Silly tavern not connected to api If you have installed anything using conda, the process is the same. Copy link Yukkun commented May 5, 2023. json file. Choose mistral. # Using getContext Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Then in silly tavern you are going to go to api selection. Let me know if it worked for you! đ I just generated a persistent API key but I didn't go down the whole 'inspect element' 'generation stream' path to finding the API key like everyone else has done because I can't figure that out. It is very smart and 8. Edit this page. What am I doing wrong? (extras) R:\AI\SillyTavern-main\SillyTavern-extras>server. You switched accounts on another tab or window. 1. To Reproduce Steps to reproduce the behavior: Go to 'API Connections' Enter API url: Multi-LLM API Integration: Connect to OpenAI, KoboldAI, NovelAI, Claude, Mistral, and other APIs for diverse AI text generation. Silly Tavern: I can't connect to Poe api anymore, I made a new account, I reinstalled node and I even downloaded a different silly tavern, and none of those helped resolve this Not Pyg Share It might be, ever other api works fine. If you don't know what this means, you might want to read the faq: https://docs. any ideas? Reply reply MopeSoap I made the mistake of 'Git Pull' today, the Oobabooga Web UI doesn't talk to Silly Tavern anymore. To check which modules are currently provided by the connected Extras API, import the modules array from scripts/extensions. Top. com but when I try to connect to lm studio it still insists on getting a non existent api key! This is a real shame, because the potential of lm studio is being held back by an extremely limited bare bones interface on the app itself. I've disabled the api tag, and made sure the --extension openai flag is applied. It does not work like that. 3B model of Pyg. Under Chat Completion Source. Sometimes Kiwi Browser's font will make I (for ice cream) look like lowercase Ls. Make sure you're on the latest update of Oobabooga's TextGen (as of Nov 14th, 2023). New comments cannot be posted. In the 10 votes, 21 comments. 8 which is under more active development, and has added many major features. As for which API to choose, for beginners, the simple answer is: Poe. js. conda activate extras, Hit Enter. I can't even click on it. You need to use the Silly Tavern AI application on your computer and it works on Android devices too. you do not need to have it connect to your multi modal API in the API tab for it to work I was going to try 2 instances of Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. , and we will not recover lost or hashed passwords. DreamGen is an app and an API for AI-powered creative writing. I don't know how to connect googleColab (Or whatever it's called) I don't know how to add characters (Or how to import characters from C. If it does not work you have to make sure you copied it in correctly. Yep, it looks like you're not connected to API. Select one or more Models ('AI brains' for the characters) from the Model Selector at the bottom of the panel. Links and materials are for informational and research purposes only. But Tavern AI continually fails to connect to the link provided by KoboldAI on startup, whether it be the local or remote play. Paste the API URL into the input box. A place to discuss the SillyTavern fork of TavernAI. SillyTavern is If you, like me, are a ppx premium user and do not want to waste those 5$/month API credits they give you, it's possible to use their models in ST. SillyTavern will "lose connection" with the API every so often. txt in your Extras install folder, which contains your chosen Extras 'password'. Additional info No response Before the ooba booga gave 2 url links to plug in silly tavern (Blocking API URL & Streaming API URL) but now it gives only one url, namely the openai API URL ex: (OpenAI compatible API Checking 'Bypass API status check' tells SillyTavern to stop alerting you about a non-functioning API endpoint. Old. A black "Windows PowerShell" window will open, and Silly Tavern will promptly open up on your selected browser. Unofficial Miyoo Mini group. Now with that out of the way, Mythomax is the best option we currently have which is a model that's completely uncensored and almost at Turbo's quality. So make sure you can manually chat with Ooga on port 7860 on its stand alone web UI first, Make sure that line has "= true", and not "= false". From here "First, of course, is to run web ui with --api commandline argument So in your "webui-user. Then paste your api code into the api key. What followed was a history of the most degenerate boundary pushing I could muster, for science, and not once did any of the models claude provided with the API refuse to comply. You signed in with another tab or window. Open the file tab on the left to access the colabâs files Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Even better if I can find a way to get it to send wake up commands to my PC, so it wouldn't need to be on all the time. Hello! I'm new to SillyTavern, and AIs in general. I've just tried using remote link and it didn't work, I'm now even using ZeroTier to allow me to connect remotely through different networks instead of the regular way and it seems to work quite well but I still can't connect to the SillyTavern extras, it just says it can't connect to the API. I installed alltalk on my pc, everything on the installation went without error, started it and now it won't even connect to sillytavern. Another point of confusion, You see, Tavern doesn't generate the responses, it's just a middle-man you have to connect to an AI system. It does respond of course but it's not being delivered to SillyTavern(the message appears simply blank, though I can view it on Poe). This is what you need to do: select chat completion - custom (openai compatible) in the connection window; Make sure oobabooga has the API turned on. Other than that, Chefs kiss. API endpoint is at port 5000 by default, look closely at the console output of textgen webui ď¸ 1 DeadGrowl reacted with heart emoji #What is the API Key box for? The API Key box in SillyTavern's Extensions panel is only used when you have: created a text file named api_key. DO NOT copy the p-b value yet. It doesn't show me ChaptGPT or any other options. ST Kobold Horde API Connection Panel Hi, I created an extension to use Stable Diffusion Webui Api in Silly Tavern, I know it has its own, but I missed to be able to pass other parameters to the command to generate images, and to use the styles of the api, it is a test version even that is what I use now myself so I launched ST and in the extensions section it still says âExtensions API: Silly Tavern-Extras Could not connect to APIâ like it did before I installed extras, but Iâm not even sure if thatâs relevant or not. To run again, simply activate the environment and run these commands. This article will discuss why is Silly Tavern AI not working or not responding and how can you fix it. Start your SillyTavern server; Open the Extensions panel (via the 'Stacked Blocks' icon at the top of the page), paste the API URL into the input box, and click "Connect" to connect to the Extras extension server. 5-turbo model for free, while it's pay-per-use on the OpenAI API. It seems to me that it is from the Intense RP API or Poe-API-Server EDIT: I just realized. com, type a message to chatgpt, then go back to Developer tools, refresh, then Application> Poe. SillyTavern is just an interface, and must be connected to an "AI brain" (LLM, model) through an API to come alive. To run Extras again, simply activate the environment and run these commands in a command prompt. Token probabilities are not available when using Smooth Streaming. That's actually good to know. I haven't managed to make it work at all. ) The ` --api` command line flag or selecting it in the extentions/settings tab and reloading the interface should turn it on, IIRC. By default, they will not be exposed to a frontend after you enter them and reload the page. Restart the SillyTavern server. I updated silly tavern and it says the API connected but there's no bots to select. txt file, and try using the --public-api flag instead. The API server settings have not been changed. It's uncensored, so no infantalizing slaps on the wrist. sillytavern. Share Sort by: Best. New. Check this if your API endpoint works, but SillyTavern keeps warning you If the API mode is disabled for SD Web UI, the Extras server won't be able to make a connection and you won't be able to generate images! # Still doesn't work? Ensure that you start everything in the proper order, waiting for every Legacy API is the culprit. Click Connect. This is a subreddit dedicated to discussing Claude, an AI assistant created by Anthropic to be helpful, harmless, and honest. So, I am only seeing the problem in the DEV branch. r/Passwords is a community to discuss password security, authentication, password management, etc. On your keyboard: press WINDOWS + R to open Run dialog box. From there, you should be able to connect to it in the extensions tab of Silly. 4-fix" Reply reply FoxTimely5569 ⢠I managed to make ST-fix connect to the API but the bots doesn't respond. I'll check it out once I get home from work today. Doesnât matter whatever I do. You are using Poe Integration, but as if it were the Try RP API or Poe-API-Server. ApI just started working on silly tavern. Filter occasionaly pops up, but waaaaay easier to dodge than on poe SillyTavern is able to connect with Horde out of the box with no additional setup required. Then, run the following command to install git: cmd /c winget install -e --id Git. When I'm not connected to the extras API on Silly Tavern a lot more expressions pop up but when I connect it to the API so it actually works https://discord. Then I reinstalled Termux and redid the whole process to run silly Tavern, the interface was updated and it worked normally. It's like the messages arrive later after being sent. This community allows you to exchange your knowledge, ideas and experience related to the G2A marketplace. Describe the bug When trying to connect to koboldcpp using the KoboldAI API, SillyTavern crashes/exits. Therefore, changing the API platform can fix the issue. They stuck to the character sheet, the performed to the best of their ability, they initiated their own degeneracy, and my day ended by hitting the 1m input token rate limit. 12. 0:8020? (Similar to above, hosting on Windows pc and connecting via Android on local network) Working on the pc, but can't connect via Android. Key is valid I am not sure what is the problem. GPT4 API is very good for roleplaying. The tutorials are available in Matthew Berman or Aitrepneur 's youtube channels. Problem is I don't understand how to enable the API server for this. I've set everything up and put SD in API mode, but SD still doesn't appear in Silly Tavern's active extensions. But I can do it locally. But when I type messages into SillyTavern, I get no very time I try and use SillyTavern, no API connects. We cannot guarantee accuracy of user posts. 32 Version 1. But now I have two difficulties. Essentially, you run one of those two backends, then they give you a API URL to enter in Tavern. Every time I try and use SillyTavern, no API connects. com> cookies, copy the value manually Do not log out after, just close the page. It was just weird that only Mancer was doing this and not any of the other models I've used in Silly Tavern, but if this helps alleviate that issue, then Mancer will quickly take the top spot for me as it's already had better responses in general, except for that one issue In silly tavern, should the provider endpoint then remain 127. Described on the page you linked: create an environment, activate it, download python to it, clone the repository, install the requirements, then Run the Extensions API server. Complete all the fields below. Copy it and make sure to save it somewhere secure as you will not be able to see the full thing again. I'm not sure why; I have the --api flag on, and I checked to make sure all my ports are forwarded and everything, but it just always says it can't connect. Refreshing the page also works. The same message typed directly on the comouter works okay, generating text on my phone directly on Oobabooga These AI's (local language models) are not as sophisticated as the ones you find online. This custom endpoint can connect to alternative Chat Completion APIs that support the generic OpenAI API schema. Click the 'View hidden API keys' link at the bottom right of the API Connection Panel. Downloaded an interface between the AI and your computer that will provide the api details you are after. I managed to make it work on normal Tavern once but it You can encounter a Tavern AI no connection issue if one of those APIs does not support your device. . 0 Desktop Information No response Describe the problem When trying to connect to a ollama server on the same computer i get Can get it to connect, and it does send the message through to the Poe bot, but the response doesn't get sent back to SillyTavern and I'm not sure what the solution is, so I'm stuck there. You can also use your own Claude and OpenAI API keys there. I only have 6GB of VRAM so I'm stuck running the 1. This makes the Extras API 'password locked', so only users who have that key in their API Key box can access it. /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper Hello everyone, I am new to ST extras, everytime I open ST I have to run the online colab to get the new link again for the API, otherwise I cannot use the extras with the message "could not connect to API". This is where your Silly Tavern interface will live. Step 1 - Choose OpenAI as chat completion source, enter API key, and hit the "Connect" button. It was working great up until a few min ago. Edit the CMD_FLAGS. Step 2 - Check the "Show "External" But I'm not exactly familiar with using Python, or what an API is, and I can't seem to simply find the files for these extensions to grab and stick into the extensions folder. SillyTavern saves your API keys to a secrets. However, it seems that this feature is breaking nonstop on sillytavern. ai; Custom API Key: They key you copied from step 2 above. I managed to install the Tavern, run the thing, ALSO: upon entering the localhost address into Kobold's API url field and trying to connect, nothing happens. cpp directly before but I saw some people saying it's much faster when used directly compared to when used inside Oobabooga Text Gen. Make sure a model is running in oobabooga. r API: Text Completion; API: Infermatic; Custom Endpoint (If selected vLLM or Aphrodite): https://api. # Text Completion. Otherwise your bug report will be ignored! Have you searched for similar Yes Describe the bug When I start SillyTavern while Poe API is on it's load for some A place to discuss the Miyoo Mini, Mini+, A30 and Flip. 2. Best. I'm using both with the Cohere API and the non-plus version is objectively better, like it's not even close. js file in st so it no longer points to openai. That's weird since I'm having the issue on the main branch and I'm not using the dev version of It. This is mainly useful for people who want to make their own public public deployment of Extras (colab, etc). Correct Way to Connect SillyTavern to Ooba's new OpenAI API Make sure you're on the latest update of Oobabooga's TextGen (as of Nov 14th, 2023). Be sure to the additional But the moment I try to verify API connection using the test message, it comes back as "Could not get a reply from API. But they are getting there. TL;DR: copy and paste the IP address of the window that Kobold AI opened in your browser, into the "connect" window of Tavern, and hit the "connect" button. 1. In order to enable viewing your keys: Set the value of allowKeysExposure to true in config. Does not exist in Poe Integration. Ooba API tends to break often but when it works, it works I just did it, connected it to Sillytavern and got a response. Silly can't really tell Ooga to load a specific model. I saw two tutorials on YouTube on how to open the Tavern on the phone, I even managed to connect Poe API. Customizable UI: Adjust themes, layouts, backgrounds, and font styles to suit personal preferences. Itâs In this tutorial, I show you how to use the Oobabooga WebUI with SillyTavern to run local models with SillyTavern. Go to poe. thanks! It says that the API is connected and the prompt is also sent to Stable Diffusion, Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Open comment sort options. the send button turns into the âabort requestâ button but the bot doesnât generate a message. Install python,pip and git, I'm not going to put that in this tutorial because there is already a lot of it on the internet. From my testing, it generates a response in around 8-11 seconds. Ai 'the bloke llm' running oogabooga, I can get the model loaded running interfacing nicely through its standard web interface But I cant get a remote terminal / Silly tavern to connect properly even with the API & OpenAI flag enabled in ooogabooga I'm trying to use the OpenAI extension for the Text Generation Web UI, as recommended by the guide, but SillyTavern just won't connect, no matter what. Install Poe-API-Server manually (without docker) - Step 1: Python and git. SillyTavern has very serviceable presets, so no problem there. Make sure that line has "= true", and not "= false". They have a free tier, as well as a paid subscription that allows unlimited monthly access to their high-quality in-house text generation models made specifically for the purpose of steerable AI-assisted writing. Examples of backends which implement this API are: LM Studio; LiteLLM; This feature is not required for custom API endpoints to work and might not be available on every backend. live link that works perfectly fine when I paste it in any browser. Select a character and begin chatting. Then hit âconnectâ connect to our API. But when I put it in the Silly Tavern API field, it won't connect and says "Models endpoint Sillytavern says (could not connect to the API) Silly tavern extras woes I did the github guide and got it running localhost. I have Stable Diffusion set up to run with --api so that I have something to send to the extras extension, but the extras extension just has the red text that says "Could not connect to API". 127. Hi! I created a public API for my oobabooga and enabled share. Created by fans & NOT officially connected to Miyoo. I've no idea what it means under the local install instructions (specifically Option 2:Vanilla) to run certain commands: is it a script I have to write myself for Python? Sorry if this is a noob question, I never used llama. question for you: i am connected to the api, but when i send a message the bot doesnât send anything back. NO ROM/BIOS links. gg/XH7qjSyG On the silly tavern discord, navigate your way to the thread called "character sprites" inside the Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. You can copy and paste that file into the Poe website manually to let it generate that message, and then copy that message into the empty AI response within SillyTavern by editing the message and pasting the generated response. 1 is now on Infermatic API upvotes After fighting with docker for most of the day and it still not working, i am so glad that this works! After fighting with docker for most of the day and it still not working, I am so glad that this works! ms very hesitant to engage in any NSFW, even using a pre-jailbroken bot. It works fine if I use the WebUI itself, and Have you searched for similar bugs? Yes Describe the bug Similar bug described in TavernAI/TavernAI#189 But I cannot find logs in SillyTavern to confirm To Reproduce Steps to reproduce the behavior: Start up laptop with no network. LlamaCPP: Available; Text Generation WebUI (oobabooga): Available; TabbyAPI: Available Not sure how to fix it during install, but you can manually fix it after ooba is installed. This is not a "local" service, you need to be able to connect to us. Environment đŞ Windows System Firefox, Win 10, ollama 0. Silly Tavern Not connecting API Non-CAI I use Poe however i put in the correct p-b cookie and i even watched videos. I'm trying to use a model not offered in the Colab, so running it locally is my best option. i am on the silly tavern fix stable I did every command and stuff right multiple times, but it still says Not connected to Api. Step 0 is to do that. It spits out a gradio. If anybody had the same problem or has an idea whats going on I would appreciate the help. Q&A. Am I doing this right? I connected the API key I have to SillyTavern and I successfully connected it but, again, I have no idea what I'm doing. When I try to connect to the koboldcpp API over the local network, nothing happens (no connection). DO NOT CLOSE THE BLACK WINDOWS POWERSHELL WINDOW. It's not pay-as-you-go, so you can't rack up a huge bill. (I can't remember which of the API flags turns on the API that SillyTavern is looking for, so you might need to enable both. Once in the desired folder, type ` cmd ` into the address bar and press enter. I agree with you though I too prefer written instructions, but between the two video's I think he did a decent enough job. # Quick Start. Sillytavern says (could not connect to the API) i want to try out all of the features but no dice. Scale API is not free, but offers a $5 trial if you link a credit card. The channels I mentioned have instructions for Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Ideally I'd love to use cloud flared or anything to remotely connect with it while I'm not at hone Help please :3 Share Add a Comment. Reply reply More replies More replies. app/usage/faq/ Hey, just wondering, but are you using Correct Way to Connect SillyTavern to Ooba's new OpenAI API. While using the ST-hosting device, access this page and look for IPv4 . Token probabilities are not available from all APIs. py, Hit Enter. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. scale. I can successfully connect the API to the URL and I have a model loaded into Kobold. Click "Connect" and select a model (Optional) Use the "Test Message" button to verify your connection # WindowAI. Controversial. Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. As far as clicking bypass authentication, still necessary. In theory Perplexity API follows OAI specs, in practice it does not work out of the box. We do not hack accounts, we are not professional support for Google, Facebook, Twitter, etc. I have seen a suggestion on Reddit to modify the . 10. This time it was worse, it started ignoring my recent answers in a way the conversation was coherent at all. I know there's probably a simple solution, but still, any help would be appreciated. Warning. Beware that this is not easy. In the video the guy assumes that I know what this URL or IP adress is, which seems to be already filled into the information when he opens up tavern. 4-fix. Users running Extras on their own PC for personal use should not type anything into the API Key box. Image Generation: Integrates with Automatic1111 and ComfyUI APIs for generating AI-driven images alongside conversations. Git. (Avatar sub credits: Cimpix17) Oobabooga has a separate colab that provides an API for my Tavern fork to use. Just want you to know that as of the most current release version of silly tavern, you do not need to change the local host URL in the config. ; started extras To connect to Runpod. Wrong API key: Make sure you copied yours in correctly! Bad model name/url: Make sure you copied it in correctly! # HELP! - I can't connect! (No connection) Make sure you copied in the URL correctly (it should start with https, not http!) Make sure you have internet. Implementation and documentation are inspired by the work of khanon on TavernAIScale. But until I do one of those things, ST will refuse to send anything to KoboldCPP. however when i click connect it dosent even register it and dosent respond. What am I doing wrong? Reply reply Top 4% Rank by size . If changing the API platform does not fix If you do not have Silly Tavern 1. Boom, you can now use mistral api to chat. Go back to SillyTavern on your phone, paste the value It should connect now. You signed out in another tab or window. ] Just a few hours ago the bots were working just fine. Chats are not isolated from each other, Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I've checked, and the I am using an open ai api key for silly tavern but for reason it just says "entered reverse proxy address is not a valid url" when i enter my openai This guide is for people who already have an OAI key and know how to use it. 4 fix, then follow the GitHub post until you reach "Run: cd SillyTavern-1. I'm sure there's something going on that's causing this for me, but CMDR+ gets repetitive real quick, but so much so that at some point, But if you do manage to get it to connect, I've noticed that the txt file still gets updated but it's just not getting sent through to Poe. totalgpt. It fails to connect. Not that I use that for Silly. However, when I message the bot on Silly Tavern, I get no replies. 8. I just finished installing and setting up Silly Tavern, but I'm very new to this type of thing. Silly Tavern API URL . One such interface is called Oobabooga. Application of password security and research are on-topic here. Not even when I refresh the page, nor wait for 3 days. Configuring these tools is beyond the scope of this FAQ, you should refer to their documentation. Please ensure you follow the rules: Be respectful, conversations primarily in English, no low-level posts/comments, and BITSAT / Admissions questions should be in the weekly thread. I cannot, for the life of me, figure out why it isn't working. More posts you may like r/webdev. If you do not see it you did not select the bot before opening developer tools correctly. You just put localhost as an address instead of some onlineservice. Silly will require that Ooga already have the model loaded on its end. Install oobaboga. I have both installed and both running. [Edit: This is for Silly Tavern-1. It doesn't actually lose connection at all, from what I can tell, as simply opening up the API menu in ST and clicking Connect will fix it every time. This subreddit is a community for BITS Pilani students, alumni, faculty across Pilani, Goa, Hyderabad and Dubai campuses. Create A New API Key. It fails to connect and in the Ooga window, I just get repeated messages saying. Download a model and setup silly tavern to connect text-generation-webui. It gives access to OpenAI's GPT-3. python server. By default, API keys will not be visible from the interface after you have saved them and refreshed the page. I've disabled the api tag, and made Check your connection settings / API key and try again. On your keyboard: press WINDOWS + E to open File Explorer, then navigate to the folder where you want to install the launcher. /v1 will be auto-trimmed in Text Completion mode (cause non-OAI endpoints for token counting and model info for ooba don't use the /v1 scheme), but it won't The API server is not hosted at port 7860, it's for Gradio UI only. However, many users have reported that they are facing the issue of Silly Tavern AI not working or not responding. I do not have Legacy API selected. I'm using the same configuration as with the Anthropic and OpenAI APIs so I'm a bit lost. optional - extension could be installed and will always be loaded, but any of the missing Extras API modules will be highlighted in the "Manage extensions" menu. 01:5000 is koboldai api endpoint of oobabooga. The available models drop Hey all, since I last updated Ooba, I cannot seem to connect it to SillyTavern or Agnai anymore. Select 'AI Horde' from the API Dropdown Selector in the ST API Panel. S In the API tab (the plug icon) you select the API you will use for image captioning and set the API address and API key if used. If you are using an API that does not support token probabilities, the panel will open but will not display any information. If you (or someone else) want to connect to your hosted ST while not being on the same network, you will need the public IP of your ST-hosting device. But it doesn't seem to Now I'm able to load Silly Tavern and Oobabooga on my phone. py--enable-modules=sd --sd-remote Initializing Stable Diffusion connection I have tried launching the extras server with the simple launcher's UI, but I don't see anything new happening in the command prompt. I managed to get a good chunk of responses the other day, but now whenever I connect my API to Poe, it leaves me in a blank option. Currently contiplating between silly tavern local or a paid subscription to No clue on how to get it all running. Reply More posts you may like. txt file, and add the --api flag there. Getting the API key is simple. I wanted to use Silly Tavern with a TheBloke model from hugging face while on my laptop, so I quickly coded a simple Google Colab that gives you the required API key for SillyTavern. After pasting it in connect and check off autoconnect to last connection. json file in the server directory. By using in base I'm trying to use the OpenAI extension for the Text Generation Web UI, as recommended by the guide, but SillyTavern just won't connect, no matter what. AI) This problem happened again using another bot on silly tavern but at message 14. Please help, how do I fix this? Edit: It can connect when I use Horde, but not when I don't, for some weird reason. You need to select KoboldAI API in SillyTavern. Credits to Cohee for quickly implementing the new API in ST. yaml file. 0. bat": set COMMANDLINE_ARGS=--api" That way when you run it, near where it says running on local URL it will have an API link - thats Copypaste the adress Oobabooga's console gives you to Api connections and connect. COM. Let me just tell you this upfont, there is NO completely free and unlimited option at the moment aside of running models locally. 1:8020 or does it need to change to 0. I don't use Horde or pay for API access out of principle, so if I can keep my LLMs loaded on the inference server on my main PC, and just use RPi to keep the Tavern open, that would be great. Add a Comment. Create a Scale Spellbook account at https://spellbook. Each of them will provide an API (look in the documentations) that Silly Tavern can connect to. Same here. " and "Bad Request". SillyTavern is a fork of TavernAI 1. If Tavern is a user Skip to main and explanations to all the issues connected with G2A. Exactly as the title says. Technical Question Can someone tell me how I can get a URL to connect it? Locked post. Similarly, when trying to connect to the oobabooga API, the situation is the same. You're going to choose chat completion. The issue I've seen for some is literally just how comfortable you are with English. Hello, can you please tell me if SillyTavern has its own api, through which I could send and receive messages, for example through discord bot? The text was updated successfully, but these errors were encountered: All reactions. Edit: Today it's not working. Update text-generation-webui and launch with the --api flag, or alternatively launch it through this Google Colab Notebook with the api checkbox checked (make sure to check it before clicking on the play buttons!) So after running all the automated install scripts from the sillytavern website, I've been following a video about how to connect my Ollama LLM to sillytavern. It has no requirements for your device. 2. I'm away from my PC so I can't really look into it right now. I can't speak for the OP, but when I switched to an up to date main branch, the problem DOES NOT persist there, and am able to select API's and use them. Reload to refresh your session. Claude does not actually run this community - it is a place for people to talk about Claude's capabilities, limitations, emerging personality and potential impacts on society as an artificial intelligence. com Paste the API key and URL into the appropriate fields and click "Connect" # Credits. But, it's all mine, and I'm not the mercy of some company like Luka, Inc for example. Once you subscribe you connect the API key you get to your Chat GPT Turbo is cheap, but GPT4 is apparently not haha. That's it. It says it is processing, so it detects alltalk running, but then just gives back "error". Perhaps you've heard of Make sure that line has "= true", and not "= false". So, I was wondering: what are Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Self-hosted AIs are supported in Tavern via one of two tools created to host self-hosted models: KoboldAI and Oobabooga's text-generation-webui. you can connect to test if it works but then switch back to the chat API and reconnect to it. When I try to connect to Pygmalion running on Oogabooba, it doesn't work. Is this normal? Also, sometimes, the extras won't work so I have to restart the ST and get the API again as mentioned above. Obviously you will need a decently strong Nvidia card with at least 12 GB VRAM for small, quantized models. 3. WindowAI is a browser extension by the makers of OpenRouter that allows control of your OpenRouter connection for any enabled site or web app. Or server. In order to enable viewing your keys by clicking a button in the API block: Set the value of allowKeysExposure to true in config. Tavern is a user Skip to main You are not connected, that's why your "plug" is red the second icon on the bar, it symbolize your connection to the API Reply reply Imaginary-Ticket-520 Karasu Mixtral 8x22B v0. jdo pujle iswn xgripa vnfderx fnzqa pmvuhd aebthky psr piii