Text version - https://docs. This repository contains a little bridge script which you can run on your own machine (windows or linux). Once the deployment is completed you will get the following URLs. Picard is a model trained for SFW Novels based on Neo 2. It's a single self contained distributable from Concedo, that builds off llama. It uses the AI Horde which lets you use a variety of AI Models. You can use the remote address displayed in the remote-play. KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models. Only Temperature, Top-P and Top-K samplers are used. Notifications. You'll have to create a new account. net - Instant access to the KoboldAI Lite UI without the need to run the AI yourself! KoboldCpp - Run GGUF models on your own PC using your favorite frontend (KoboldAI Lite included), OpenAI API compatible. Changelog for KoboldAI Lite 13 Jan 2023: Added integration with Stable Horde to auto generate images inside your stories and Entering your Claude API key will allow you to use KoboldAI Lite with their API. Login with your Horde API key and click your username to access this feature. net) and then type a username. KoboldAI Horde. This will allow people to use their own PCs to 2024-05-20 - Generate QR Codes. Bobby#1234) from the merged horde. (KoboldAI) #332. There are two built-in methods to gain Kudos at the moment: Any time your KoboldAI server generates text for someone, you receive tokens based on the amount of text generated and the power of your model. Generator version: 7. Its primary purpose is to assist users in generating high-quality, contextually relevant content with ease. Horde will allow you to contribute your own GPU (or any other Kobold instance) to the community so others can use it to power KoboldAI. net horde) Go Step 2 Step 2 - Please enter your NEW API Key, OR new full username (e. However, I'm encountering some challenges with maintaining consistency, especially when it comes to relationships between characters and geographic continuity. io or vast. 1 13 0. The second part is the bridge, which is what people who have their own KAI instances run, in order to connect the KAI server to the server. The Gantian - Creator of KoboldAI, has created most features such as the interface, the different AI model / API integrations and in general the largest part of the project. You can find visit official KoboldAI Horde. Links - L KoboldAI Lite - A frontend for self hosted and third party API services. A Discord chatbot that uses OpenAI's API to generate conversation. koboldai. I have an api key from horde. net domain for this project, this is not a hostile takeover of a domain. 4. The full dataset consists of 6 different sources, all surrounding the "Adult" theme. May 16, 2023 · SillyTavern / SillyTavern Public. :l Reply reply May 20, 2024 · 2024-05-20 - Generate QR Codes. VE FORBRYDERNE - Contributed many features such as the Editing overhaul, Adventure Mode, expansions to the world info section, breakmodel integration, scripting support KoboldAI is a powerful and easy way to use a variety of AI based text generation experiences. bat. 19 has now been officially released, this is the last update before our new UI work will make an apperance. net and select " AI " and choose " Custom Remote Play Endpoint ". Wait for Installation and Download: Wait for the automatic installation and download process to complete, which can take approximately 7 to 10 minutes. alpindale. When making an API request to the Kobold AI model, you typically send a POST request to the API URL with a JSON body. " The Gantian - Creator of KoboldAI, has created most features such as the interface, the different AI model / API integrations and in general the largest part of the project. You can use it to write stories, blog posts, play a text adventure game, use it like a chatbot and more! In some cases it might even help you with an assignment or programming task (But always make sure the information the AI mentions is correct, it The API documentation for the AI Horde. ai, and set KoboldAI up on those platforms. In your browser, go to that trycloudflare url, the select your preferred model to load. The Public version allows people without a powerful GPU to use Stable Diffusion or Large Language We would like to show you a description here but the site won’t allow us. 5. image-based workers [{"date_published":"2024-05-20","newspiece":"You can now generate QR Codes on the AI Horde! Currently this functionality is only available for Stable Diffusion 1. Dbzer0 is allowed to use the koboldai. To ensure you avoid this fate, please login using one of the buttons above May 20, 2024 · 2024-05-20 - Generate QR Codes. 6k. net. In this case, you will need to run the development version of Kobold AI on your PC to use them. Registering KoboldAI is a powerful and easy way to use a variety of AI based text generation experiences. cpp, and adds a versatile Kobold API endpoint, additional format support, Stable Diffusion image generation, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info, author KoboldAI Client supports using the AI Horde directly from its interface. StableHorde. You can use this to connect to a KoboldAI instance running via a remote tunnel such as trycloudflare, localtunnel, ngrok. . When I use kobold lite I see koboldcpp named volunteers so I wondered if I can also become a koboldcpp volunteer. With this brand new API you can now use the power of KoboldAI within your own software, its a json based REST API and accessible by Here's the 13 January 2023 release for KoboldAI Lite which brings Stable Horde Integration, improved chatmode, colorful text, v1 sync API and a bunch of other bugfixes! https://lite. While the name suggests a sci-fi model this model is designed for Novels of a variety of genre's. Kobold AI Old UI. It is infinitelly scalable and supports seamless drop-in/drop-out of compute resources. By default, your SillyTavern instance connects to the Horde's low priority 'guest account'. This is in line with Shin'en, or "deep abyss". The API documentation for the AI Horde. codegen. You can also rent access to systems with the requisite hardware on runpod. VE FORBRYDERNE - Contributed many features such as the Editing overhaul, Adventure Mode, expansions to the world info section, breakmodel integration, scripting support This software enables you to join your KoboldAI client to the KoboldAI Horde and make it into a worker. Sep 3, 2022 · Introducing the KoboldAI Horde! This is a python server which you run on a server somewhere and it provides an interface with which people can request GPT writing generations. To use it go to the AI menu on the top left, then select Online Services > KoboldAI Horde. Oct 9, 2023 · - These hosts run API endpoints on their own PCs/servers for Horde users to access. com/LostRuins/koboldcppAI Horde - https://stablehorde. Once loaded, copy the trycloudflare url that appears. ¶ Automatic Download KoboldAI Horde. Knedlex. Kobold AI New UI. I left out some stuff that i thought was useless. It will throw an "API Error" from a generated Kobold Horde API key. This package provides some tools to help manage the model metadata which AI-Horde uses. Set Display Name. A crowdsourced distributed cluster for AI art and text generation - AI-Horde/README_StableHorde. Click on ‘Generate New API Key’. Github - https://github. NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Jun 17, 2023 · Run language models locally via KoboldAI on your PC. SDK version: 1. Picard by Mr Seeker. It will take care of communicating between the KoboldAI Horde and your own KAI Worker. Hence, a higher number means a better KoboldAI-Horde-Bridge alternative or higher similarity. The name "Erebus" comes from the greek mythology, also named "darkness". 11K subscribers in the KoboldAI community. I keep running into an issue where every time I register for a Kobold Horde API key and put it into the AI window on Kobold Lite. "Server is busy. This repo turns your PC into a AI Horde worker node. Remember to store this key in a secure location, as it’s essential for all May 20, 2024 · 2024-05-20 - Generate QR Codes. It is meant to be used in KoboldAI's regular mode. VE FORBRYDERNE - Contributed many features such as the Editing overhaul, Adventure Mode, expansions to the world info section, breakmodel integration, scripting support The Gantian - Creator of KoboldAI, has created most features such as the interface, the different AI model / API integrations and in general the largest part of the project. Jun 13, 2023 · Start Kobold AI: Click the play button next to the instruction “ Select your model below and then click this to start KoboldA I”. Model description. No connection. KoboldAI supports both automatic downloads and manual downloads. You will need a PC with at Step 1 - Please enter your KoboldAI API Key (For original KoboldAI. Once you have received the URLs you need to wait for sometime for the tensors to be loaded. Erebus 2. Step 2: Find the Link in Terminal or Command Prompt. net KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models. " Go to your local koboldai installation and run remote-play. You can use it by connecting the Kobold AI API. Select 'KoboldAI Horde' from the API Dropdown Selector in the ST API Panel. It allows people without a powerful GPU to use KAI by relying on spare/idle resources provided by the community. md at main Hi everyone,I've been using KoboldAI Lite for my writing projects and I'm loving it so far. Novel. net Picard by Mr Seeker. KoboldAI Discord - Meet The Gantian - Creator of KoboldAI, has created most features such as the interface, the different AI model / API integrations and in general the largest part of the project. Whether you’re a content creator, marketer, or business owner, KoboldAI API offers a comprehensive solution to meet your May 20, 2024 · 2024-05-20 - Generate QR Codes. KoboldAI is a program you install and run on a local computer with an Nvidia graphics card, or on a local with a recent CPU and a large amount of RAM with koboldcpp. Get one at https://aihorde. Based on a fork of TavernAI 1. Added /docs endpoint which is an alias for /api, containing API documentation; Embedded Horde Worker job polling URL changed to aihorde. Once load is done, go to https://lite. Star 6. We have prepared a very simple installation procedure for running the bridge on each OS. Also trying to figure this out. If the models window hasn't appeared yet, click Jun 14, 2023 · 6. Atmospheric adventure chat for AI language models (KoboldAI, NovelAI, Pygmalion, OpenAI chatgpt, gpt-4) - TavernAI/TavernAI 这使得KoboldAI不仅是一个写作助手、游戏,还是一个更多用途的平台。 您玩的方式和 人工智能 的表现取决于您决定使用的模型或服务。 无论您想使用免费、快速的 Google Colab 、您自己的高端图形卡、在线服务(例如 OpenAI 或Inferkit)的API密钥,还是您宁愿在CPU上 I won't go into how to install KoboldAI since Oobabooga should give you enough freedom with 7B, 13B and maybe 30B models (depending on available RAM), but KoboldAI lets you download some models directly from the web interface, supports using online service providers to run the models for you, and supports the horde with a list of available The horde desperately needs more volunteers as well. js node. dev/local-installation-(gpu)/koboldai4bit/If link doesn't work - ht KoboldAI is a program you install and run on a local computer with an Nvidia graphics card, or on a local with a recent CPU and a large amount of RAM with koboldcpp. CSharpClientCodegen. Keep the colab page open and check for occational captcha's, otherwise they will We would like to show you a description here but the site won’t allow us. For now it shows all the text-based clients connected to the horde and shows most of the information contained in the API. Up to and including sniffing the packet traffic between KoboldAI and the TavernAI server. To use this functionality, your frontend needs to support it so that you can type the text you wish to be made into a QR code and to specify the specific qr_code workflow. Copy Kobold API URL: Upon completion, two blue Kobold URL Use your PC (CPU method) to run AI language models for other users. May 20, 2024 · 2024-05-20 - Generate QR Codes. You need an API key to use AI Horde to generate text. Aug 22, 2023 · Here’s a easy step-by-step guide on how to use the KoboldAI API URL: Step 1: Run KoboldAI API on Your Computer. It is focused on Novel style writing without the NSFW bias. API Version 2. Was using "asmodeus" by default. The AI Horde is an enterprise-level ML-Ops crowdsourced distributed inference cluster for AI Models. GET /v2 /documents Returns all the statistics of a specific model in this horde. cpp, and adds a versatile Kobold API endpoint, additional format support, Stable Diffusion image generation, backward compatibility, as well as a fancy UI with persistent stories, editing tools, save formats, memory, world info, author Jun 23, 2023 · Choose Version as United. E. Closed. NOTICE: At this time, the official Claude API has CORS restrictions and must be accessed with a CORS proxy. net/More abo Haidra-Org/AI-Horde-Worker. Kobold AI API URL. Entering your Claude API key will allow you to use KoboldAI Lite with their API. Kobold AI Lite. These are mostly the same – the file is opened in binary read-write mode and then seeked to the start of the file – except the former mode deletes the contents of the file prior to opening it and the latter mode does not. This middleware can support both Image and Text generation. (for the "Error!" Mostly. For example, I'm trying to ensure that familial relationships (like siblings or parent-child relationships) and romantic relationships (boyfriend #koboldai #koboldai #koboldaitutorial #koboldaiapiurl #koboldai apiTavern AI:https://github. Silly Tavern is an interface which you can use to chat with your AI Characters. API Request. Brand new API by VE Forbryderne. Registering Jun 14, 2023 · Additionally, you can easily interact with the AI with KoboldAI API URL. exe process if necessary. net Nov 1, 2023 · I'm willing to go all the way to the bottom of this rabbit hole with you as I am involved with the KoboldAI/KoboldAI-Client project as well as working on TavernAI itself. and flexibility. co/PygmalionAI Mar 8, 2023 · What it does. KoboldAI United - Need more than just GGUF or a UI more focussed on writing? KoboldAI United is for you. Links - L Set Display Name. You can now generate QR Codes on the AI Horde! Currently this functionality is only available for Stable Diffusion 1. KoboldAI servers get “uptime” rewards every 10 Dec 15, 2023 · KoboldAI API is a sophisticated artificial intelligence tool designed to streamline content creation processes. Jul 24, 2023 · *When generating a new response from an ai module through horde, with any of the modules connected to the koboldai horde the following message appears almost instantly on the Windows PowerShell command prompt while causing the request not to send or receive. PUT /v2 /status /modes Sep 10, 2022 · A Kudos is a reward gained when someone contributes to the well-being horde in some way. 0. This turns KoboldAI into a giant crowdsourced distributed cluster. Select one or more Models ('AI brains' for the characters) from the Model Selector at the bottom of the panel. With this release you can enjoy the following improvements. A refeference of text models that can be used in the AI Horde. You can use it to write stories, blog posts, play a text adventure game, use it like a chatbot and more! In some cases it might even help you with an assignment or programming task (But always make sure the information the AI mentions is correct, it KoboldAI Lite - A frontend for self hosted and third party API services. There are only around 40-50 workers at any given time. bat window or colab window, note that the model must be loaded first. Mostly just plain javascript and HTML so feel free to review. net; Embedded Horde Workers will now give priority to the local user, and pause/unpause themselves briefly whenever generating on a local active client, and then returning to full speed when idle. Finally unlike many of these services, Horde also provides a fully fledged REST API you can use to integrate your applications, without worrying about costs. g. 2024-05-20 - Generate QR Codes. cpp which is excellent, portable and literally one click, and KoboldAI, with the very fast and vram-efficient exllamav2 backend: For anybody who wants to just play without having to setup or run other software in the background or install python etc. In the next window that opens, you have to fill in the url of the Horde (You can use https://aihorde. Localhost IPs are not fully supported. Mobile-friendly layout, Multi-API (KoboldAI/CPP, Horde, NovelAI, Ooba, OpenAI, OpenRouter, Claude, Scale), VN-like Waifu Mode, Stable Diffusion, TTS, WorldInfo (lorebooks), customizable UI, auto-translate, and more prompt options than you'd ever want or need + ability to install third-party extensions. See either section for your use case. Once done you can start using the new UI. I’ll probalbly add more things and change some stuff, like showing the kudos better or colorizing all the properties, that’s for 1. Haidra-Org/horde-model-reference. WARNING: You are not logged in! If you submit a username, it will create a new user with a random API key which cannot be maintained by us! If you forget/lose this API Key, there's nothing we can do to recover it. </p> <p>If KoboldAI does possess an open file handle to the configuration file, that open file handle is returned without . cpp, and adds a versatile KoboldAI API endpoint, additional format support, Stable Diffusion image generation, speech-to-text, backward compatibility, as well as a fancy UI with persistent stories Entering your Claude API key will allow you to use KoboldAI Lite with their API. It's a single self-contained distributable from Concedo, that builds off llama. com/TavernAI/TavernAIPygmalion:https://huggingface. To ensure you avoid this fate, please login using one of the buttons above KoboldAI 1. SillyTavern can access this API out of the box with no additional settings required Uses the GPU of individual volunteers (Horde Workers) to process responses for your chat inputs At the mercy of the Worker in terms of generation wait times, AI settings, and available models Nov 1, 2023 · I'm willing to go all the way to the bottom of this rabbit hole with you as I am involved with the KoboldAI/KoboldAI-Client project as well as working on TavernAI itself. I'm hosting on the horde and I keep getting this warning: To host on horde you need a personal API key which you can obtain from https://horde. Second, the Horde gives you all the benefits of a local installation, such as freedom in prompts, while still allowing a browser interface. Those cost roughly $0. Select a character and begin chatting. 7B. Navigate to the ‘API’ section. The backends du jour are koboldcpp, a frontend for llama. Seeker. This JSON body should contain the context field, which holds the context based on which the model should generate a response. It's a single standalone static HTML file that uses the v2 Horde API and has all the basic config and writing functionality implemented in JS. AID by melastacho. Understanding Kobold API Requests and Responses 6. We would like to show you a description here but the site won’t allow us. Note that KoboldAI Lite takes no responsibility for your usage or consequences of this feature. Api - the C# library for the AI Horde. ¶ Installing Models. To Reproduce Steps to reproduce the behavior: Go to 'API' Click on 'KoboldAI Horde' Sep 19, 2023 · Kobold AI Lite is an interface where you can chat with your Favourite AI Characters. This C# SDK is automatically generated by the OpenAPI Generator project: API version: 2. 2. Added new feature: Anthropic Claude API Sep 19, 2023 · Kobold AI Lite is an interface where you can chat with your Favourite AI Characters. KoboldAI. It also allows clients other than KAI, such as games and apps, to use KAI-provided generations. First, you need to make sure the KoboldAI API is running on your local machine. v2. 8 Multiple backend API connectivity (KoboldAI, KoboldCPP, AI Horde, NovelAI, Oobabooga's TextGen WebUI, OpenAI+proxies, WindowAI, OpenRouter) Visual Novel-like Waifu Mode; Horde Stable Diffusion generation; TTS support (ElevenLabs, Silero, and built-in OS) WorldInfo (lorebooks) Author's Note / Character Bias To do so, they need to run a software we call the AI Horde Worker, which bridges your Stable Diffusion inference to the AI Horde via REST API. Wait times have been very high for anonymous and 0 kudo users for a while now. Click the Play button. KoboldCpp is an easy-to-use AI text-generation software for GGML and GGUF models, inspired by the original KoboldAI. Jul 8, 2023 · Here’s a guide on how to install KoboldAI locally on your PC so you can run Pygmalion for things like JanitorAI, SillyTavern, etc. 1. Haidra-Org/AI-Horde-text-model-reference. The system will generate a new API key for you. openapitools. This is the second generation of the original Shinen made by Mr. 50/hr or so to use. languages. This is a tutorial on how you Note that a server side bug currently prevents workers from clearing their descriptions - so any description you set cannot be removed at this time, only replaced. The KoboldAI Horde has arrived! Couple of things to clarify in case people get confused. Fork 2k. Example: Jun 14, 2023 · After creating an account on the Kobold AI platform, you can generate your API key through the following steps: Login to your Kobold AI account. You can get it from KoboldAI’s GitHub page and follow their instructions to run it. Any way I can resolve this so I can stop using the "anonymous API?" Hi u/stampela u/ScorchDraken I've pushed a fix, please let me know if it solves Entering your Claude API key will allow you to use KoboldAI Lite with their API. If you want to train a soft prompt, you can use a Colab notebook provided by the Kobold AI community. Build package: org. 0 Python KoboldAI-Horde-Bridge VS discord-openai-bot. Yunlincalvin opened this issue on May 16, 2023 · 4 comments. VE FORBRYDERNE - Contributed many features such as the Editing overhaul, Adventure Mode, expansions to the world info section, breakmodel integration, scripting support Colab will now install a computer for you to use with KoboldCpp, once its done you will receive all the relevant links both to the KoboldAI Lite UI you can use directly in your browser for model testing, as well as API links you can use to test your development. TPU edition model description with its style. To ensure you avoid this fate, please login using one of the buttons above Go back to SillyTavern, go to API Connections, select KoboldAI (not KoboldAI Horde) configure the link to your KoboldAI location and click Connect. wlfvgnejnycmquxfdvge