There's a lot of awesome open-source LLM projects with OpenAI-compatible API's over non-openai models (vllm, @LocalAI_API , @any

24 Oct 2023, 22:49
There’s a lot of awesome open-source LLM projects with OpenAI-compatible API’s over non-openai models (vllm, @LocalAI_API , @anyscalecompute LLM endpoints, etc). Thanks to @the_benbot , you can now use *any* of them with our `OpenAILike` class 👇 (Example for vllm + mistral 🖼️)