There's a lot of awesome open-source LLM projects with OpenAI-compatible API's over non-openai models (vllm, @LocalAI_API , @any
24 Oct 2023,   22:49
There’s a lot of awesome open-source LLM projects with OpenAI-compatible API’s over non-openai models (vllm, @LocalAI_API , @anyscalecompute LLM endpoints, etc). 
 
Thanks to @the_benbot , you can now use *any* of them with our `OpenAILike` class 👇 
 
(Example for vllm + mistral 🖼️)