Available LLM integrations#

We support integrations with OpenAI, Anthropic, Hugging Face, PaLM, and more.

AI21#

Anthropic#

AnyScale#

Clarifai#

Cohere#

EverlyAI#

Fireworks#

Friendli#

Groq#

Konko#

LangChain#

LiteLLM#

Llama API#

Llama CPP#

LocalAI#

MariTalk#

MyMagic#

NeutrinoAI#

Nvidia TensorRT-LLM#

Nvidia Triton#

OpenLLM#

OpenRouter#

PaLM#

Perplexity#

Portkey#

Predibase#

RunGPT#

Together.ai#

Xorbits Inference#

ModelScope#