Modules We support integrations with OpenAI, Anthropic, Hugging Face, PaLM, and more. OpenAI OpenAI Azure OpenAI Anthropic Anthropic Hugging Face HuggingFace LLM - Camel-5b HuggingFace LLM - StableLM Local Llama2 + VectorStoreIndex EverlyAI EverlyAI LiteLLM LiteLLM PaLM PaLM Predibase Predibase Replicate Replicate - Llama 2 13B Replicate - Vicuna 13B Llama2 + VectorStoreIndex LangChain LangChain LLM Llama API Llama API Llama CPP LlamaCPP Xorbits Inference Xorbits Inference MonsterAPI Set Monster API Key env variable Basic Usage Pattern RunGPT RunGPT Setup Portkey Portkey AnyScale Anyscale Ollama Ollama - Llama 2 7B Konko