Chat models
info
If you'd like to write your own chat model, see this how-to. If you'd like to contribute an integration, see Contributing integrations.
Featured Providersโ
info
While all these LangChain classes support the indicated advanced feature, you may have to open the provider-specific documentation to learn which hosted models or backends support the feature.
| Provider | Tool calling | Structured output | JSON mode | Local | Multimodal | Package |
|---|---|---|---|---|---|---|
| ChatAnthropic | โ | โ | โ | โ | โ | langchain-anthropic |
| ChatMistralAI | โ | โ | โ | โ | โ | langchain-mistralai |
| ChatFireworks | โ | โ | โ | โ | โ | langchain-fireworks |
| AzureChatOpenAI | โ | โ | โ | โ | โ | langchain-openai |
| ChatOpenAI | โ | โ | โ | โ | โ | langchain-openai |
| ChatTogether | โ | โ | โ | โ | โ | langchain-together |
| ChatVertexAI | โ | โ | โ | โ | โ | langchain-google-vertexai |
| ChatGoogleGenerativeAI | โ | โ | โ | โ | โ | langchain-google-genai |
| ChatGroq | โ | โ | โ | โ | โ | langchain-groq |
| ChatCohere | โ | โ | โ | โ | โ | langchain-cohere |
| ChatBedrock | โ | โ | โ | โ | โ | langchain-aws |
| ChatHuggingFace | โ | โ | โ | โ | โ | langchain-huggingface |
| ChatNVIDIA | โ | โ | โ | โ | โ | langchain-nvidia-ai-endpoints |
| ChatOllama | โ | โ | โ | โ | โ | langchain-ollama |
| ChatLlamaCpp | โ | โ | โ | โ | โ | langchain-community |
| ChatAI21 | โ | โ | โ | โ | โ | langchain-ai21 |
| ChatUpstage | โ | โ | โ | โ | โ | langchain-upstage |
All chat modelsโ
| Label | Description |
|---|---|
| AI21 Labs | Overview |
| Alibaba Cloud PAI EAS | Alibaba Cloud PAI (Platform for AI) is a lightweight and cost-efficie... |
| Anthropic | This notebook provides a quick overview for getting started with Anth... |
| [Deprecated] Experimental Anthropic Tools Wrapper | The Anthropic API officially supports tool-calling so this workaround... |
| Anyscale | This notebook demonstrates the use of langchain.chat_models.ChatAnysc... |
| Azure OpenAI | This guide will help you get started with AzureOpenAI chat models. Fo... |
| Azure ML Endpoint | Azure Machine Learning is a platform used to build, train, and deploy... |
| Baichuan Chat | Baichuan chat models API by Baichuan Intelligent Technology. For more... |
| Baidu Qianfan | Baidu AI Cloud Qianfan Platform is a one-stop large model development... |
| AWS Bedrock | This doc will help you get started with AWS Bedrock chat models. Amaz... |
| Cohere | This notebook covers how to get started with Cohere chat models. |
| Coze Chat | ChatCoze chat models API by coze.com. For more information, see https... |
| Dappier AI | Dappier: Powering AI with Dynamic, Real-Time Data Models |
| Databricks | Databricks Lakehouse Platform unifies data, analytics, and AI on one ... |
| DeepInfra | DeepInfra is a serverless inference as a service that provides access... |
| Eden AI | Eden AI is revolutionizing the AI landscape by uniting the best AI pr... |
| Ernie Bot Chat | ERNIE-Bot is a large language model developed by Baidu, covering a hu... |
| EverlyAI | EverlyAI allows you to run your ML models at scale in the cloud. It a... |
| Fireworks | This doc help you get started with Fireworks AI chat models. For deta... |
| Friendli | Friendli enhances AI application performance and optimizes cost savin... |
| GigaChat | This notebook shows how to use LangChain with GigaChat. |
| Google AI | This docs will help you get started with Google AI chat models. For d... |
| Google Cloud Vertex AI | This page provides a quick overview for getting started with VertexAI... |
| GPTRouter | GPTRouter is an open source LLM API Gateway that offers a universal A... |
| Groq | This will help you getting started with Groq chat models. For detaile... |
| ChatHuggingFace | This will help you getting started with langchainhuggingface chat mod... |
| IBM watsonx.ai | ChatWatsonx is a wrapper for IBM watsonx.ai foundation models. |
| JinaChat | This notebook covers how to get started with JinaChat chat models. |
| Kinetica | This notebook demonstrates how to use Kinetica to transform natural l... |
| Konko | Konko API is a fully managed Web API designed to help application dev... |
| LiteLLM | LiteLLM is a library that simplifies calling Anthropic, Azure, Huggin... |
| LiteLLM Router | LiteLLM is a library that simplifies calling Anthropic, Azure, Huggin... |
| Llama 2 Chat | This notebook shows how to augment Llama-2 LLMs with the Llama2Chat w... |
| Llama API | This notebook shows how to use LangChain with LlamaAPI - a hosted ver... |
| LlamaEdge | LlamaEdge allows you to chat with LLMs of GGUF format both locally an... |
| ChatLlamaCpp | This notebook provides a quick overview for getting started with chat... |
| maritalk | Introduction |
| MiniMax | Minimax is a Chinese startup that provides LLM service for companies ... |
| MistralAI | This will help you getting started with Mistral chat models. For deta... |
| MLX | This notebook shows how to get started using MLX LLM's as chat models. |
| Moonshot | Moonshot is a Chinese startup that provides LLM service for companies... |
| NVIDIA AI Endpoints | This will help you getting started with NVIDIA chat models. For detai... |
| OCIGenAI | This notebook provides a quick overview for getting started with OCIG... |
| ChatOctoAI | OctoAI offers easy access to efficient compute and enables users to i... |
| Ollama | Ollama allows you to run open-source large language models, such as L... |
| Ollama Functions | This was an experimental wrapper that attempts to bolt-on tool callin... |
| OpenAI | This notebook provides a quick overview for getting started with Open... |
| Perplexity | This notebook covers how to get started with Perplexity chat models. |
| PremAI | PremAI is an all-in-one platform that simplifies the creation of robu... |
| PromptLayer ChatOpenAI | This example showcases how to connect to PromptLayer to start recordi... |
| Snowflake Cortex | Snowflake Cortex gives you instant access to industry-leading large l... |
| solar | Related |
| SparkLLM Chat | SparkLLM chat models API by iFlyTek. For more information, see iFlyTe... |
| Tencent Hunyuan | Tencent's hybrid model API (Hunyuan API) |
| Together | This page will help you get started with Together AI chat models. For... |
| Tongyi Qwen | Tongyi Qwen is a large language model developed by Alibaba's Damo Aca... |
| Upstage | This notebook covers how to get started with Upstage chat models. |
| vLLM Chat | vLLM can be deployed as a server that mimics the OpenAI API protocol.... |
| Volc Enging Maas | This notebook provides you with a guide on how to get started with vo... |
| YandexGPT | This notebook goes over how to use Langchain with YandexGPT chat mode... |
| ChatYI | This will help you getting started with Yi chat models. For detailed ... |
| Yuan2.0 | This notebook shows how to use YUAN2 API in LangChain with the langch... |
| ZHIPU AI | This notebook shows how to use ZHIPU AI API in LangChain with the lan... |