Chat models
info
If you'd like to write your own chat model, see this how-to. If you'd like to contribute an integration, see Contributing integrations.
Featured Providersโ
info
While all these LangChain classes support the indicated advanced feature, you may have to open the provider-specific documentation to learn which hosted models or backends support the feature.
Provider | Tool calling | Structured output | JSON mode | Local | Multimodal | Package |
---|---|---|---|---|---|---|
ChatAnthropic | โ | โ | โ | โ | โ | langchain-anthropic |
ChatMistralAI | โ | โ | โ | โ | โ | langchain-mistralai |
ChatFireworks | โ | โ | โ | โ | โ | langchain-fireworks |
AzureChatOpenAI | โ | โ | โ | โ | โ | langchain-openai |
ChatOpenAI | โ | โ | โ | โ | โ | langchain-openai |
ChatTogether | โ | โ | โ | โ | โ | langchain-together |
ChatVertexAI | โ | โ | โ | โ | โ | langchain-google-vertexai |
ChatGoogleGenerativeAI | โ | โ | โ | โ | โ | langchain-google-genai |
ChatGroq | โ | โ | โ | โ | โ | langchain-groq |
ChatCohere | โ | โ | โ | โ | โ | langchain-cohere |
ChatBedrock | โ | โ | โ | โ | โ | langchain-aws |
ChatHuggingFace | โ | โ | โ | โ | โ | langchain-huggingface |
ChatNVIDIA | โ | โ | โ | โ | โ | langchain-nvidia-ai-endpoints |
ChatOllama | โ | โ | โ | โ | โ | langchain-ollama |
ChatLlamaCpp | โ | โ | โ | โ | โ | langchain-community |
ChatAI21 | โ | โ | โ | โ | โ | langchain-ai21 |
ChatUpstage | โ | โ | โ | โ | โ | langchain-upstage |
All chat modelsโ
Label | Description |
---|---|
AI21 Labs | Overview |
Alibaba Cloud PAI EAS | Alibaba Cloud PAI (Platform for AI) is a lightweight and cost-efficie... |
Anthropic | This notebook provides a quick overview for getting started with Anth... |
[Deprecated] Experimental Anthropic Tools Wrapper | The Anthropic API officially supports tool-calling so this workaround... |
Anyscale | This notebook demonstrates the use of langchain.chat_models.ChatAnysc... |
Azure OpenAI | This guide will help you get started with AzureOpenAI chat models. Fo... |
Azure ML Endpoint | Azure Machine Learning is a platform used to build, train, and deploy... |
Baichuan Chat | Baichuan chat models API by Baichuan Intelligent Technology. For more... |
Baidu Qianfan | Baidu AI Cloud Qianfan Platform is a one-stop large model development... |
AWS Bedrock | This doc will help you get started with AWS Bedrock chat models. Amaz... |
Cohere | This notebook covers how to get started with Cohere chat models. |
Coze Chat | ChatCoze chat models API by coze.com. For more information, see https... |
Dappier AI | Dappier: Powering AI with Dynamic, Real-Time Data Models |
Databricks | Databricks Lakehouse Platform unifies data, analytics, and AI on one ... |
DeepInfra | DeepInfra is a serverless inference as a service that provides access... |
Eden AI | Eden AI is revolutionizing the AI landscape by uniting the best AI pr... |
Ernie Bot Chat | ERNIE-Bot is a large language model developed by Baidu, covering a hu... |
EverlyAI | EverlyAI allows you to run your ML models at scale in the cloud. It a... |
Fireworks | This doc help you get started with Fireworks AI chat models. For deta... |
Friendli | Friendli enhances AI application performance and optimizes cost savin... |
GigaChat | This notebook shows how to use LangChain with GigaChat. |
Google AI | This docs will help you get started with Google AI chat models. For d... |
Google Cloud Vertex AI | This page provides a quick overview for getting started with VertexAI... |
GPTRouter | GPTRouter is an open source LLM API Gateway that offers a universal A... |
Groq | This will help you getting started with Groq chat models. For detaile... |
ChatHuggingFace | This will help you getting started with langchainhuggingface chat mod... |
IBM watsonx.ai | ChatWatsonx is a wrapper for IBM watsonx.ai foundation models. |
JinaChat | This notebook covers how to get started with JinaChat chat models. |
Kinetica | This notebook demonstrates how to use Kinetica to transform natural l... |
Konko | Konko API is a fully managed Web API designed to help application dev... |
LiteLLM | LiteLLM is a library that simplifies calling Anthropic, Azure, Huggin... |
LiteLLM Router | LiteLLM is a library that simplifies calling Anthropic, Azure, Huggin... |
Llama 2 Chat | This notebook shows how to augment Llama-2 LLMs with the Llama2Chat w... |
Llama API | This notebook shows how to use LangChain with LlamaAPI - a hosted ver... |
LlamaEdge | LlamaEdge allows you to chat with LLMs of GGUF format both locally an... |
ChatLlamaCpp | This notebook provides a quick overview for getting started with chat... |
maritalk | Introduction |
MiniMax | Minimax is a Chinese startup that provides LLM service for companies ... |
MistralAI | This will help you getting started with Mistral chat models. For deta... |
MLX | This notebook shows how to get started using MLX LLM's as chat models. |
Moonshot | Moonshot is a Chinese startup that provides LLM service for companies... |
NVIDIA AI Endpoints | This will help you getting started with NVIDIA chat models. For detai... |
OCIGenAI | This notebook provides a quick overview for getting started with OCIG... |
ChatOctoAI | OctoAI offers easy access to efficient compute and enables users to i... |
Ollama | Ollama allows you to run open-source large language models, such as L... |
Ollama Functions | This was an experimental wrapper that attempts to bolt-on tool callin... |
OpenAI | This notebook provides a quick overview for getting started with Open... |
Perplexity | This notebook covers how to get started with Perplexity chat models. |
PremAI | PremAI is an all-in-one platform that simplifies the creation of robu... |
PromptLayer ChatOpenAI | This example showcases how to connect to PromptLayer to start recordi... |
Snowflake Cortex | Snowflake Cortex gives you instant access to industry-leading large l... |
solar | Related |
SparkLLM Chat | SparkLLM chat models API by iFlyTek. For more information, see iFlyTe... |
Tencent Hunyuan | Tencent's hybrid model API (Hunyuan API) |
Together | This page will help you get started with Together AI chat models. For... |
Tongyi Qwen | Tongyi Qwen is a large language model developed by Alibaba's Damo Aca... |
Upstage | This notebook covers how to get started with Upstage chat models. |
vLLM Chat | vLLM can be deployed as a server that mimics the OpenAI API protocol.... |
Volc Enging Maas | This notebook provides you with a guide on how to get started with vo... |
YandexGPT | This notebook goes over how to use Langchain with YandexGPT chat mode... |
ChatYI | This will help you getting started with Yi chat models. For detailed ... |
Yuan2.0 | This notebook shows how to use YUAN2 API in LangChain with the langch... |
ZHIPU AI | This notebook shows how to use ZHIPU AI API in LangChain with the lan... |