Write agentic apps once, run with any LLM provider

Supported Providers

Connect to any LLM provider with a unified interface. All providers use the same API structure.

🤖

OpenAI

Industry-leading GPT models including GPT-4 and GPT-3.5

Models:

GPT-4GPT-4 TurboGPT-3.5 Turbo

Features:

ChatCompletionsFunctionsStreaming
Setup Guide
🧠

Anthropic

Claude family of models with strong reasoning capabilities

Models:

Claude 3 OpusClaude 3 SonnetClaude 3 Haiku

Features:

ChatCompletionsFunctionsStreaming
Setup Guide
🔍

Google

Gemini and PaLM models with multimodal capabilities

Models:

Gemini ProGemini Pro VisionPaLM 2

Features:

ChatCompletionsVisionStreaming
Setup Guide
☁️

AWS Bedrock

Access to multiple foundation models through AWS

Models:

ClaudeLlama 2Titan+1 more

Features:

ChatCompletionsEmbeddings
Setup Guide
☁️

Azure

OpenAI models hosted on Microsoft Azure

Models:

GPT-4GPT-3.5DALL-E

Features:

ChatCompletionsFunctionsStreaming
Setup Guide
🌊

Mistral

Open-weight models with strong performance

Models:

Mistral LargeMistral MediumMistral Small

Features:

ChatCompletionsFunctions
Setup Guide

Groq

Ultra-fast inference with LPU technology

Models:

LLaMA 2MixtralGemma

Features:

ChatCompletionsStreaming
Setup Guide
🤗

HuggingFace

Wide variety of open-source models

Models:

Various open-source models

Features:

ChatCompletionsCustom Models
Setup Guide
🦙

Ollama

Run large language models locally

Models:

LLaMAMistralCodeLlama+1 more

Features:

Local InferenceCustom Models
Setup Guide
🎯

Cohere

Enterprise-focused language models

Models:

CommandCommand LightEmbed

Features:

ChatCompletionsEmbeddingsRerank
Setup Guide
🧮

Cerebras

BETA

High-performance AI compute platform

Models:

Cerebras-GPTCustom Models

Features:

ChatCompletions
Setup Guide
🔬

DeepSeek

Advanced reasoning and coding models

Models:

DeepSeek-CoderDeepSeek-Math

Features:

ChatCode GenerationMath
Setup Guide
✖️

xAI

BETA

Grok models with real-time information

Models:

Grok-1Grok-2

Features:

ChatReal-time Data
Setup Guide
🤝

Together

Platform for running open-source models

Models:

Multiple open-source models

Features:

ChatCompletionsCustom Models
Setup Guide
🎆

Fireworks

Fast inference for open-source models

Models:

Various open models

Features:

ChatCompletionsFine-tuning
Setup Guide
🎵

SambaNova

BETA

Enterprise AI platform

Models:

Samba-1Custom Models

Features:

ChatCompletions
Setup Guide
🏢

Watsonx

IBM enterprise AI platform

Models:

IBM GraniteLLaMAFlan

Features:

ChatCompletionsEnterprise
Setup Guide
☁️

Nebius

BETA

Cloud AI infrastructure provider

Models:

Various models

Features:

ChatCompletions
Setup Guide
💻

LMStudio

Desktop app for local LLM inference

Models:

Any GGUF model

Features:

Local InferenceModel Management
Setup Guide
🌀

Inception

BETA

Custom model deployment platform

Models:

Custom deployed models

Features:

Custom Deployment
Setup Guide

Don't See Your Provider?

We're always adding new providers. Request one or contribute your own!