BerriAI/litellm

library

NOASSERTION

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

Python

49k

8.7k

Updated 6 Jun 2026

ai-gateway

anthropic

azure-openai

bedrock

gateway

langchain

litellm

llm

llm-gateway

llmops

mcp-gateway

openai

openai-proxy

vertex-ai

View on GitHub Homepage

Appears in lists

d5-llm

BerriAI/litellm

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]