Back to Dashboard
AI Hourly Dashboard
litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native)
Developer ToolsLibrariesOpen Source
0
55,976stars
55,976points
About
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Technical Details
- Task Type
- general
- Technical Level
- advanced
- Deployment Options
- librarycli
Information
- Launched
- July 27, 2023
- Popularity Score
- 100.0
Tags
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsPython