Fixes $0 billing bugs when companies stream AI responses through model aliases.
Built by startup BerriAI and 1,700+ contributors, LiteLLM has 63,000+ GitHub stars and 92.2 million monthly downloads. Over 2,500 companies, including Netflix, NVIDIA, and Lemonade, use it to route AI traffic.
Companies using model nicknames won't accidentally record $0 for streamed AI replies anymore. Billing and usage logs now match non-streamed requests, while unpriced custom models still bill $0.
WHERE In the LiteLLM admin dashboard on the request logs and team budget screen after streaming chat responses.
SCENE You manage an engineering team using a custom nickname for a $5-per-request AI model. Your team already ran 2 regular non-streamed chats ($10 total) and now runs extra streamed chats.