LiteLLM v1.111.0-rc.1: Expanded Model Support, Cost Controls, and Security Improvements
LiteLLM's latest release introduces broader model support, improved cost tracking, stricter API input validation, and new capabilities for secure content handling. This update enhances flexibility, security, and transparency for AI service deployments and customers.
What changed?
LiteLLM v1.111.0-rc.1 introduces several enhancements and fixes to its infrastructure. Notable updates include OpenSearch index pass-through with per-key read and write grants, expanded model support such as Claude Fable 5.2 on various cloud platforms, and the addition of meta/muse-ember-1.0 and gemini/gemini-4-carbon models. The release enforces per-customer and per-model token per minute (tpm) and request per minute (rpm) limits, as well as refined cost controls that now bill audio transcriptions by the actual seconds reported by providers. Security is improved with the rejection of unknown fields in customer creation and update APIs, and deployments can now declare shared encrypted content boundaries.
Why does it matter to an everyday developer?
These changes affect developers integrating LiteLLM as an abstraction layer over multiple AI model providers. The ability to pass through OpenSearch requests with per-key access control increases flexibility for search and indexing workloads. Strict enforcement of input validation for customer APIs helps prevent accidental configuration errors and potential security issues. The expanded model registry allows developers to use the latest models and cloud endpoints with a unified API. Improved cost and rate controls provide clarity and guardrails for managing API usage and spend, which is essential in production environments.
What can the developer do now?
- Integrate and test new supported models and endpoints, like Claude Fable 5.2 and Gemini 4 Carbon, for use in production or evaluation workflows.
- Use the improved OpenSearch pass-through with fine-grained API key permissions for secure and practical search operations.
