sglang v0.5.21 Brings New Models, Performance Gains, and Low-Latency APIs
sglang v0.5.21 introduces support for top open LLMs and diffusion models, major API updates for low-latency scoring/classification, performance boosts for popular models, and a new Rust prefix cache.
