SGLang's New Unified Radix Cache Adds Proper Prefix Caching for Hybrid Models Like DeepSeek-V4

LMSYS rebuilt SGLang's caching system into one composable 'Unified Radix Cache,' finally enabling proper prefix caching for hybrid architectures like DeepSeek-V4.