Together AI's ThunderAgent Doubles GPU Throughput for Multi-Agent Inference

Together AI's new ThunderAgent system fixes KV-cache bottlenecks to run 192 AI agents at once with 2.5x higher GPU throughput.