Next 100x in AI: Inference, Networking, & Self-Optimizing Models — Philip Kiely & Ali Taha, Baseten

A deep, 100-minute inference-engineering conversation with Baseten's Philip Kiely and Ali Taha on how LLM requests get served and where inference is headed, for engineers building or evaluating servi…