OpenAI and Broadcom Introduce AI Inference Chip

OpenAI and Broadcom unveiled a custom AI inference chip aimed at cutting token costs for businesses running models at scale.