The Inference Frontier: from 100 to 10,000 tokens per second
Cerebras CTO Sean Lie discusses pushing inference beyond 4,000 tokens per second, their partnership with OpenAI, and the emerging hardware stack for frontier inference. He covers Cerebras' wafer-scale architecture, OpenAI's Jalapeño chip, and the future of AI-first chip design.
YouTube Latent Space
Video:The Inference Frontier: from 100 to 10,000 tokens per second — Sean Lie, Cerebras CTO ↗