How Cerebras Deploys Trillion-Parameter AI Models
One of the most frequently asked questions we get is how we deploy large models on Cerebras wafer-scale chips. A single Cerebras WSE-3T wafer has 44 GB of on-chip memory, and trillion-parameter frontier models need terabytes for their weights alone.In this post, we’ll explain how we split a large frontier model across multiple WSE-3T wafers, to run multi-trillion parameter models at 1000-2000+ tokens per second.We’ll use the open source model Kimi K3, with ~3 trillion parameters, as an illustrat...
Read more at cerebras.ai