Someone Crammed 2.78 Trillion Parameters Into 8 GB of RAM. I Went to See the Catch
A pure-C project on GitHub runs all 2.78 trillion parameters of Kimi K3 in 8 GB of RAM — 5,000+ stars. The project is real and the engineering is solid. But what it proves isn't 'you don't need a GPU.' It's exactly the opposite.
Kimi K3GPUCPUMoEInferenceBandwidthC99Offloading