Homelabber Runs 2.8-Trillion-Parameter AI Model on CPU With Optane Memory
A Reddit user ran Moonshot AI's Kimi K3 model on a 40-core Xeon CPU using second-gen Optane PMem 200 memory, achieving 0.85 tokens per second with 1-bit quantization.
Checked against 2 sourcesTom's Hardwaremezha.net
