Really cool. @atomic_chat_hq 's 1-bit Kimi K3 quant shrinks the 2.8T model to 590GB (-62%)
- The 1-bit model keeps 78.7% of the original quality and the full 1M context. model on Huggingface
- Moving to 2.1 bits raises the footprint to 769GB, but agreement jumps to 87.2%. Going all the way to 3.4 bits adds another 428GB for only 0.5 percentage points.
- In their HTML 3D physics test, all 4 models handled the drop physics, while only local K3 built the requested working winch.
- They ran it with on 4x B200 GPUs
1-bit Kimi K3 performs at Opus 5 level on 3D physics! We ran our Atomic Chat quant of Kimi K3 locally on 4x B200 against three cloud models and gave them all th...