The open ecosystem benefits when we all share research and code together. Proud to see this. Long live open source!
We're open-sourcing Mixture-of-Kittens (MoK), our MoE training megakernel for NVL72s. It fuses all Mixture-of-Experts communication and computation into a singl...