We've open-sourced MoonEP, our high-performance communication library for distributed MoE workloads.
Built to make expert-parallel communication more efficient at scale, MoonEP helps reduce communication overhead in large MoE training and inference systems.
Explore on GitHub: http://github.com/MoonshotAI/MoonEP