SemiAnalysis@SemiAnalysis_ · XAI 摘要
过去12年间，cuDNN一直完全闭源（除.h文件外），直到本周！超过20个MoE内核及NSA稀疏注意力内核已从cuDNN开源！感谢@manicely6005及团队其他成员的卓越工作，让我们看到英伟达的部分技术正朝着开放内核的方向迈进！开源内核驱动创新！(1/3) 🧵
For the past 12 years， cuDNN has been completely closed sourced （besides the .h files）， until this week！ OVER 20 MoE kernels & NSA sparse attention kernels from cuDNN has been open sourced！ Great work to @manicely6005 & the rest of the team on seeing that parts of NVIDIA are moving towards open kernels！ open source kernels drive innovation！ （1/3） 🧵