SemiAnalysis@SemiAnalysis_ · XAI 摘要
CUDA生态的护城河并非主要由NVIDIA内部开发者构建，而是源于数百万外部开发者——他们基于CUDA发明了Flash Attention等算法。这些开发者大多从GeForce游戏GPU起步，因为NVIDIA是唯一在消费级GPU上提供完善开发者工具栈的公司。游戏玩家长大后，利用现有的GeForce显卡转向编程，形成了从游戏生态到AI开发的独特人才输送管道。
YOUR PARENTS PAID FOR THE CUDA MOAT！ The #1 contributor to the CUDA MOAT isn't the the developers at NVIDIA， but it is the millions of developers outside of NVIDIA that invent new algorithms for CUDA like Flash Attention. For most of them， it started with an GeForce gaming GPU. NVIDIA is the only companies that has an reasonable good developer stack on consumer grade GPUs. As people grow up beyond playing CSGO & League of Legends & Minecraft， they either become anime weeaboos or they start programming on their existing computer with has an GeForce GPU