Work led by @jacobcares showed that little compute for building an LLM is actually in the final runs. The vast majority of compute goes to developing a recipe.

Creating the recipe openly is a huge lever in making sure the research community's compute pushes to new knowledge.