We finally have a product that helps with frontier AI research.
Frontier LLMs are a) nerfed at AI research b) lack immediate GPU availability and c) lack access to the right skills and research material.
"Teach me how vision models see"
Goodfire Silico takes a vision transformer (ViT), loads ImageNet images, and for each head, visualizes the 196x196 matrix by creating animated arcs across patches.
Haven't found another model or product that can do this level of comprehensive AI research, much less oneshot it.