Today, researchers made an important breakthrough in interpretability.

They found "manifolds" in the neural net weights for any concepts in image gen models (SDXL), like the pretzel manifold, and could steer them to generate various kinds of pretzels from the weights directly.

This is well beyond a neat theoretical understanding on how AI models see but gives us a low-compute volume dial to edit the results of a generation.