.@emollick has used data from Artificial Analysis to show how the development of intelligence compares with open source.
Two interesting points:
-The development is still unquestionably exponential. There is no doubt about that. AI is not just getting better, it is getting better faster and faster. This is a truth that all of us probably already notice when using AI.
-The gap to open source remains fairly constant. Chinese models in particular are still about half a year behind closed source. But that also means that Mythos-class models as open-source variants are genuinely realistic toward the end of the year.
A very interesting graph.
I took the new AA-Briefcase scores from @ArtificialAnlys (basically having the AI do multi-week consulting gigs with a lot of complexity) and graphed the fronti...