Broken record here, but GDPval-AA is a very bad benchmark. 1) AIs give answers to the public questions of GDPval, which involve subjective judgement 2) Other AIs judge the answer (in the real GDPval, it was human experts) It has no validity & yet even the AI labs keep citing it.
So, one thing that still puzzles me is that Artificial Intelligence Analysis has confidently stood by their score that GPT-6 scores worse on real world tasks th...