Qwen 27B is really good local model but, when you use it, it is immediately absolutely and obviously nowhere near as good as the other models listed here for agentic tasks, and especially for the kinds of complex tasks that GDPval-AA proports to measure
Do your own benchmarking!
Qwen 27B is the "DeepSeek moment" for open source. It matches the closed-source state-of-the-art from just a few months ago and runs on an RTX 5090. Without exa...