Agentic knowledge work can take frontier models over 20 minutes per task， as measured in AA-Briefcase， our new benchmark

Last week we released AA-Briefcase， our proprietary agentic knowledge work benchmark testing models on long horizon tasks built by industry experts. AA-Briefcase requires models to build deliverables such as financial models， board presentations， and design mock-ups in the context of realistic multi week projects.

One of the key metrics we measure in AA-Briefcase is average time per task. This is calculated using evaluation token usage， representative model output speeds， and tool execution time recorded during evaluation.