Nemotron 3 Ultra was launched today， including a focus on low latency agentic performance. We tested it against peers under restricted turn-usage limits on Terminal-Bench v2.1 - @NVIDIA Nemotron 3 Ultra completes tasks at a much faster pace than peers due to its high inference speed while scoring competitively on the benchmark.

In this analysis each model is given a 'turn limit' within which it can complete tasks， inside a customized version of the Terminus 2 harness which advises it of this limit. We apply 4 increasing turn limits and trace each result's tradeoff of task latency and performance. Time per task， on the X axis， is calculated as decode time based on token usage and measured endpoint output speeds （for Nemotron 3 Ultra， speeds were measured on a pre-release deployment on @blackboxai）， plus the actual time spent executing tools to complete the benchmark.