Banger paper from Google DeepMind.

It's on the very hot topic of model routing.

Routers assume the value estimate is free. Working out which specialist handles a query best costs money too, and it is often the larger cost in the pipeline.

This new work formalizes model routing as Pandora's Box, the classic problem of optimal search when inspection is expensive. Under a Gaussian signal model the policies come out in closed form, telling you per specialist and per input whether refining the estimate is worth the price.

Across a multi-LLM benchmark, retrieval-augmented specialists, and LLMs with variable inference-time reasoning, Pandora's Router matches exhaustive estimation quality while calling the expensive estimator far less often.

When competing estimates are noisy, value-of-information reasoning raises the strategic specialist's utility at everyone else's expense.

Paper: https://arxiv.org/abs/2608.20316

Track more trending AI papers in our academy: https://academy.dair.ai/