Parallel reasoning improves the accuracy and robustness of large reasoning models by exploring multiple solution paths, but its computational cost grows with reasoning depth and branch count. Existing methods for managing these parallel paths typically rely on final-answer consensus, local token confidence, or isolated intermediate probes. However, these signals are often delayed, weakly tied to actual reasoning progress, or too noisy for dynamic, branch-level control. To address these limitations, we introduce ParaTempo, a training-free asynchronous parallel reasoning framework. ParaTempo is driven by temporal confidence, a branch-local measure of answer-space convergence. Each branch is periodically probed for a tentative answer probability distribution, and temporal confidence quantifies how sharply the recent intermediate probes concentrate on a dominant answer. Once sufficient evidence has accumulated, ParaTempo drives its entire control process from this single signal: low-confidence branches are pruned, branches that persistently commit to their dominant answer are retired early, freed computation is reallocated by forking new branches, and generation stops globally once the confidence-weighted vote concentrates. Without requiring synchronization among reasoning trajectories, ParaTempo adaptively allocates computation based on branch-level convergence. Experiments on challenging mathematical and scientific reasoning benchmarks show that ParaTempo reduces average latency by 21.8-32.2% and total token usage by 18.1-30.3% while maintaining competitive accuracy. Moreover, temporal confidence exhibits stronger temporal stability and predictive power for future branch convergence than token-level and instantaneous signals.
ParaTempo:基于时间置信度的并行推理加速框架
AI 导读
ParaTempo 提出一种免训练的非同步并行推理框架,通过分支级时间置信度动态剪枝、提前退出和计算重分配,在数学与科学推理基准上将平均延迟降低 21.8-32.2%,总 token 用量减少 18.1-30.3%,同时保持有竞争力的准确率。相比 token 级和瞬时信号,时间置信度对未来分支收敛具有更强的时序稳定性和预测能力。
HuggingFace Daily Papers(社区热门论文)
52
AI 编辑部评分,满分 100ParaTempo:基于时间置信度的并行推理加速框架
ParaTempo 提出一种免训练的非同步并行推理框架,通过分支级时间置信度动态剪枝、提前退出和计算重分配,在数学与科学推理基准上将平均延迟降低 21.8-32.2%,总 token 用量减少 18.1-30.3%,同时保持有竞争力的准确率。相比 token 级和瞬时信号,时间置信度对未来分支收敛具有更强的时序稳定性和预测能力。
原文 · 保持原样,未翻译原文 · 未翻译
来源:HuggingFace Daily Papers(社区热门论文)· arxiv.org