ORBIT: On-policy Exploration-Exploitation for Controllable Multi-Budget Reasoning

arXiv:2601.08310v2 Announce Type: replace-cross Abstract: Recent Large Reasoning Models (LRMs) achieve strong performance by leveraging long-form Chain-of-Thought (CoT) reasoning, but uniformly applying overlong reasoning at inference time incurs substantial and often unnecessary computational cost. To address this, prior work explores various strategies to infer an appropriate reasoning budget from the input. However, such approaches are unreliable in the worst case, as estimating the minimal r