budget-aware reasoning

Think Again or Think Longer? Selective Verification Boosts LLM Accuracy While Cutting Compute Costs

A new preprint on arXiv proposes SEVRA, a serving-layer controller that selectively verifies LLM reasoning outputs. On MATH-500, it achieves 76.3% accuracy — higher than always verifying — while reducing post-generation tokens by 26.8% and harmful flips from 2.2% to 1.0%. The study provides a deployment rule: first tune the initial reasoning budget, then use selective recovery when explicit checks are needed.