Mechanism
Augments GRPO's outcome reward with dense step-wise reasoning accuracy and formatting rewards (or serial early-exit rollouts truncated at intermediate reasoning checkpoints), rewarding the model for reaching correct conclusions earlier in the reasoning trace.