Spurious Rewards (June, 2025)
Random rewards can raise scores by amplifying existing priors, without creating genuine capability gains.
Noisy Data Is Destructive (Aug, 2026)
Verified wrong labels reinforce errors, reduce exploration, and underperform clean supervision.
Papers:
Spurious Rewards: Rethinking Training Signals in RLVR Noisy Data is Destructive to Reinforcement Learning with Verifiable Rewards