Tag
Decoupled Clip and Dynamic Sampling Policy Optimization
Posts and notes tagged with Decoupled Clip and Dynamic Sampling Policy Optimization.
- July 29, 202616 min read
Decoupled Clip and Dynamic Sampling Policy Optimization (DAPO)
How DAPO fixes the failures of GRPO in long chain-of-thought reasoning: Clip-Higher against entropy collapse, dynamic sampling against zero-gradient prompts, a token-level loss for long responses, and overlong reward shaping for truncated answers.