Tag
VPPO
Posts and notes tagged with VPPO.
- October 6, 202613 min read
Visually-Perceptive Policy Optimization (VPPO)
How VPPO makes reinforcement learning for vision-language models pay attention to the image: it measures how much each token depends on the picture, scales each response's advantage by that dependency, and updates only the most image-dependent tokens.