Tag
Vision-Language Models
Posts and notes tagged with Vision-Language Models.
- October 22, 202612 min read
Contrastive Perception Policy Optimization (CPPO)
How CPPO improves perception in vision-language models during reinforcement learning: it finds the tokens whose entropy rises most when the image is hidden, and trains them with a contrastive loss to stay stable under harmless image changes and to shift when the image's content is removed.
- October 14, 202611 min read
Perception-Aware Policy Optimization (PAPO)
How PAPO teaches multimodal models to look at the image while they learn to reason: it adds a loss that rewards responses whose probability drops when the image is masked, and keeps that loss from being gamed with two entropy terms.
- October 6, 202613 min read
Visually-Perceptive Policy Optimization (VPPO)
How VPPO makes reinforcement learning for vision-language models pay attention to the image: it measures how much each token depends on the picture, scales each response's advantage by that dependency, and updates only the most image-dependent tokens.
- September 28, 202612 min read
Adversarial Defense with Preference Optimization (AdPO)
How AdPO turns adversarial training into a preference optimization problem: a vision-language model learns, with DPO, to prefer its own description of a clean image over its description of an attacked one, and to describe the attacked image as if it were clean.