Group Relative Policy Optimization for Image Captioning

Understand

Image captioning tasks usually use two-stage training to complete model optimization.

• The first stage uses cross-entropy as the loss function for optimization, and the second stage uses self-critical sequence training (SCST) for reinforcement learning optimization.
• However, the SCST algorithm has certain defects.
• SCST relies only on a single greedy decoding result as a baseline.