Evaluating Gender Bias in Speech Translation

Understand

The scientific community is increasingly aware of the necessity to embrace pluralism and consistently represent major and minor social groups.

• Currently, there are no standard evaluation techniques for different types of biases.
• Accordingly, there is an urgent need to provide evaluation sets and protocols to measure existing biases in our automatic systems.
• Evaluating the biases should be an essential step towards mitigating them in the systems.