Measuring Social Biases in Grounded Vision and Language Embeddings

Understand

We generalize the notion of social biases from language embeddings to grounded vision and language embeddings.

• Biases are present in grounded embeddings, and indeed seem to be equally or more significant than for ungrounded embeddings.
• This is despite the fact that vision and language can suffer from different biases, which one might hope could attenuate the biases in both.
• Multiple ways exist to generalize metrics measuring bias in word embeddings to this new setting.