Probing for the Usage of Grammatical Number

Understand

A central quest of probing is to uncover how pre-trained models encode a linguistic property within their representations.

• An encoding, however, might be spurious-i.e., the model might not rely on it when making predictions.
• In this paper, we try to find encodings that the model actually uses, introducing a usage-based probing setup.
• We first choose a behavioral task which cannot be solved without using the linguistic property.