A Discerning Several Thousand Judgments: GPT-3 Rates the Article + Adjective + Numeral + Noun Construction

Understand

Knowledge of syntax includes knowledge of rare, idiosyncratic constructions.

• LLMs must overcome frequency biases in order to master such constructions.
• In this study, I prompt GPT-3 to give acceptability judgments on the English-language Article + Adjective + Numeral + Noun construction (e.g., "a lovely five days").
• I validate the prompt using the CoLA corpus of acceptability judgments and then zero in on the AANN construction.