Something Old, Something New: Grammar-based CCG Parsing with Transformer Models

Understand

This report describes the parsing problem for Combinatory Categorial Grammar (CCG), showing how a combination of Transformer-based neural models and a symbolic CCG grammar can lead to substantial gains over existing approaches.

• The report also documents a 20-year research program, showing how NLP methods have evolved over this time.
• The staggering accuracy improvements provided by neural models for CCG parsing can be seen as a reflection of the improvements seen in NLP more generally.
• The report provides a minimal introduction to CCG and CCG parsing, with many pointers to the relevant literature.