Fetching the paper…

Reading the bibliography…

2020

GePpeTto Carves Italian into a Language Model

De Mattei, Lorenzo, Cafagna, Michele, Dell'Orletta, Felice et al.

Original
PDF
Post on X

Understand

In the last few years, pre-trained neural architectures have provided impressive improvements across several NLP tasks.

Still, generative language models are available mainly for English.
We develop GePpeTto, the first generative language model for Italian, built using the GPT-2 architecture.
We provide a thorough analysis of GePpeTto's quality by means of both an automatic and a human-based evaluation.

GePpeTto Carves Italian into a Language Model · Around

Built on

Gltr: Statistical detection and visualization of generated text
Original
Sebastian Gehrmann, Hendrik Strobelt, and Alexander M Rush. 2019 · 1906
Earlier work this paper cites.
The WaCky wide web: a collection of very large linguistically processed web-crawled corpora
Marco Baroni, Silvia Bernardini, Adriano Ferraresi, and Eros Zanchetta. 2009 · 2009
Earlier work this paper cites.
Wikiextractor
Giuseppe Attardi. 2012 · 2012
Earlier work this paper cites.
Survey of the state of the art in natural language generation: Core tasks, applications and evaluation
Albert Gatt and Emiel Krahmer. 2018 · 2018
Earlier work this paper cites.

Similar

BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Quanti anni hai? Age Identification for Italian
Aleksandra Maslennikova, Paolo Labruna, Andrea Cimino, and Felice Dell’Orletta. 2019 · 2019
Cited alongside, same era.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Cited alongside, same era.

Then

Defending against neural fake news
Original
Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019 · 2019
Later among the works it cites.
Profiling-UD: a Tool for Linguistic Profiling of Texts
Dominique Brunato, Andrea Cimino, Felice Dell’Orletta, Simonetta Montemagni, and Giulia Venturi. 2020 · 2020
Closest in time.
Invisible to People but not to Machines: Evaluation of Style-aware Headline Generation in Absence of Reliable Human Judgment
Lorenzo De Mattei, Michele Cafagna, Felice Dell’Orletta, and Malvina Nissim. 2020 · 2020
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…