BERTweetFR : Domain Adaptation of Pre-Trained Language Models for French Tweets

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Byte pair encoding: A text compression scheme that accelerates pattern matching

Yusuke Shibata, Takuya Kida, Shuichi Fukamachi, Masayuki Takeda, Ayumi Shinohara, Takeshi Shinohara, and Setsuo Arikawa. 1999 · 1999

Earlier work this paper cites.

Barthez: a skilled pretrained french sequence-to-sequence model

Original

Moussa Kamal Eddine, Antoine J-P Tixier, and Michalis Vazirgiannis. 2020 · 2010

Earlier work this paper cites.

Distributed representations of words and phrases and their compositionality

Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013 · 2013

Earlier work this paper cites.

GloVe: Global vectors for word representation

Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014 · 2014

Earlier work this paper cites.

Semi-supervised sequence learning

Andrew M Dai and Quoc V Le. 2015 · 2015

Earlier work this paper cites.

Adam: A method for stochastic optimization

Original

Diederik P. Kingma and Jimmy Ba. 2015 · 2015

Earlier work this paper cites.

Cap 2017 challenge: Twitter named entity recognition

Original

Cédric Lopez, Ioannis Partalas, Georgios Balikas, Nadia Derbas, Amélie Martin, Coralie Reutenauer, Frédérique Segond, and Massih-Reza Amini. 2017 · 2017

Earlier work this paper cites.

Unsupervised pretraining for sequence to sequence learning

Prajit Ramachandran, Peter Liu, and Quoc Le. 2017 · 2017

Cited alongside, same era.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Cited alongside, same era.

Socioeconomic dependencies of linguistic patterns in twitter: A multivariate analysis

Jacob Levy Abitbol, Márton Karsai, Jean-Philippe Magué, Jean-Pierre Chevrot, and Eric Fleury. 2018 · 2018

Cited alongside, same era.

Subword regularization: Improving neural network translation models with multiple subword candidates

Taku Kudo. 2018 · 2018

Cited alongside, same era.

SentencePiece: A simple and language independent subword tokenizer and detokenizer for neural text processing

Taku Kudo and John Richardson. 2018 · 2018

Cited alongside, same era.

Natural language processing for social media

Anna Atefeh Farzindar and Diana Inkpen. 2020 · 2020

Later among the works it cites.

Don’t stop pretraining: Adapt language models to domains and tasks

Suchin Gururangan, Ana Marasović, Swabha Swayamdipta, Kyle Lo, Iz Beltagy, Doug Downey, and Noah A. Smith. 2020 · 2020

Later among the works it cites.

FlauBERT: Unsupervised language model pre-training for French

Hang Le, Loïc Vial, Jibril Frej, Vincent Segonne, Maximin Coavoux, Benjamin Lecouteux, Alexandre Allauzen, Benoit Crabbé, Laurent Besacier, and Didier Schwab. 2020 · 2020

Later among the works it cites.

BART: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension

Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020 · 2020

Later among the works it cites.

CamemBERT: a tasty French language model

Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah, and Benoît Sagot. 2020 · 2020

Later among the works it cites.