JuriBERT: A Masked-Language Model Adaptation for French Legal Text

Biobert: a pre-trained biomedical language representation model for biomedical text mining

Original

Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang. 2019 · 1901

Earlier work this paper cites.

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Original

Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019 · 1910

Earlier work this paper cites.

BERT goes to law school: Quantifying the competitive advantage of access to large legal corpora in contract understanding

Original

Emad Elwany, Dave Moore, and Gaurav Oberoi. 2019 · 1911

Earlier work this paper cites.

Finbert: A pretrained language model for financial communications

Original

Yi Yang, Mark Christopher Siy Uy, and Allen Huang. 2020 · 2006

Earlier work this paper cites.

BARThez: a skilled pretrained French sequence-to-sequence model

Original

Moussa Kamal Eddine, Antoine J.-P. Tixier, and Michalis Vazirgiannis. 2020 · 2010

Earlier work this paper cites.

Exploring the use of text classification in the legal domain

Original

Octavia-Maria Sulea, Marcos Zampieri, Shervin Malmasi, Mihaela Vela, Liviu P. Dinu, and Josef van Genabith. 2017 · 2017

Cited alongside, same era.

SciBERT: A pretrained language model for scientific text

Iz Beltagy, Kyle Lo, and Arman Cohan. 2019 · 2019

Cited alongside, same era.

BERT: Pre-training of deep bidirectional transformers for language understanding

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019

Cited alongside, same era.

LEGAL-BERT: The muppets straight out of law school

Ilias Chalkidis, Manos Fergadiotis, Prodromos Malakasiotis, Nikolaos Aletras, and Ion Androutsopoulos. 2020 · 2020

Cited alongside, same era.

CamemBERT: a tasty French language model

Louis Martin, Benjamin Muller, Pedro Javier Ortiz Suárez, Yoann Dupont, Laurent Romary, Éric de la Clergerie, Djamé Seddah, and Benoît Sagot. 2020 · 2020

Later among the works it cites.

Evaluation of word embeddings from large-scale french web content

Original

Hadi Abdine, Christos Xypolopoulos, Moussa Kamal Eddine, and Michalis Vazirgiannis. 2021 · 2021

Closest in time.

LegalDB: Long DistilBERT for legal document classification

Purbid Bambroo and Aditi Awasthi. 2021 · 2021

Closest in time.

CriminelBart: A French Canadian legal language model specialized in criminal law

Nicolas Garneau, Eve Gaumond, Luc Lamontagne, and Pierre-Luc Déziel. 2021 · 2021

Closest in time.