Fetching the paper…
Reading the bibliography…
In this work, we take the first steps towards building a universal rewriter: a model capable of rewriting text in any language to exhibit a wide variety of attributes, including styles and languages, while preserving as much of the original semantics as possible.
Language models are few-shot learners
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, Sandhini Agarwal, Ariel Herbert-Voss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, Scott Gray, Benjamin Chess, Jack Clark, Christopher Berner, Sam McCandlish, Alec Radford, Ilya Sutskever, and Dario Amodei. 2020 · 1901
Earlier work this paper cites.
Ctrl: A conditional transformer language model for controllable generation
Nitish Shirish Keskar, Bryan McCann, Lav R Varshney, Caiming Xiong, and Richard Socher. 2019 · 1909
Earlier work this paper cites.
Bleu: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
Cross-language text classification using structural correspondence learning
Peter Prettenhofer and Benno Stein. 2010 · 2010
Earlier work this paper cites.
TextSETTR: Label-free text style extraction and tunable targeted restyling
Parker Riley, Noah Constant, Mandy Guo, Girish Kumar, David Uthus, and Zarana Parekh. 2020 · 2010
Earlier work this paper cites.
A study of style in machine translation: Controlling the formality of machine translation output
Xing Niu, Marianna Martindale, and Marine Carpuat. 2017 · 2017
Earlier work this paper cites.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Earlier work this paper cites.
Unsupervised learning of style-sensitive word vectors
Reina Akama, Kento Watanabe, Sho Yokoi, Sosuke Kobayashi, and Kentaro Inui. 2018 · 2018
Earlier work this paper cites.
JAX: composable transformations of Python+NumPy programs
James Bradbury, Roy Frostig, Peter Hawkins, Matthew James Johnson, Chris Leary, Dougal Maclaurin, George Necula, Adam Paszke, Jake VanderPlas, Skye Wanderman-Milne, and Qiao Zhang. 2018 · 2018
Earlier work this paper cites.
Neural machine translation into language varieties
Surafel Melaku Lakew, Aliia Erofeeva, and Marcello Federico. 2018 · 2018
Earlier work this paper cites.
Extreme adaptation for personalized neural machine translation
Paul Michel and Graham Neubig. 2018 · 2018
Earlier work this paper cites.
Multi-task neural models for translating between styles within and across languages
Xing Niu, Sudha Rao, and Marine Carpuat. 2018 · 2018
Earlier work this paper cites.
A call for clarity in reporting BLEU scores
Matt Post. 2018 · 2018
Cited alongside, same era.
Adafactor: Adaptive learning rates with sublinear memory cost
Noam Shazeer and Mitchell Stern. 2018 · 2018
Cited alongside, same era.
Cross-lingual language model pretraining
Alexis Conneau and Guillaume Lample. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Cited alongside, same era.
Multiple-attribute text rewriting
Guillaume Lample, Sandeep Subramanian, Eric Michael Smith, Ludovic Denoyer, Marc’Aurelio Ranzato, and Y-Lan Boureau. 2019 · 2019
Cited alongside, same era.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019
Cited alongside, same era.
Multilingual denoising pre-training for neural machine translation
Yinhan Liu, Jiatao Gu, Naman Goyal, Xian Li, Sergey Edunov, Marjan Ghazvininejad, Mike Lewis, and Luke Zettlemoyer. 2020 · 2020
Later among the works it cites.
Leveraging monolingual data with self-supervision for multilingual neural machine translation
Aditya Siddhant, Ankur Bapna, Yuan Cao, Orhan Firat, Mia Chen, Sneha Kudugunta, Naveen Arivazhagan, and Yonghui Wu. 2020 · 2020
Later among the works it cites.
On variational learning of controllable representations for text without supervision
Peng Xu, Jackie Chi Kit Cheung, and Yanshuai Cao. 2020 · 2020
Later among the works it cites.
Improving massively multilingual neural machine translation and zero-shot translation
Biao Zhang, Philip Williams, Ivan Titov, and Rico Sennrich. 2020 · 2020
Later among the works it cites.
Olá, bonjour, salve! XFORMAL: A benchmark for multilingual formality style transfer
Eleftheria Briakou, Di Lu, Ke Zhang, and Joel Tetreault. 2021 · 2021
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Harnessing pre-trained neural networks with rules for formality style transfer
Yunli Wang, Yu Wu, Lili Mou, Zhoujun Li, and Wenhan Chao. 2019 · 2019
Cited alongside, same era.
Plug and play language models: A simple approach to controlled text generation
Sumanth Dathathri, Andrea Madotto, Janice Lan, Jane Hung, Eric Frank, Piero Molino, Jason Yosinski, and Rosanne Liu. 2020 · 2020
Cited alongside, same era.
A multilingual view of unsupervised machine translation
Xavier Garcia, Pierre Foret, Thibault Sellam, and Ankur Parikh. 2020 · 2020
Cited alongside, same era.
When and why is unsupervised neural machine translation useless?
Yunsu Kim, Miguel Graça, and Hermann Ney. 2020 · 2020
Cited alongside, same era.
The IndicNLP Library
Anoop Kunchukuttan. 2020 · 2020
Cited alongside, same era.
Reference language based unsupervised neural machine translation
Zuchao Li, Hai Zhao, Rui Wang, Masao Utiyama, and Eiichiro Sumita. 2020 · 2020
Cited alongside, same era.
Closest in time.
Cocon: A self-supervised approach for controlled text generation
Alvin Chan, Yew-Soon Ong, Bill Pung, Aston Zhang, and Jie Fu. 2021 · 2021
Closest in time.
Evaluating large language models trained on code
Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde, Jared Kaplan, Harri Edwards, Yura Burda, Nicholas Joseph, Greg Brockman, et al. 2021 · 2021
Closest in time.
Harnessing multilinguality in unsupervised machine translation for rare languages
Xavier Garcia, Aditya Siddhant, Orhan Firat, and Ankur Parikh. 2021 · 2021
Closest in time.
Machine translation into low-resource language varieties
Sachin Kumar, Antonios Anastasopoulos, Shuly Wintner, and Yulia Tsvetkov. 2021 · 2021
Closest in time.
Towards personalised and document-level machine translation of dialogue
Sebastian Vincent. 2021 · 2021
Closest in time.
mt5: A massively multilingual pre-trained text-to-text transformer
Linting Xue, Noah Constant, Adam Roberts, Mihir Kale, Rami Al-Rfou, Aditya Siddhant, Aditya Barua, and Colin Raffel. 2021 · 2021
Closest in time.