2018

Style Transfer Through Back-Translation

Prabhumoye, Shrimai, Tsvetkov, Yulia, Salakhutdinov, Ruslan et al.

Understand

Style transfer is the task of rephrasing the text to contain specific stylistic properties without changing the intent or affect within the context.

This paper introduces a new method for automatic style transfer.
We first learn a latent representation of the input sentence which is grounded in a language translation model in order to better preserve the meaning of the sentence while reducing stylistic properties.
Then adversarial generation techniques are used to make the output match the desired style.

Built on

Stereotype Threat and Women’s Math Performance
Steven J. Spencer, Claude M. Steele, and Diane M. Quinn. 1999 · 1999
Earlier work this paper cites.
BLEU: a method for automatic evaluation of machine translation
Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002
Earlier work this paper cites.
Language and gender
Penelope Eckert and Sally McConnell-Ginet. 2003 · 2003
Earlier work this paper cites.
Language and woman’s place: Text and commentaries , volume 3
Robin Tolmach Lakoff and Mary Bucholtz. 2004 · 2004
Earlier work this paper cites.
Large scale evaluation of corpus-based synthesizers: Results and lessons from the blizzard challenge 2005
Christina L Bennett. 2005 · 2005
Earlier work this paper cites.
Moses: Open source toolkit for statistical machine translation
Philipp Koehn, Hieu Hoang, Alexandra Birch, Chris Callison-Burch, Marcello Federico, Nicola Bertoldi, Brooke Cowan, Wade Shen, Christine Moran, Richard Zens, et al. 2007 · 2007
Earlier work this paper cites.
Fightin words: Lexical feature selection and evaluation for identifying the content of political conflict
Burt L. Monroe, Michael P. Colaresi, and Kevin M. Quinn. 2008 · 2008
Earlier work this paper cites.
Generating phrasal and sentential paraphrases: A survey of data-driven methods
Nitin Madnani and Bonnie J Dorr. 2010 · 2010
Earlier work this paper cites.
Meteor 1.3: Automatic metric for reliable optimization and evaluation of machine translation systems
Michael Denkowski and Alon Lavie. 2011 · 2011
Earlier work this paper cites.
Learning sentential paraphrases from bilingual parallel corpora for text-to-text generation
Juri Ganitkevitch, Chris Callison-Burch, Courtney Napoles, and Benjamin Van Durme. 2011 · 2011
Earlier work this paper cites.
Data-driven response generation in social media
Alan Ritter, Colin Cherry, and William B Dolan. 2011 · 2011
Earlier work this paper cites.
The multilingual paraphrase database
Juri Ganitkevitch and Chris Callison-Burch. 2014 · 2014
Earlier work this paper cites.
Auto-encoding variational bayes
Diederik P Kingma and Max Welling. 2014 · 2014
Earlier work this paper cites.
Sequence to sequence learning with neural networks
Ilya Sutskever, Oriol Vinyals, and Quoc V Le. 2014 · 2014
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2015 · 2015
Earlier work this paper cites.
Findings of the 2015 workshop on statistical machine translation
Ondřej Bojar, Rajen Chatterjee, Christian Federmann, Barry Haddow, Matthias Huck, Chris Hokamp, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Carolina Scarton, Lucia Specia, and Marco Turchi. 2015 · 2015
Earlier work this paper cites.

Similar

Women, men and language: A sociolinguistic account of gender differences in language
Jennifer Coates. 2015 · 2015
Cited alongside, same era.
Challenges of studying and processing dialects in social media
Anna Jørgensen, Dirk Hovy, and Anders Søgaard. 2015 · 2015
Cited alongside, same era.
Deep visual-semantic alignments for generating image descriptions
Andrej Karpathy and Li Fei-Fei. 2015 · 2015
Cited alongside, same era.
Effective approaches to attention-based neural machine translation
Minh-Thang Luong, Hieu Pham, and Christopher D. Manning. 2015 · 2015
Cited alongside, same era.
A neural network approach to context-sensitive generation of conversational responses
Alessandro Sordoni, Michel Galley, Michael Auli, Chris Brockett, Yangfeng Ji, Margaret Mitchell, Jian-Yun Nie, Jianfeng Gao, and Bill Dolan. 2015 · 2015
Cited alongside, same era.
A neural conversational model
Oriol Vinyals and Quoc Le. 2015 · 2015
Cited alongside, same era.
Demographic dialectal variation in social media: A case study of African-American English
Su Lin Blodgett, Lisa Green, and Brendan O’Connor. 2016 · 2016
Cited alongside, same era.
Tor, what is it good for? political repression and the use of online anonymity-granting technologies
Eric Jardine. 2016 · 2016
Cited alongside, same era.
Google’s multilingual neural machine translation system: enabling zero-shot translation
Original
Melvin Johnson, Mike Schuster, Quoc V Le, Maxim Krikun, Yonghui Wu, Zhifeng Chen, Nikhil Thorat, Fernanda Viégas, Martin Wattenberg, Greg Corrado, et al. 2016 · 2016
Cited alongside, same era.
Globally coherent text generation with neural checklist models
Chloé Kiddon, Luke Zettlemoyer, and Yejin Choi. 2016 · 2016
Cited alongside, same era.
A persona-based neural conversation model
Jiwei Li, Michel Galley, Chris Brockett, Georgios P Spithourakis, Jianfeng Gao, and Bill Dolan. 2016 · 2016
Cited alongside, same era.
Computational sociolinguistics: A survey
Dong Nguyen, A. Seza Doğruöz, Carolyn P. Rosé, and Franciska de Jong. 2016 · 2016
Cited alongside, same era.

Then

Toward controlled generation of text
Zhiting Hu, Zichao Yang, Xiaodan Liang, Ruslan Salakhutdinov, and Eric P Xing. 2017 · 2017
Later among the works it cites.
Adversarially Regularized Autoencoders for Generating Discrete Structures
Original
Junbo, Zhao, Y. Kim, K. Zhang, A. M. Rush, and Y. LeCun. 2017 · 2017
Later among the works it cites.
Paraphrasing revisited with neural machine translation
Jonathan Mallinson, Rico Sennrich, and Mirella Lapata. 2017 · 2017
Later among the works it cites.
A study of style in machine translation: Controlling the formality of machine translation output
Xing Niu, Marianna Martindale, and Marine Carpuat. 2017 · 2017
Later among the works it cites.
Social bias in elicited natural language inferences
Rachel Rudinger, Chandler May, and Benjamin Van Durme. 2017 · 2017
Later among the works it cites.
Get to the point: Summarization with pointer-generator networks
Abigail See, Peter J Liu, and Christopher D Manning. 2017 · 2017
Later among the works it cites.
Style transfer from non-parallel text by cross-alignment
Tianxiao Shen, Tao Lei, Regina Barzilay, and Tommi Jaakkola. 2017 · 2017
Later among the works it cites.
A network-based end-to-end trainable task-oriented dialogue system
Tsung-Hsien Wen, David Vandyke, Nikola Mrksic, Milica Gasic, Lina M Rojas-Barahona, Pei-Hao Su, Stefan Ultes, and Steve Young. 2017 · 2017
Later among the works it cites.
Learning paraphrastic sentence embeddings from back-translated bitext
John Wieting, Jonathan Mallinson, and Kevin Gimpel. 2017 · 2017
Later among the works it cites.
Unsupervised neural machine translation
Mikel Artetxe, Gorka Labaka, Eneko Agirre, and Kyunghyun Cho. 2018 · 2018
Closest in time.
Style Transfer in Text: Exploration and Evaluation
Zhenxin Fu, Xiaoye Tan, Nanyun Peng, Dongyan Zhao, and Rui Yan. 2018 · 2018
Closest in time.
Unsupervised machine translation using monolingual corpora only
Guillaume Lample, Alexis Conneau, Ludovic Denoyer, and Marc’Aurelio Ranzato. 2018 · 2018
Closest in time.
Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfer
Original
J. Li, R. Jia, H. He, and P. Liang. 2018 · 2018
Closest in time.
RtGender: A corpus for studying differential responses to gender
Rob Voigt, David Jurgens, Vinodkumar Prabhakaran, Dan Jurafsky, and Yulia Tsvetkov. 2018 · 2018
Closest in time.
Show, attend and tell: Neural image caption generation with visual attention
Kelvin Xu, Jimmy Ba, Ryan Kiros, Kyunghyun Cho, Aaron Courville, Ruslan Salakhudinov, Rich Zemel, and Yoshua Bengio. 2015 · 2057
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…