Data Augmentation for Spoken Language Understanding via Pretrained Language Models

X. Lu, B. Zheng, A. Velivelli, and C. Zhai, “Enhancing text categorization with semantic-enriched representation and training data augmentation,” Journal of the American Medical Informatics Association , vol. 13, no. 5, pp. 526–535, 2006

2006

Earlier work this paper cites.

G. Tur, D. Hakkani-Tür, and L. Heck, “What is left to be understood in atis?” in 2010 IEEE Spoken Language Technology Workshop . IEEE, 2010, pp. 19–24

2010

Earlier work this paper cites.

J. R. Bellegarda, “Spoken language understanding for natural interaction: The siri experience,” in Natural interaction with robots, knowbots and smartphones . Springer, 2014, pp. 3–14

2014

Earlier work this paper cites.

A. Hannun, C. Case, J. Casper, B. Catanzaro, G. Diamos, E. Elsen, R. Prenger, S. Satheesh, S. Sengupta, A. Coates et al. , “Deep speech: Scaling up end-to-end speech recognition,” arXiv preprint arXiv:1412.5567 , 2014

Original

2014

Earlier work this paper cites.

D. P. Kingma, S. Mohamed, D. J. Rezende, and M. Welling, “Semi-supervised learning with deep generative models,” in Advances in neural information processing systems , 2014, pp. 3581–3589

2014

Earlier work this paper cites.

D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980 , 2014

Original

2014

Earlier work this paper cites.

G. Kurata, B. Xiang, and B. Zhou, “Labeled data generation with encoder-decoder lstm for semantic slot filling.” in Interspeech , 2016

2016

Earlier work this paper cites.

Y.-N. Chen, D. Hakanni-Tür, G. Tur, A. Celikyilmaz, J. Guo, and L. Deng, “Syntax or semantics? Knowledge-guided joint semantic frame parsing,” in 2016 IEEE Spoken Language Technology Workshop (SLT) . IEEE, 2016, pp. 348–355

2016

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , pp. 5998–6008, 2017

2017

Earlier work this paper cites.

Y. Hou, Y. Liu, W. Che, and T. Liu, “Sequence-to-sequence data augmentation for dialogue language understanding,” arXiv preprint arXiv:1807.01554 , 2018

Original

2018

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805 , 2018

Original

2018

Cited alongside, same era.

A. Radford, K. Narasimhan, T. Salimans, and I. Sutskever, “Improving language understanding by generative pre-training,” 2018

2018

Cited alongside, same era.

M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer, “Deep contextualized word representations,” arXiv preprint arXiv:1802.05365 , 2018

Original

2018

Cited alongside, same era.

C. Zhu, M. Zeng, and X. Huang, “Sdnet: Contextualized attention-based deep network for conversational question answering,” arXiv preprint arXiv:1812.03593 , 2018

Original

2018

Cited alongside, same era.

A. Coucke, A. Saade, A. Ball, T. Bluche, A. Caulier, D. Leroy, C. Doumouro, T. Gisselbrecht, F. Caltagirone, T. Lavril et al. , “Snips voice platform: an embedded spoken language understanding system for private-by-design voice interfaces,” arXiv preprint arXiv:1805.10190 , 2018

E. Cho, H. Xie, J. P. Lalor, V. Kumar, and W. M. Campbell, “Efficient semi-supervised learning for natural language understanding by optimizing diversity,” in 2019 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) . IEEE, 2019, pp. 1077–1084

2019

Later among the works it cites.

L. Dong, N. Yang, W. Wang, F. Wei, X. Liu, Y. Wang, J. Gao, M. Zhou, and H.-W. Hon, “Unified language model pre-training for natural language understanding and generation,” arXiv preprint arXiv:1905.03197 , 2019

Original

2019

Later among the works it cites.

Y. Liu and M. Lapata, “Text summarization with pretrained encoders,” EMNLP , 2019

2019

Later among the works it cites.

A. Holtzman, J. Buys, L. Du, M. Forbes, and Y. Choi, “The curious case of neural text degeneration,” arXiv preprint arXiv:1904.09751 , 2019

Original

2019

Later among the works it cites.