2020

AutoQA: From Databases To QA Semantic Parsers With Only Synthetic Training Data

Xu, Silei, Semnani, Sina J., Campagna, Giovanni et al.

Understand

We propose AutoQA, a methodology and toolkit to generate semantic parsers that answer questions on databases, with no manual effort.

Given a database schema and its data, AutoQA automatically generates a large set of high-quality questions for training that covers different database operations.
It uses automatic paraphrasing combined with template-based parsing to find alternative expressions of an attribute in different parts of speech.
It also uses a novel filtered auto-paraphraser to generate correct paraphrases of entire sentences.

Built on

The curious case of neural text degeneration
Original
Ari Holtzman, Jan Buys, Li Du, Maxwell Forbes, and Yejin Choi. 2019 · 1904
Earlier work this paper cites.
Zero-shot text-to-SQL learning with auxiliary task
Original
Shuaichen Chang, Pengfei Liu, Yun Tang, Jing Huang, Xiaodong He, and Bowen Zhou. 2019 · 1908
Earlier work this paper cites.
Revisiting self-training for neural sequence generation
Original
Junxian He, Jiatao Gu, Jiajun Shen, and Marc’Aurelio Ranzato. 2019 · 1909
Earlier work this paper cites.
Towards scalable multi-domain conversational agents: The schema-guided dialogue dataset
Original
Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta, and Pranav Khaitan. 2019 · 1909
Earlier work this paper cites.
Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension
Original
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, and Luke Zettlemoyer. 2019 · 1910
Earlier work this paper cites.
Huggingface’s transformers: State-of-the-art natural language processing
Original
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, R’emi Louf, Morgan Funtowicz, and Jamie Brew. 2019 · 1910
Earlier work this paper cites.
Unsupervised word sense disambiguation rivaling supervised methods
David Yarowsky. 1995 · 1995
Earlier work this paper cites.
Long short-term memory
Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997
Earlier work this paper cites.
Data augmentation using pre-trained transformer models
Original
Varun Kumar, Ashutosh Choudhary, and Eunah Cho. 2020 · 2003
Earlier work this paper cites.
Unnatural language processing: Bridging the gap between synthetic and natural language data
Original
Alana Marzoev, Samuel Madden, M. Frans Kaashoek, Michael Cafarella, and Jacob Andreas. 2020 · 2004
Earlier work this paper cites.
Language models are few-shot learners
Original
Tom B Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 2005
Earlier work this paper cites.
Zero-shot transfer learning with synthesized data for multi-domain dialogue state tracking
Original
Giovanni Campagna, Agata Foryciarz, Mehrad Moradshahi, and Monica S Lam. 2020 · 2005
Earlier work this paper cites.
Effective self-training for parsing
David McClosky, Eugene Charniak, and Mark Johnson. 2006 · 2006
Earlier work this paper cites.
PPDB: The paraphrase database
Juri Ganitkevitch, Benjamin Van Durme, and Chris Callison-Burch. 2013 · 2013
Earlier work this paper cites.
Neural machine translation by jointly learning to align and translate
Original
Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. 2014 · 2014
Earlier work this paper cites.
Compositional semantic parsing on semi-structured tables
Panupong Pasupat and Percy Liang. 2015 · 2015
Earlier work this paper cites.
Building a semantic parser overnight
Yushi Wang, Jonathan Berant, and Percy Liang. 2015 · 2015
Earlier work this paper cites.

Similar

Language to logical form with neural attention
Li Dong and Mirella Lapata. 2016 · 2016
Cited alongside, same era.
Data recombination for neural semantic parsing
Robin Jia and Percy Liang. 2016 · 2016
Cited alongside, same era.
A diversity-promoting objective function for neural conversation models
Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. 2016 · 2016
Cited alongside, same era.
Neural paraphrase generation with stacked residual LSTM networks
Aaditya Prakash, Sadid A. Hasan, Kathy Lee, Vivek Datla, Ashequl Qadir, Joey Liu, and Oladimeji Farri. 2016 · 2016
Cited alongside, same era.
Controlling linguistic style aspects in neural language generation
Jessica Ficler and Yoav Goldberg. 2017 · 2017
Cited alongside, same era.
A deep generative framework for paraphrase generation
Original
Ankush Gupta, Arvind Agarwal, Prawaan Singh, and Piyush Rai. 2017 · 2017
Cited alongside, same era.
Neural semantic parsing with type constraints for semi-structured tables
Jayant Krishnamurthy, Pradeep Dasigi, and Matt Gardner. 2017 · 2017
Cited alongside, same era.
Paraphrasing revisited with neural machine translation
Jonathan Mallinson, Rico Sennrich, and Mirella Lapata. 2017 · 2017
Cited alongside, same era.
Get to the point: Summarization with pointer-generator networks
Abigail See, Peter J Liu, and Christopher D Manning. 2017 · 2017
Cited alongside, same era.
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017
Cited alongside, same era.
Seq2SQL: Generating structured queries from natural language using reinforcement learning
Original
Victor Zhong, Caiming Xiong, and Richard Socher. 2017 · 2017
Cited alongside, same era.
Sequence-to-action: End-to-end semantic graph generation for semantic parsing
Bo Chen, Le Sun, and Xianpei Han. 2018 · 2018
Cited alongside, same era.

Then

Contextual augmentation: Data augmentation by words with paradigmatic relations
Sosuke Kobayashi. 2018 · 2018
Later among the works it cites.
Self-attention with relative position representations
Original
Peter Shaw, Jakob Uszkoreit, and Ashish Vaswani. 2018 · 2018
Later among the works it cites.
Spider: A large-scale human-labeled dataset for complex and cross-domain semantic parsing and text-to-sql task
Tao Yu, Rui Zhang, Kai Yang, Michihiro Yasunaga, Dongxu Wang, Zifan Li, James Ma, Irene Li, Qingning Yao, Shanelle Roman, et al. 2018b · 2018
Later among the works it cites.
Genie: A generator of natural language semantic parsers for virtual assistant commands
Giovanni Campagna, Silei Xu, Mehrad Moradshahi, Richard Socher, and Monica S. Lam. 2019 · 2019
Later among the works it cites.
Semantic parsing with dual learning
Ruisheng Cao, Su Zhu, Chen Liu, Jieyu Li, and Kai Yu. 2019 · 2019
Later among the works it cites.
Practical semantic parsing for spoken language understanding
Marco Damonte, Rahul Goel, and Tagyoung Chung. 2019 · 2019
Later among the works it cites.
BERT: Pre-training of deep bidirectional transformers for language understanding
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019 · 2019
Later among the works it cites.
Language models are unsupervised multitask learners
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, and Ilya Sutskever. 2019 · 2019
Later among the works it cites.
Unsupervised paraphrasing without translation
Aurko Roy and David Grangier. 2019 · 2019
Later among the works it cites.
Domain-specific question answering at scale for conversational systems
Sina J. Semnani, Madhulima Pandey, and Manish Pandey. 2019 · 2019
Later among the works it cites.
Conditional BERT contextual augmentation
Xing Wu, Shangwen Lv, Liangjun Zang, Jizhong Han, and Songlin Hu. 2019 · 2019
Later among the works it cites.
An end-to-end generative architecture for paraphrase generation
Qian Yang, Zhouyuan Huo, Dinghan Shen, Yong Cheng, Wenlin Wang, Guoyin Wang, and Lawrence Carin. 2019 · 2019
Later among the works it cites.
Do not have enough data? deep learning to the rescue!
Ateret Anaby-Tavor, Boaz Carmeli, Esther Goldbraich, Amir Kantor, George Kour, Segev Shlomov, Naama Tepper, and Naama Zwerdling. 2020 · 2020
Closest in time.
Localizing open-ontology QA semantic parsers in a day using machine translation
Mehrad Moradshahi, Giovanni Campagna, Sina J. Semnani, Silei Xu, and Monica S. Lam. 2020 · 2020
Closest in time.
DBPal: A fully pluggable nl2sql training pipeline
Nathaniel Weir, Prasetya Utama, Alex Galakatos, Andrew Crotty, Amir Ilkhechi, Shekar Ramaswamy, Rohin Bhushan, Nadja Geisler, Benjamin Hättasch, Steffen Eger, Ugur Cetintemel, and Carsten Binnig. 2020 · 2020
Closest in time.
Schema2QA: High-quality and low-cost Q&A agents for the structured web
Silei Xu, Giovanni Campagna, Jian Li, and Monica S Lam. 2020 · 2020
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…