2020

Toward Subgraph-Guided Knowledge Graph Question Generation with Graph Neural Networks

Chen, Yu, Wu, Lingfei, Zaki, Mohammed J.

Understand

Knowledge graph (KG) question generation (QG) aims to generate natural language questions from KGs and target answers.

Previous works mostly focus on a simple setting which is to generate questions from a single KG triple.
In this work, we focus on a more realistic setting where we aim to generate questions from a KG subgraph and target answers.
In addition, most of previous works built on either RNN-based or Transformer based models to encode a linearized KG sugraph, which totally discards the explicit structure information of a KG subgraph.

Built on

F. W. Levi, Finite geometrical systems: six public lectues delivered in February, 1940, at the University of Calcutta . The University of Calcutta, 1942
1942
Earlier work this paper cites.
R. J. Williams, “Simple statistical gradient-following algorithms for connectionist reinforcement learning,” Machine learning , vol. 8, no. 3-4, pp. 229–256, 1992
1992
Earlier work this paper cites.
S. Hochreiter and J. Schmidhuber, “Long short-term memory,” Neural computation , vol. 9, no. 8, pp. 1735–1780, 1997
1997
Earlier work this paper cites.
K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, “Bleu: a method for automatic evaluation of machine translation,” in Proceedings of the 40th annual meeting on association for computational linguistics . Association for Computational Linguistics, 2002, pp. 311–318
2002
Earlier work this paper cites.
C.-Y. Lin, “ROUGE: A package for automatic evaluation of summaries,” in Text Summarization Branches Out . Barcelona, Spain: Association for Computational Linguistics, 2004, pp. 74–81
2004
Earlier work this paper cites.
S. Banerjee and A. Lavie, “Meteor: An automatic metric for mt evaluation with improved correlation with human judgments,” in Proceedings of the acl workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization , 2005, pp. 65–72
2005
Earlier work this paper cites.
M. Heilman and N. A. Smith, “Good question! statistical ranking for question generation,” in Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics , 2010, pp. 609–617
2010
Earlier work this paper cites.
V. Nair and G. E. Hinton, “Rectified linear units improve restricted boltzmann machines,” in Proceedings of the 27th international conference on machine learning (ICML-10) , 2010, pp. 807–814
2010
Earlier work this paper cites.
A. Bordes, N. Usunier, A. Garcia-Duran, J. Weston, and O. Yakhnenko, “Translating embeddings for modeling multi-relational data,” in Advances in neural information processing systems , 2013, pp. 2787–2795
2013
Earlier work this paper cites.
I. Sutskever, O. Vinyals, and Q. Le, “Sequence to sequence learning with neural networks,” in Advances in Neural Information Processing Systems , 2014, pp. 3104–3112
2014
Earlier work this paper cites.
K. Cho, B. van Merrienboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio, “Learning phrase representations using rnn encoder–decoder for statistical machine translation,” in EMNLP , 2014, pp. 1724–1734
2014
Earlier work this paper cites.
J. Pennington, R. Socher, and C. Manning, “Glove: Global vectors for word representation,” in EMNLP , 2014, pp. 1532–1543
2014
Earlier work this paper cites.
D. Bahdanau, K. Cho, and Y. Bengio, “Neural machine translation by jointly learning to align and translate,” arXiv preprint arXiv:1409.0473 , 2014
Original
2014
Earlier work this paper cites.
D. P. Kingma and J. Ba, “Adam: A method for stochastic optimization,” arXiv preprint arXiv:1412.6980 , 2014
Original
2014
Earlier work this paper cites.
D. Seyler, M. Yahya, and K. Berberich, “Generating quiz questions from knowledge graphs,” in Proceedings of the 24th International Conference on World Wide Web . ACM, 2015, pp. 113–114
2015
Earlier work this paper cites.
Y. Li, D. Tarlow, M. Brockschmidt, and R. Zemel, “Gated graph sequence neural networks,” arXiv preprint arXiv:1511.05493 , 2015
Original
2015
Earlier work this paper cites.
M.-T. Luong, H. Pham, and C. D. Manning, “Effective approaches to attention-based neural machine translation,” arXiv preprint arXiv:1508.04025 , 2015
Original
2015
Earlier work this paper cites.
O. Vinyals, M. Fortunato, and N. Jaitly, “Pointer networks,” in Advances in Neural Information Processing Systems , 2015, pp. 2692–2700
2015
Earlier work this paper cites.
S. Bengio, O. Vinyals, N. Jaitly, and N. Shazeer, “Scheduled sampling for sequence prediction with recurrent neural networks,” in Advances in Neural Information Processing Systems , 2015, pp. 1171–1179
2015
Earlier work this paper cites.
M. Ranzato, S. Chopra, M. Auli, and W. Zaremba, “Sequence level training with recurrent neural networks,” arXiv preprint arXiv:1511.06732 , 2015
Original
2015
Earlier work this paper cites.
D. P. Kingma, T. Salimans, and M. Welling, “Variational dropout and the local reparameterization trick,” in Advances in Neural Information Processing Systems , 2015, pp. 2575–2583
2015
Earlier work this paper cites.
N. Mostafazadeh, I. Misra, J. Devlin, M. Mitchell, X. He, and L. Vanderwende, “Generating natural questions about an image,” arXiv preprint arXiv:1603.06059 , 2016
Original
2016
Earlier work this paper cites.
L. Song and L. Zhao, “Question generation from a knowledge base with web exploration,” arXiv preprint arXiv:1610.03807 , 2016
Original
2016
Earlier work this paper cites.
I. V. Serban, A. García-Durán, C. Gulcehre, S. Ahn, S. Chandar, A. Courville, and Y. Bengio, “Generating factoid questions with recurrent neural networks: The 30m factoid question-answer corpus,” arXiv preprint arXiv:1603.06807 , 2016
Original
2016
Earlier work this paper cites.
T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” arXiv preprint arXiv:1609.02907 , 2016
Original
2016
Earlier work this paper cites.
J. Gu, Z. Lu, H. Li, and V. O. Li, “Incorporating copying mechanism in sequence-to-sequence learning,” arXiv preprint arXiv:1603.06393 , 2016
Original
2016
Earlier work this paper cites.

Similar

Y. Wu, M. Schuster, Z. Chen, Q. V. Le, M. Norouzi, W. Macherey, M. Krikun, Y. Cao, Q. Gao, K. Macherey et al. , “Google’s neural machine translation system: Bridging the gap between human and machine translation,” arXiv preprint arXiv:1609.08144 , 2016
Original
2016
Cited alongside, same era.
W.-t. Yih, M. Richardson, C. Meek, M.-W. Chang, and J. Suh, “The value of semantic parse labeling for knowledge base question answering,” in Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) , 2016, pp. 201–206
2016
Cited alongside, same era.
Z. Tu, Z. Lu, Y. Liu, X. Liu, and H. Li, “Modeling coverage for neural machine translation,” arXiv preprint arXiv:1601.04811 , 2016
Original
2016
Cited alongside, same era.
X. Du, J. Shao, and C. Cardie, “Learning to ask: Neural question generation for reading comprehension,” arXiv preprint arXiv:1705.00106 , 2017
Original
2017
Cited alongside, same era.
D. Seyler, M. Yahya, and K. Berberich, “Knowledge questions from knowledge graphs,” in Proceedings of the ACM SIGIR International Conference on Theory of Information Retrieval . ACM, 2017, pp. 11–18
2017
Cited alongside, same era.
D. Tang, N. Duan, T. Qin, Z. Yan, and M. Zhou, “Question answering and question generation as dual tasks,” arXiv preprint arXiv:1706.02027 , 2017
Original
2017
Cited alongside, same era.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” in Advances in neural information processing systems , 2017, pp. 5998–6008
2017
Cited alongside, same era.
S. Reddy, D. Raghu, M. M. Khapra, and S. Joshi, “Generating natural language question-answer pairs from a knowledge graph using a rnn based question generation model,” in Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers , 2017, pp. 376–385
2017
Cited alongside, same era.
J. Gilmer, S. S. Schoenholz, P. F. Riley, O. Vinyals, and G. E. Dahl, “Neural message passing for quantum chemistry,” in Proceedings of the 34th International Conference on Machine Learning-Volume 70 . JMLR. org, 2017, pp. 1263–1272
2017
Cited alongside, same era.
W. Hamilton, Z. Ying, and J. Leskovec, “Inductive representation learning on large graphs,” in Advances in Neural Information Processing Systems , 2017, pp. 1024–1034
2017
Cited alongside, same era.
J. Bastings, I. Titov, W. Aziz, D. Marcheggiani, and K. Sima’an, “Graph convolutional encoders for syntax-aware neural machine translation,” arXiv preprint arXiv:1704.04675 , 2017
Original
2017
Cited alongside, same era.
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Lio, and Y. Bengio, “Graph attention networks,” arXiv preprint arXiv:1710.10903 , 2017
Original
2017
Cited alongside, same era.

Then

D. Marcheggiani and L. Perez-Beltrachini, “Deep graph convolutional encoders for structured data to text generation,” arXiv preprint arXiv:1810.09995 , 2018
Original
2018
Later among the works it cites.
P. Vougiouklis, H. Elsahar, L.-A. Kaffee, C. Gravier, F. Laforest, J. Hare, and E. Simperl, “Neural wikipedian: Generating textual summaries from knowledge base triples,” Journal of Web Semantics , vol. 52, pp. 1–15, 2018
2018
Later among the works it cites.
Google, “Freebase data dumps,” https://developers.google.com/freebase
2018
Later among the works it cites.
A. Talmor and J. Berant, “The web as a knowledge-base for answering complex questions,” arXiv preprint arXiv:1803.06643 , 2018
Original
2018
Later among the works it cites.
M. Zhou, M. Huang, and X. Zhu, “An interpretable reasoning network for multi-relation question answering,” arXiv preprint arXiv:1801.04726 , 2018
Original
2018
Later among the works it cites.
Y. Chen, L. Wu, and M. J. Zaki, “Bidirectional attentive memory networks for question answering over knowledge bases,” NAACL , 2019
2019
Later among the works it cites.
C. Liu, K. Liu, S. He, Z. Nie, and J. Zhao, “Generating questions for knowledge bases via incorporating diversified contexts and answer-aware loss,” in EMNLP , 2019, pp. 2431–2441
2019
Later among the works it cites.
V. Kumar, Y. Hua, G. Ramakrishnan, G. Qi, L. Gao, and Y.-F. Li, “Difficulty-controllable multi-hop question generation from knowledge graphs,” in International Semantic Web Conference . Springer, 2019, pp. 382–398
2019
Later among the works it cites.
S. Haussmann, O. Seneviratne, Y. Chen, Y. Ne’eman, J. Codella, C.-H. Chen, D. L. McGuinness, and M. J. Zaki, “Foodkg: A semantics-driven knowledge graph for food recommendation,” in International Semantic Web Conference . Springer, 2019, pp. 146–162
2019
Later among the works it cites.
L. F. Ribeiro, C. Gardent, and I. Gurevych, “Enhancing amr-to-text generation with dual graph representations,” arXiv preprint arXiv:1909.00352 , 2019
Original
2019
Later among the works it cites.
R. Koncel-Kedziorski, D. Bekal, Y. Luan, M. Lapata, and H. Hajishirzi, “Text generation from knowledge graphs with graph transformers,” arXiv preprint arXiv:1904.02342 , 2019
Original
2019
Later among the works it cites.
Y. Chen, L. Wu, and M. J. Zaki, “Reinforcement learning based graph-to-sequence model for natural question generation,” ICLR , 2020
2020
Closest in time.
L. Pan, Y. Xie, Y. Feng, T.-S. Chua, and M.-Y. Kan, “Semantic graphs for generating deep questions,” arXiv preprint arXiv:2004.12704 , 2020
Original
2020
Closest in time.
S. Bi, X. Cheng, Y. Li, Y. Wang, and G. Qi, “Knowledge-enriched, type-constrained and grammar-guided question generation over knowledge bases,” in COLING 2020 , 2020, pp. 2776–2786
2020
Closest in time.
W. Chen, Y. Su, X. Yan, and W. Y. Wang, “KGPT: knowledge-grounded pre-training for data-to-text generation,” in EMNLP 2020 , 2020, pp. 8635–8648
2020
Closest in time.
Y. Chen, L. Wu, and M. J. Zaki, “Iterative deep graph learning for graph neural networks: Better and robust node embeddings,” in Advances in Neural Information Processing Systems , 2020, pp. 19 314–19 326
2020
Closest in time.
Y. Chen, L. Wu, and M. J. Zaki, “Graphflow: Exploiting conversation flow with graph neural networks for conversational machine comprehension,” in IJCAI 2020 , 2020, pp. 1230–1236
2020
Closest in time.
Y. Chen, A. Subburathinam, C. Chen, and M. J. Zaki, “Personalized food recommendation as constrained question answering over a large-scale food knowledge graph,” in WSDM 2021 , 2021, pp. 544–552
2021
Closest in time.
P. Ke, H. Ji, Y. Ran, X. Cui, L. Wang, L. Song, X. Zhu, and M. Huang, “Jointgt: Graph-text joint representation learning for text generation from knowledge graphs,” in Findings of the Association for Computational Linguistics: ACL/IJCNLP 2021 , 2021, pp. 2526–2538
2021
Closest in time.
L. Wu, Y. Chen, H. Ji, and B. Liu, “Deep learning on graphs for natural language processing,” in Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval , 2021, pp. 2651–2653
2021
Closest in time.
S. Liu, Y. Chen, X. Xie, J. K. Siow, and Y. Liu, “Retrieval-augmented generation for code summarization via hybrid GNN,” in ICLR 2021 , 2021
2021
Closest in time.
Y. Hu, H. Yang, G. Zhou, and J. X. Huang, “Generating factoid questions with question type enhanced representation and attention-based copy mechanism,” Transactions on Asian and Low-Resource Language Information Processing , vol. 21, no. 2, pp. 1–18, 2022
2022
Closest in time.
X. Shen, J. Chen, J. Chen, C. Zeng, and Y. Xiao, “Diversified query generation guided by knowledge graph,” in Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining , 2022, pp. 897–907
2022
Closest in time.
N. Liu, X. Wang, L. Wu, Y. Chen, X. Guo, and C. Shi, “Compact graph structure learning via mutual information compression,” in TheWebConf 2022 , 2022
2022
Closest in time.
L. Wu, Y. Chen, K. Shen, X. Guo, H. Gao, S. Li, J. Pei, B. Long et al. , “Graph neural networks for natural language processing: A survey,” Foundations and Trends® in Machine Learning , vol. 16, no. 2, pp. 119–328, 2023
2023
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…