SPARQL Generation with Entity Pre-trained GPT for KG Question Answering

Attention is all you need

Original

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., and Polosukhin, I · 2017

Earlier work this paper cites.

BERT: pre-training of deep bidirectional transformers for language understanding

Original

Devlin, J., Chang, M., Lee, K., and Toutanova, K · 2018

Earlier work this paper cites.

Improving language understanding by generative pre-training, 2018

Radford, A., Narasimhan, K., Salimans, T., and Sutskever, I · 2018

Earlier work this paper cites.

A survey on transfer learning in natural language processing, 2020

Alyafeai, Z., AlShaibani, M. S., and Ahmad, I · 2020

Earlier work this paper cites.

Language models are few-shot learners

Original

Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., Agarwal, S., Herbert-Voss, A., Krueger, G., Henighan, T., Child, R., Ramesh, A., Ziegler, D. M., Wu, J., Winter, C., Hesse, C., Chen, M., Sigler, E., Litwin, M., Gray, S., Chess, B., Clark, J., Berner, C., McCandlish, S., Radford, A., Sutskever, I., and Amodei, D · 2020

Earlier work this paper cites.

Shortcut learning in deep neural networks

Original

Geirhos, R., Jacobsen, J., Michaelis, C., Zemel, R. S., Brendel, W., Bethge, M., and Wichmann, F. A · 2020

Earlier work this paper cites.

Knowledge Graphs

Hogan, A., Blomqvist, E., Cochez, M., d’Amato, C., de Melo, G., Gutiérrez, C., Kirrane, S., Labra Gayo, J. E., Navigli, R., Neumaier, S., Ngonga Ngomo, A.-C., Polleres, A., Rashid, S. M., Rula, A., Schmelzeisen, L., Sequeda, J. F., Staab, S., and Zimmermann, A · 2021

Cited alongside, same era.

Induced natural language rationales and interleaved markup tokens enable extrapolation in large language models, 2022

Bueno, M., Gemmell, C., Dalton, J., Lotufo, R., and Nogueira, R · 2022

Cited alongside, same era.

Sciqa benchmark: Dataset and rdf dump, Mar. 2023

Auer, S., Barone, D. A. C., Bartz, C., Cortes, E. G., Jaradeh, M. Y., Karras, O., Koubarakis, M., Mouromtsev, D., Pliukhin, D., Radyush, D., Shilin, I., Stocker, M., and Tsalapati, E · 2023

Cited alongside, same era.

Dblp-quad, Feb. 2023

Awale, S., Banerjee, D., Usbeck, R., and Biemann, C · 2023

Cited alongside, same era.

Dblplink: An entity linker for the dblp scholarly knowledge graph, 2023

Banerjee, D., Arefa, Usbeck, R., and Biemann, C · 2023

Cited alongside, same era.

Improving subgraph extraction algorithms for one-shot sparql query generation with large language models

Pliukhin, D., Radyush, D., Kovriguina, L., and Mouromtsev, D · 2023

Later among the works it cites.

Exploring the limits of transfer learning with a unified text-to-text transformer, 2023

Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., and Liu, P. J · 2023

Later among the works it cites.

BERTologyNavigator: Advanced question answering with bert-based semantics

Rajpal, S., and Usbeck, R · 2023

Later among the works it cites.

Leveraging llms in scholarly knowledge graph question answering

Taffa, T. A., and Usbeck, R · 2023

Later among the works it cites.

Nlqxform: A language model-based question to sparql transformer

Wang, R., Zhang, Z., Rossetto, L., Ruosch, F., and Bernstein, A · 2023

Later among the works it cites.