LLM2KB: Constructing Knowledge Bases using instruction tuned context aware Large Language Models

Brown, T., Mann, B., Ryder, N., Subbiah, M., Kaplan, J.D., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A. and Agarwal, S., 2020. Language models are few-shot learners. Advances in neural information processing systems, 33, pp.1877-1901

1901

Earlier work this paper cites.

Wolf, T., Debut, L., Sanh, V., Chaumond, J., Delangue, C., Moi, A., Cistac, P., Rault, T., Louf, R., Funtowicz, M. and Davison, J., 2019. Huggingface’s transformers: State-of-the-art natural language processing. arXiv preprint arXiv:1910.03771

Original

1910

Earlier work this paper cites.

Petroni, F., Rocktäschel, T., Riedel, S., Lewis, P., Bakhtin, A., Wu, Y. and Miller, A., 2019, November. Language Models as Knowledge Bases?. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 2463-2473)

2019

Earlier work this paper cites.

Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L. and Desmaison, A., 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems, 32

2019

Earlier work this paper cites.

Jiang, Z., Xu, F.F., Araki, J. and Neubig, G., 2020. How can we know what language models know?. Transactions of the Association for Computational Linguistics, 8, pp.423-438

2020

Earlier work this paper cites.

Bouraoui, Z., Camacho-Collados, J. and Schockaert, S., 2020, April. Inducing relational knowledge from BERT. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 34, No. 05, pp. 7456-7463)

2020

Earlier work this paper cites.

Shin, T., Razeghi, Y., Logan IV, R.L., Wallace, E. and Singh, S., 2020, November. AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 4222-4235)

2020

Earlier work this paper cites.

Kalo, J.C., Fichtel, L., Ehler, P. and Balke, W.T., 2020. KnowlyBERT-Hybrid query answering over language models and knowledge graphs. In The Semantic Web–ISWC 2020: 19th International Semantic Web Conference, Athens, Greece, November 2–6, 2020, Proceedings, Part I 19 (pp. 294-310). Springer International Publishing

2020

Earlier work this paper cites.

Karpukhin, V., Oguz, B., Min, S., Lewis, P., Wu, L., Edunov, S., Chen, D. and Yih, W.T., 2020, November. Dense Passage Retrieval for Open-Domain Question Answering. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 6769-6781)

2020

Earlier work this paper cites.

Hu, E.J., Shen, Y., Wallis, P., Allen-Zhu, Z., Li, Y., Wang, S., Wang, L. and Chen, W., 2021. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685

Original

2021

Earlier work this paper cites.

Razniewskia, S., Yatesa, A., Kassnerc, N. and Weikuma, G., 2021. Language Models As or For Knowledge Bases

2021

Earlier work this paper cites.

Haviv, A., Berant, J. and Globerson, A., 2021, April. BERTese: Learning to Speak to BERT. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume (pp. 3618-3623)

2021

Cited alongside, same era.

Qin, G. and Eisner, J., 2021, June. Learning How to Ask: Querying LMs with Mixtures of Soft Prompts. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 5203-5212)

2021

Cited alongside, same era.

Zhong, Z., Friedman, D. and Chen, D., 2021, June. Factual Probing Is [MASK]: Learning vs. Learning to Recall. In Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (pp. 5017-5033)

2021

Cited alongside, same era.

Fichtel, L., Kalo, J.C. and Balke, W.T., 2021, June. Prompt tuning or fine-tuning-investigating relational knowledge in pre-trained language models. In 3rd Conference on Automated Knowledge Base Construction

Alivanistos, D., Santamaría, S.B., Cochez, M., Kalo, J.C., van Krieken, E. and Thanapalasingam, T., 2022. Prompting as Probing: Using Language Models for Knowledge Base Construction

2022

Later among the works it cites.

Ning, X. and Celebi, R., 2022. Knowledge Base Construction from Pre-trained Language Models by Prompt learning

2022

Later among the works it cites.

Fang, X., Kalinowski, A., Zhao, H., You, Z., Zhang, Y. and An, Y., 2022. Prompt Design and Answer Processing for Knowledge Base Construction from Pre-trained Language Models (KBC-LM)

2022

Later among the works it cites.

Dalal, S., Sharma, A., Jain, S. and Dave, M., 2022. Manual Prompt Generation For Language Model Probing

2022

Later among the works it cites.

Dettmers, T., Lewis, M., Belkada, Y. and Zettlemoyer, L., 2022. Llm. int8 (): 8-bit matrix multiplication for transformers at scale. arXiv preprint arXiv:2208.07339

Original