HiPerRAG: High-Performance Retrieval Augmented Generation for Scientific Insights

A question-answering framework for automated abstract screening using large language models

Opeoluwa Akinseloyin, Xiaorui Jiang, and Vasile Palade. 2024 · 1952

Earlier work this paper cites.

Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics . 311–318

Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. 2002 · 2002

Earlier work this paper cites.

Dense Passage Retrieval for Open-Domain Question Answering

Original

Vladimir Karpukhin, Barlas Oğuz, Sewon Min, Patrick Lewis, Ledell Wu, Sergey Edunov, Danqi Chen, and Wen tau Yih. 2020 · 2004

Earlier work this paper cites.

APD: The antimicrobial peptide database

Zhe Wang and Guangshun Wang. 2004 · 2004

Earlier work this paper cites.

Contrastive Representation Learning: A Framework and Review

Original

Phuc H. Le-Khac, Graham Healy, and Alan F. Smeaton. 2020 · 2010

Earlier work this paper cites.

Efficient Estimation of Word Representations in Vector Space

Original

Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013 · 2013

Earlier work this paper cites.

Scientists may be reaching a peak in reading habits

Richard Van Noorden. 2014 · 2014

Earlier work this paper cites.

Character-based parsing with convolutional neural network. In Twenty-Fourth International Joint Conference on Artificial Intelligence

Xiaoqing Zheng, Haoyuan Peng, Yi Chen, Pengjing Zhang, and Wenqiang Zhang. 2015 · 2015

Earlier work this paper cites.

Semantics, Analytics, Visualization. Enhancing Scholarly Data

2016 · 2016

Earlier work this paper cites.

Scientific literature: Information overload

Esther Landhuis. 2016 · 2016

Earlier work this paper cites.

You only look once: Unified, real-time object detection. In IEEE Conference on Computer Vision and Pattern Recognition . 779–788

Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016 · 2016

Earlier work this paper cites.

MSL: Facilitating automatic and physical analysis of published scientific literature in PDF format

Zeeshan Ahmed and Thomas Dandekar. 2017 · 2017

Earlier work this paper cites.

Crowdsourcing Multiple Choice Science Questions

Original

Johannes Welbl, Nelson F. Liu, and Matt Gardner. 2017 · 2017

Earlier work this paper cites.

Science of science

Santo Fortunato, Carl T. Bergstrom, Katy Börner, James A. Evans, Dirk Helbing, Staša Milojević, Alexander M. Petersen, Filippo Radicchi, Roberta Sinatra, Brian Uzzi, Alessandro Vespignani, Ludo Waltman, Dashun Wang, and Albert-László Barabási. 2018 · 2018

Earlier work this paper cites.

SciTaiL: A textual entailment dataset from science question answering. In AAAI Conference on Artificial Intelligence , Vol. 32

Tushar Khot, Ashish Sabharwal, and Peter Clark. 2018 · 2018

Earlier work this paper cites.

Parsl: Pervasive Parallel Programming in Python. In ACM International Symposium on High-Performance Parallel and Distributed Computing

Yadu Babuji, Anna Woodard, Zhuozhao Li, Ben Clifford, Rohan Kumar, Lukasz Lacinski, Ryan Chard, Justin Wozniak, Ian Foster, Michael Wilde, Daniel Katz, and Kyle Chard. 2019 · 2019

Earlier work this paper cites.

Learning Representations by Maximizing Mutual Information Across Views

Original

Philip Bachman, R Devon Hjelm, and William Buchwalter. 2019 · 2019

Earlier work this paper cites.

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies . 4171–4186

Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. 2019 · 2019

Earlier work this paper cites.

BioBERT: a pre-trained biomedical language representation model for biomedical text mining

Jinhyuk Lee, Wonjin Yoon, Sungdong Kim, Donghyeon Kim, Sunkyu Kim, Chan Ho So, and Jaewoo Kang. 2019 · 2019

Earlier work this paper cites.

Molecular Transformer: A Model for Uncertainty-Calibrated Chemical Reaction Prediction

Philippe Schwaller, Teodoro Laino, Théophile Gaudin, Peter Bolgar, Christopher A. Hunter, Costas Bekas, and Alpha A. Lee. 2019 · 2019

Earlier work this paper cites.

Unsupervised word embeddings capture latent knowledge from materials science literature

Vahe Tshitoyan, John Dagdelen, Leigh Weston, Alexander Dunn, Ziqin Rong, Olga Kononova, Kristin A. Persson, Gerbrand Ceder, and Anubhav Jain. 2019 · 2019

Earlier work this paper cites.

The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Original

Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, and Connor Leahy. 2020 · 2020

Earlier work this paper cites.

ColBERT: Efficient and effective passage search via contextualized late interaction over BERT. In 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval . 39–48

Omar Khattab and Matei Zaharia. 2020 · 2020

Earlier work this paper cites.

Retrieval-augmented generation for knowledge-intensive NLP tasks. In 34th International Conference on Neural Information Processing Systems (Vancouver, BC, Canada) (NIPS’20) . Curran Associates Inc., Red Hook, NY, USA, Article 793, 16 pages

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich Küttler, Mike Lewis, Wen-tau Yih, Tim Rocktäschel, Sebastian Riedel, and Douwe Kiela. 2020 · 2020

Earlier work this paper cites.

LayoutLM: Pre-training of text and layout for document image understanding. In 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining . 1192–1200

Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, and Ming Zhou. 2020 · 2020

Earlier work this paper cites.

Slowed canonical progress in large fields of science

Johan SG Chu and James A Evans. 2021 · 2021

Earlier work this paper cites.

SimCSE: Simple Contrastive Learning of Sentence Embeddings. In Conference on Empirical Methods in Natural Language Processing , Marie-Francine Moens, Xuanjing Huang, Lucia Specia, and Scott Wen-tau Yih (Eds.). Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, 6894–6910

Tianyu Gao, Xingcheng Yao, and Danqi Chen. 2021 · 2021

Earlier work this paper cites.

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, and Hoifung Poon. 2021a · 2021

Earlier work this paper cites.

Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing

Yu Gu, Robert Tinn, Hao Cheng, Michael Lucas, Naoto Usuyama, Xiaodong Liu, Tristan Naumann, Jianfeng Gao, and Hoifung Poon. 2021b · 2021

Cited alongside, same era.

New directions in science emerge from disconnection and discord

Yiling Lin, James A. Evans, and Lingfei Wu. 2022 · 2021

Cited alongside, same era.

Pretrained Transformers as Universal Computation Engines

Original

Kevin Lu, Aditya Grover, Pieter Abbeel, and Igor Mordatch. 2021 · 2021

Cited alongside, same era.

Global citation inequality is on the rise

Mathias Wullum Nielsen and Jens Peter Andersen. 2021 · 2021

Cited alongside, same era.

DBAASP v3: Database of antimicrobial/cytotoxic activity and structure of peptides as a resource for development of new therapeutics

Malak Pirtskhalava, Anthony A Amstrong, Maia Grigolava, Mindia Chubinidze, Evgenia Alimbarashvili, Boris Vishnepolsky, Andrei Gabrielian, Alex Rosenthal, Darrell E Hurt, and Michael Tartakovsky. 2021 · 2021

Mistral 7B

Original

Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, Lélio Renard Lavaud, Marie-Anne Lachaux, Pierre Stock, Teven Le Scao, Thibaut Lavril, Thomas Wang, Timothée Lacroix, and William El Sayed. 2023 · 2023

Later among the works it cites.

PaperQA: Retrieval-augmented generative agent for scientific research

Original

Jakub Lála, Odhran O’Donoghue, Aleksandar Shtedritski, Sam Cox, Samuel G Rodriques, and Andrew D White. 2023 · 2023

Later among the works it cites.

AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation

Original

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Jiale Liu, Ahmed Hassan Awadallah, Ryen W White, Doug Burger, and Chi Wang. 2023 · 2023

Later among the works it cites.

Retrieving Multimodal Information for Augmented Generation: A Survey

Original

Ruochen Zhao, Hailin Chen, Weishi Wang, Fangkai Jiao, Xuan Long Do, Chengwei Qin, Bosheng Ding, Xiaobao Guo, Minzhi Li, Xingxuan Li, and Shafiq Joty. 2023 · 2023