Benchmarking Large Language Models on Multiple Tasks in Bioinformatics NLP with Prompting

Bertscore: Evaluating text generation with bert

Original

Tianyi Zhang, Varsha Kishore, Felix Wu, Kilian Q Weinberger, and Yoav Artzi. 2019 · 1904

Earlier work this paper cites.

Pubmedqa: A dataset for biomedical research question answering

Original

Qiao Jin, Bhuwan Dhingra, Zhengping Liu, William W Cohen, and Xinghua Lu. 2019 · 1909

Earlier work this paper cites.

Language models as knowledge bases?

Original

Fabio Petroni, Tim Rocktäschel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, Alexander H Miller, and Sebastian Riedel. 2019 · 1909

Earlier work this paper cites.

Language models are few-shot learners

Original

Tom B Brown. 2020 · 2005

Earlier work this paper cites.

Blast: improvements for better sequence analysis

Jian Ye, Scott McGinnis, and Thomas L Madden. 2006 · 2006

Earlier work this paper cites.

Infernal 1.0: inference of rna alignments

Eric P Nawrocki, Diana L Kolbe, and Sean R Eddy. 2009 · 2009

Earlier work this paper cites.

Infernal 1.1: 100-fold faster rna homology searches

Eric P Nawrocki and Sean R Eddy. 2013 · 2013

Earlier work this paper cites.

Lora: Low-rank adaptation of large language models

Original

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021 · 2021

Earlier work this paper cites.

Dnabert: pre-trained bidirectional encoder representations from transformers model for dna-language in genome

Yanrong Ji, Zhihan Zhou, Han Liu, and Ramana V Davuluri. 2021 · 2021

Earlier work this paper cites.

What disease does this patient have? a large-scale open domain question answering dataset from medical exams

Di Jin, Eileen Pan, Nassim Oufattole, Wei-Hung Weng, Hanyi Fang, and Peter Szolovits. 2021 · 2021

Earlier work this paper cites.

Highly accurate protein structure prediction with alphafold

John Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ronneberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Žídek, Anna Potapenko, et al. 2021 · 2021

Earlier work this paper cites.

Prefix-tuning: Optimizing continuous prompts for generation

Original

Xiang Lisa Li and Percy Liang. 2021 · 2021

Earlier work this paper cites.

Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing, 2021

Original

Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2021 · 2021

Earlier work this paper cites.

Robustness of learning from task instructions

Original

Jiasheng Gu, Hongyu Zhao, Hanzi Xu, Liangyu Nie, Hongyuan Mei, and Wenpeng Yin. 2022 · 2022

Earlier work this paper cites.

Medmcqa: A large-scale multi-subject multi-choice dataset for medical domain question answering

Ankit Pal, Logesh Kumar Umapathi, and Malaikannan Sankarasubbu. 2022 · 2022

Earlier work this paper cites.

Leveraging large language models for multiple choice question answering. arxiv 2022

Original

Joshua Robinson, Christopher Michael Rytting, and David Wingate. 2022 · 2022

Earlier work this paper cites.

Self-consistency improves chain of thought reasoning in language models

Original

Xuezhi Wang, Jason Wei, Dale Schuurmans, Quoc Le, Ed Chi, Sharan Narang, Aakanksha Chowdhery, and Denny Zhou. 2022 · 2022

Earlier work this paper cites.

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022 · 2022

Earlier work this paper cites.

Peer: a comprehensive and multi-task benchmark for protein sequence understanding

Minghao Xu, Zuobai Zhang, Jiarui Lu, Zhaocheng Zhu, Yangtian Zhang, Ma Chang, Runcheng Liu, and Jian Tang. 2022 · 2022

Earlier work this paper cites.

Self-rag: Learning to retrieve, generate, and critique through self-reflection

Original

Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi. 2023 · 2023

Earlier work this paper cites.

Sparks of artificial general intelligence: Early experiments with gpt-4

Original

Sébastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023 · 2023

Earlier work this paper cites.

An extensive benchmark study on biomedical text generation and mining with chatgpt

Qijie Chen, Haotong Sun, Haoyang Liu, Yinghui Jiang, Ting Ran, Xurui Jin, Xianglu Xiao, Zhimin Lin, Hongming Chen, and Zhangmin Niu. 2023 · 2023

Earlier work this paper cites.

Synergpt: In-context learning for personalized drug synergy prediction and drug design

Original

Carl Edwards, Aakanksha Naik, Tushar Khot, Martin Burke, Heng Ji, and Tom Hope. 2023 · 2023

Earlier work this paper cites.

A cognitive stimulation dialogue system with multi-source knowledge fusion for elders with cognitive impairment

Original

Jiyue Jiang, Sheng Wang, Qintong Li, Lingpeng Kong, and Chuan Wu. 2023 · 2023

Earlier work this paper cites.

Mimic-iv, a freely accessible electronic health record dataset

Alistair EW Johnson, Lucas Bulgarelli, Lu Shen, Alvin Gayles, Ayad Shammout, Steven Horng, Tom J Pollard, Sicheng Hao, Benjamin Moody, Brian Gow, et al. 2023 · 2023

Cited alongside, same era.

Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing

Pengfei Liu, Weizhe Yuan, Jinlan Fu, Zhengbao Jiang, Hiroaki Hayashi, and Graham Neubig. 2023 · 2023

Cited alongside, same era.

Factscore: Fine-grained atomic evaluation of factual precision in long form text generation

Original

Sewon Min, Kalpesh Krishna, Xinxi Lyu, Mike Lewis, Wen-tau Yih, Pang Wei Koh, Mohit Iyyer, Luke Zettlemoyer, and Hannaneh Hajishirzi. 2023 · 2023

Cited alongside, same era.

Proteingym: Large-scale benchmarks for protein design and fitness prediction

Pascal Notin, Aaron W Kollasch, Daniel Ritter, Lood van Niekerk, Steffanie Paul, Hansen Spinner, Nathan Rollins, Ada Shaw, Ruben Weitzman, Jonathan Frazer, et al. 2023 · 2023

Cited alongside, same era.

Towards expert-level medical question answering with large language models

Assessing gpt-4 for cell type annotation in single-cell rna-seq analysis

Wenpin Hou and Zhicheng Ji. 2024 · 2024

Later among the works it cites.

An empirical study of llm-as-a-judge for llm evaluation: Fine-tuned judge models are task-specific classifiers

Original

Hui Huang, Yingqi Qu, Jing Liu, Muyun Yang, and Tiejun Zhao. 2024 · 2024

Later among the works it cites.

Qwen2. 5-coder technical report

Original

Binyuan Hui, Jian Yang, Zeyu Cui, Jiaxi Yang, Dayiheng Liu, Lei Zhang, Tianyu Liu, Jiajun Zhang, Bowen Yu, Kai Dang, et al. 2024 · 2024

Later among the works it cites.

Olaph: Improving factuality in biomedical long-form question answering

Original

Minbyul Jeong, Hyeon Hwang, Chanwoong Yoon, Taewhoo Lee, and Jaewoo Kang. 2024 · 2024

Later among the works it cites.

How well do llms handle cantonese? benchmarking cantonese capabilities of large language models