RouterEval: A Comprehensive Benchmark for Routing LLMs to Explore Model-level Scaling Up in LLMs

Hellaswag: Can a machine really finish your sentence?

Original

Rowan Zellers, Ari Holtzman, Yonatan Bisk, Ali Farhadi, and Yejin Choi. 2019 · 1905

Earlier work this paper cites.

Roberta: A robustly optimized bert pretraining approach

Original

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019 · 1907

Earlier work this paper cites.

Sentence-bert: Sentence embeddings using siamese bert-networks

Original

Nils Reimers and Iryna Gurevych. 2019 · 1908

Earlier work this paper cites.

Dropout: a simple way to prevent neural networks from overfitting

Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014 · 1958

Earlier work this paper cites.

Routing to the expert: Efficient reward-guided ensemble of large language models

Keming Lu, Hongyi Yuan, Runji Lin, Junyang Lin, Zheng Yuan, Chang Zhou, and Jingren Zhou. 2024b · 1974

Earlier work this paper cites.

Animating rotation with quaternion curves

Ken Shoemake. 1985 · 1985

Earlier work this paper cites.

Adaptive mixtures of local experts

Robert A. Jacobs, Michael I. Jordan, Steven J. Nowlan, and Geoffrey E. Hinton. 1991 · 1991

Earlier work this paper cites.

Hierarchical mixtures of experts and the EM algorithm

M.I. Jordan and R.A. Jacobs. 1993 · 1993

Earlier work this paper cites.

Scaling to very very large corpora for natural language disambiguation

Michele Banko and Eric Brill. 2001 · 2001

Earlier work this paper cites.

Methods and metrics for cold-start recommendations

Andrew I Schein, Alexandrin Popescul, Lyle H Ungar, and David M Pennock. 2002 · 2002

Earlier work this paper cites.

Longformer: The long-document transformer

Original

Iz Beltagy, Matthew E Peters, and Arman Cohan. 2020 · 2004

Earlier work this paper cites.

Searching for robust pareto-optimal solutions in multi-objective optimization

Kalyanmoy Deb and Himanshu Gupta. 2005 · 2005

Earlier work this paper cites.

Pattern recognition and machine learning , volume 4

Christopher M Bishop and Nasser M Nasrabadi. 2006 · 2006

Earlier work this paper cites.

Addressing cold-start problem in recommendation systems

Xuan Nhat Lam, Thuc Vu, Trong Duc Le, and Anh Duc Duong. 2008 · 2008

Earlier work this paper cites.

Imagenet: A large-scale hierarchical image database

Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009 · 2009

Earlier work this paper cites.

The elements of statistical learning: data mining, inference, and prediction , volume 2

Trevor Hastie, Robert Tibshirani, Jerome H Friedman, and Jerome H Friedman. 2009 · 2009

Earlier work this paper cites.

Measuring massive multitask language understanding

Original

Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. 2020 · 2009

Earlier work this paper cites.

Scaling laws for autoregressive generative modeling

Original

Tom Henighan, Jared Kaplan, Mor Katz, Mark Chen, Christopher Hesse, Jacob Jackson, Heewoo Jun, Tom B Brown, Prafulla Dhariwal, Scott Gray, et al. 2020 · 2010

Earlier work this paper cites.

Methods for multi-objective optimization: An analysis

Ioannis Giagkiozis and Peter J Fleming. 2015 · 2015

Earlier work this paper cites.

Deep speech 2: End-to-end speech recognition in english and mandarin

Dario Amodei, Sundaram Ananthanarayanan, Rishita Anubhai, Jingliang Bai, Eric Battenberg, Carl Case, Jared Casper, Bryan Catanzaro, Qiang Cheng, Guoliang Chen, et al. 2016 · 2016

Earlier work this paper cites.

Causal inference for recommendation

Dawen Liang, Laurent Charlin, and David M Blei. 2016 · 2016

Earlier work this paper cites.

Meta-prod2vec: Product embeddings using side-information for recommendation

Flavian Vasile, Elena Smirnova, and Alexis Conneau. 2016 · 2016

Earlier work this paper cites.

Matching networks for one shot learning

Oriol Vinyals, Charles Blundell, Tim Lillicrap, Koray kavukcuoglu, and Daan Wierstra. 2016 · 2016

Earlier work this paper cites.

Neural collaborative filtering

Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat-Seng Chua. 2017 · 2017

Earlier work this paper cites.

Deep learning scaling is predictable, empirically

Original

Joel Hestness, Sharan Narang, Newsha Ardalani, Gregory Diamos, Heewoo Jun, Hassan Kianinejad, Md Mostofa Ali Patwary, Yang Yang, and Yanqi Zhou. 2017 · 2017

Earlier work this paper cites.

Outrageously large neural networks: The sparsely-gated mixture-of-experts layer

Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

A Vaswani. 2017 · 2017

Earlier work this paper cites.

Joint deep modeling of users and items using reviews for recommendation

Lei Zheng, Vahid Noroozi, and Philip S Yu. 2017 · 2017

Earlier work this paper cites.

To prune, or not to prune: exploring the efficacy of pruning for model compression

Original

Michael Zhu and Suyog Gupta. 2017 · 2017

Earlier work this paper cites.

Neural attentional rating regression with review-level explanations

Chong Chen, Min Zhang, Yiqun Liu, and Shaoping Ma. 2018 · 2018

Earlier work this paper cites.

Think you have solved question answering? try arc, the ai2 reasoning challenge

Original

Peter Clark, Isaac Cowhey, Oren Etzioni, Tushar Khot, Ashish Sabharwal, Carissa Schoenick, and Oyvind Tafjord. 2018 · 2018

Earlier work this paper cites.

Deep modeling of social relations for recommendation

Wenqi Fan, Qing Li, and Min Cheng. 2018 · 2018

Earlier work this paper cites.

Squeeze-and-excitation networks

Jie Hu, Li Shen, and Gang Sun. 2018 · 2018

Earlier work this paper cites.

Model evaluation, model selection, and algorithm selection in machine learning

Original

Sebastian Raschka. 2018 · 2018

Earlier work this paper cites.

Graph convolutional neural networks for web-scale recommender systems

Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L Hamilton, and Jure Leskovec. 2018 · 2018

Earlier work this paper cites.

Language models are unsupervised multitask learners

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019 · 2019

Earlier work this paper cites.

A survey on image data augmentation for deep learning

Connor Shorten and Taghi M Khoshgoftaar. 2019 · 2019

Earlier work this paper cites.

Bert4rec: Sequential recommendation with bidirectional encoder representations from transformer

Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019 · 2019

Earlier work this paper cites.

Rethinking pre-training and self-training

Barret Zoph, Golnaz Ghiasi, Tsung-Yi Lin, Yin Cui, Hanxiao Liu, Ekin Dogus Cubuk, and Quoc Le. 2020 · 2019

Earlier work this paper cites.

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020 · 2020

Earlier work this paper cites.

Epidemic graph convolutional network

Tyler Derr, Yao Ma, Wenqi Fan, Xiaorui Liu, Charu Aggarwal, and Jiliang Tang. 2020 · 2020

Earlier work this paper cites.

A graph neural network framework for social recommendations

Wenqi Fan, Yao Ma, Qing Li, Jianping Wang, Guoyong Cai, Jiliang Tang, and Dawei Yin. 2020 · 2020

Earlier work this paper cites.

Dianet: Dense-and-implicit attention network

Zhongzhan Huang, Senwei Liang, Mingfu Liang, and Haizhao Yang. 2020 · 2020

Earlier work this paper cites.

Scaling laws for neural language models

Original

Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B. Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. 2020 · 2020

Earlier work this paper cites.

Instance enhancement batch normalization: An adaptive regulator of batch noise

Senwei Liang, Zhongzhan Huang, Mingfu Liang, and Haizhao Yang. 2020 · 2020

Earlier work this paper cites.

BLEURT: Learning robust metrics for text generation

Thibault Sellam, Dipanjan Das, and Ankur Parikh. 2020 · 2020

Earlier work this paper cites.

Model fusion via optimal transport

Sidak Pal Singh and Martin Jaggi. 2020 · 2020

Earlier work this paper cites.

Causal inference for recommender systems

Yixin Wang, Dawen Liang, Laurent Charlin, and David M Blei. 2020 · 2020

Earlier work this paper cites.

Mind: A large-scale dataset for news recommendation

Fangzhao Wu, Ying Qiao, Jiun-Hung Chen, Chuhan Wu, Tao Qi, Jianxun Lian, Danyang Liu, Xing Xie, Jianfeng Gao, Winnie Wu, et al. 2020 · 2020

Earlier work this paper cites.

Bertscore: Evaluating text generation with bert

Tianyi Zhang*, Varsha Kishore*, Felix Wu*, Kilian Q. Weinberger, and Yoav Artzi. 2020 · 2020

Earlier work this paper cites.

Training verifiers to solve math word problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, et al. 2021 · 2021

Earlier work this paper cites.

Model performance scaling with multiple data sources

Tatsunori Hashimoto. 2021 · 2021

Cited alongside, same era.

Measuring mathematical problem solving with the math dataset

Original

Dan Hendrycks, Collin Burns, Saurav Kadavath, Akul Arora, Steven Basart, Eric Tang, Dawn Song, and Jacob Steinhardt. 2021 · 2021

Cited alongside, same era.

Scaling laws for transfer

Original

Danny Hernandez, Jared Kaplan, Tom Henighan, and Sam McCandlish. 2021 · 2021

Cited alongside, same era.

Altersgd: Finding flat minima for continual learning by alternative training

Original

Zhongzhan Huang, Mingfu Liang, Senwei Liang, and Wei He. 2021 · 2021

Cited alongside, same era.

Truthfulqa: Measuring how models mimic human falsehoods

Original

Instruction-following evaluation for large language models

Original

Jeffrey Zhou, Tianjian Lu, Swaroop Mishra, Siddhartha Brahma, Sujoy Basu, Yi Luan, Denny Zhou, and Le Hou. 2023 · 2023

Later among the works it cites.

Automix: Automatically mixing language models

Pranjal Aggarwal, Aman Madaan, Ankit Anand, Srividya Pranavi Potharaju, Swaroop Mishra, Pei Zhou, Aditya Gupta, Dheeraj Rajagopal, Karthik Kappaganthu, Yiming Yang, Shyam Upadhyay, Manaal Faruqui, and Mausam . 2024 · 2024

Later among the works it cites.

Flextron: Many-in-one flexible large language model

Original

Ruisi Cai, Saurav Muralidharan, Greg Heinrich, Hongxu Yin, Zhangyang Wang, Jan Kautz, and Pavlo Molchanov. 2024 · 2024

Later among the works it cites.

Domain adaptation for robust model routing

Christoph Dann, Yishay Mansour, Teodor Vanislavov Marinov, and Mehryar Mohri. 2024 · 2024

Later among the works it cites.

MatFormer: Nested transformer for elastic inference

Fnu Devvrit, Sneha Kudugunta, Aditya Kusupati, Tim Dettmers, Kaifeng Chen, Inderjit S Dhillon, Yulia Tsvetkov, Hannaneh Hajishirzi, Sham M. Kakade, Ali Farhadi, and Prateek Jain. 2024 · 2024