Evolutionary Optimization of Model Merging Recipes

Visual Question Answering Dataset for Bilingual Image Understanding: A Study of Cross-Lingual Transfer Using Attention Maps. In

Nobuyuki Shimizu, Na Rong, and Takashi Miyazaki. 2018 · 1928

Earlier work this paper cites.

Learning to control fast-weight memories: An alternative to dynamic recurrent networks

Jürgen Schmidhuber. 1992 · 1992

Earlier work this paper cites.

Simplifying neural nets by discovering flat minima

Sepp Hochreiter and Jürgen Schmidhuber. 1994 · 1994

Earlier work this paper cites.

Flat minima

Sepp Hochreiter and Jürgen Schmidhuber. 1997 · 1997

Earlier work this paper cites.

The cathedral and the bazaar

Eric Raymond. 1999 · 1999

Earlier work this paper cites.

A fast and elitist multiobjective genetic algorithm: NSGA-II

Kalyanmoy Deb, Amrit Pratap, Sameer Agarwal, and TAMT Meyarivan. 2002 · 2002

Earlier work this paper cites.

Evolving neural networks through augmenting topologies

Kenneth O Stanley and Risto Miikkulainen. 2002 · 2002

Earlier work this paper cites.

The CMA evolution strategy: a comparing review

Nikolaus Hansen. 2006 · 2006

Earlier work this paper cites.

Hypernetworks

Original

David Ha, Andrew Dai, and Quoc V Le. 2016 · 2016

Earlier work this paper cites.

FastText.zip: Compressing text classification models

Original

Armand Joulin, Edouard Grave, Piotr Bojanowski, Matthijs Douze, Hérve Jégou, and Tomas Mikolov. 2016b · 2016

Earlier work this paper cites.

Bag of Tricks for Efficient Text Classification

Original

Armand Joulin, Edouard Grave, Piotr Bojanowski, and Tomas Mikolov. 2016a · 2016

Earlier work this paper cites.

Sampling generative networks

Original

Tom White. 2016 · 2016

Earlier work this paper cites.

Neural architecture search with reinforcement learning

Original

Barret Zoph and Quoc V Le. 2016 · 2016

Earlier work this paper cites.

Computing nonvacuous generalization bounds for deep (stochastic) neural networks with many more parameters than training data

Original

Gintare Karolina Dziugaite and Daniel M Roy. 2017 · 2017

Earlier work this paper cites.

On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima. In

Nitish Shirish Keskar, Dheevatsa Mudigere, Jorge Nocedal, Mikhail Smelyanskiy, and Ping Tak Peter Tang. 2017 · 2017

Earlier work this paper cites.

Optuna: A Next-generation Hyperparameter Optimization Framework. In

Takuya Akiba, Shotaro Sano, Toshihiko Yanase, Takeru Ohta, and Masanori Koyama. 2019 · 2019

Earlier work this paper cites.

Weight agnostic neural networks

Adam Gaier and David Ha. 2019 · 2019

Earlier work this paper cites.

Regularized evolution for image classifier architecture search. In

Esteban Real, Alok Aggarwal, Yanping Huang, and Quoc V Le. 2019 · 2019

Earlier work this paper cites.

The evolved transformer. In

David So, Quoc Le, and Chen Liang. 2019 · 2019

Earlier work this paper cites.

Training Verifiers to Solve Math Word Problems

Original

Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert, Jerry Tworek, Jacob Hilton, Reiichiro Nakano, Christopher Hesse, and John Schulman. 2021 · 2021

Earlier work this paper cites.

Relative Flatness and Generalization. In

Henning Petzka, Michael Kamp, Linara Adilova, Cristian Sminchisescu, and Mario Boley. 2021 · 2021

Cited alongside, same era.

A call to build models like we build open-source software

Colin Raffel. 2021 · 2021

Cited alongside, same era.

Stable Diffusion WebUI

AUTOMATIC1111. 2022 · 2022

Cited alongside, same era.

Transformer feed-forward layers build predictions by promoting concepts in the vocabulary space

Original

Mor Geva, Avi Caciularu, Kevin Ro Wang, and Yoav Goldberg. 2022 · 2022

Cited alongside, same era.

Editing models with task arithmetic

Original

Gabriel Ilharco, Marco Tulio Ribeiro, Mitchell Wortsman, Suchin Gururangan, Ludwig Schmidt, Hannaneh Hajishirzi, and Ali Farhadi. 2022 · 2022

Cited alongside, same era.

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models

Original

Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. 2023 · 2023

Later among the works it cites.

WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instruct

Original

Haipeng Luo, Qingfeng Sun, Can Xu, Pu Zhao, Jianguang Lou, Chongyang Tao, Xiubo Geng, Qingwei Lin, Shifeng Chen, and Dongmei Zhang. 2023 · 2023

Later among the works it cites.

Building machine learning models like open source software

Colin Raffel. 2023 · 2023

Later among the works it cites.

Language models are multilingual chain-of-thought reasoners. In

Freda Shi, Mirac Suzgun, Markus Freitag, Xuezhi Wang, Suraj Srivats, Soroush Vosoughi, Hyung Won Chung, Yi Tay, Sebastian Ruder, Denny Zhou, Dipanjan Das, and Jason Wei. 2023 · 2023

Later among the works it cites.

Japanese Stable VLM

Makoto Shing and Takuya Akiba. 2023 · 2023

Later among the works it cites.