It's Morphing Time: Unleashing the Potential of Multiple LLMs via Multi-objective Optimization · Around

Fetching the paper…

It's Morphing Time: Unleashing the Potential of Multiple LLMs via Multi-objective Optimization · Around

Built on

P.-L. Yu, “Cone convexity, cone extreme points, and nondominated solutions in decision problems with multiobjectives,” Journal of optimization Theory and Applications , vol. 14, pp. 319–377, 1974
1974
Earlier work this paper cites.
G. Brown, “Diversity in neural network ensembles,” Ph.D. dissertation, Citeseer, 2004
2004
Earlier work this paper cites.
E. K. Tang, P. N. Suganthan, and X. Yao, “An analysis of diversity measures,” Machine learning , vol. 65, pp. 247–271, 2006
2006
Earlier work this paper cites.
A. Konak, D. W. Coit, and A. E. Smith, “Multi-objective optimization using genetic algorithms: A tutorial,” Reliability engineering & system safety , vol. 91, no. 9, pp. 992–1007, 2006
2006
Earlier work this paper cites.
M. T. Emmerich, K. C. Giannakoglou, and B. Naujoks, “Single-and multiobjective evolutionary optimization assisted by gaussian random field metamodels,” IEEE Transactions on Evolutionary Computation , vol. 10, no. 4, pp. 421–439, 2006
2006
Earlier work this paper cites.
N. Hansen, “The cma evolution strategy: a comparing review,” Towards a new evolutionary computation: Advances in the estimation of distribution algorithms , pp. 75–102, 2006
2006
Earlier work this paper cites.
X. Yao and M. M. Islam, “Evolving artificial neural network ensembles,” IEEE Computational Intelligence Magazine , vol. 3, no. 1, pp. 31–42, 2008
2008
Earlier work this paper cites.
S. Das and P. N. Suganthan, “Differential evolution: A survey of the state-of-the-art,” IEEE transactions on evolutionary computation , vol. 15, no. 1, pp. 4–31, 2010
2010
Earlier work this paper cites.
T. White, “Sampling generative networks,” arXiv preprint arXiv:1609.04468 , 2016
Original
2016
Earlier work this paper cites.
A. Ly, M. Marsman, J. Verhagen, R. P. Grasman, and E.-J. Wagenmakers, “A tutorial on fisher information,” Journal of Mathematical Psychology , vol. 80, pp. 40–55, 2017
2017
Earlier work this paper cites.
R. Zellers, A. Holtzman, Y. Bisk, A. Farhadi, and Y. Choi, “Hellaswag: Can a machine really finish your sentence?” arXiv preprint arXiv:1905.07830 , 2019
Original
2019
Earlier work this paper cites.
S. Daulton, M. Balandat, and E. Bakshy, “Differentiable expected hypervolume improvement for parallel multi-objective bayesian optimization,” Advances in Neural Information Processing Systems , vol. 33, pp. 9851–9864, 2020
2020
Earlier work this paper cites.
K. Shang and H. Ishibuchi, “A new hypervolume-based evolutionary algorithm for many-objective optimization,” IEEE Transactions on Evolutionary Computation , vol. 24, no. 5, pp. 839–852, 2020
2020
Earlier work this paper cites.
M. Balandat, B. Karrer, D. Jiang, S. Daulton, B. Letham, A. G. Wilson, and E. Bakshy, “Botorch: A framework for efficient monte-carlo bayesian optimization,” Advances in neural information processing systems , vol. 33, pp. 21 524–21 538, 2020
2020
Earlier work this paper cites.
D. Hendrycks, C. Burns, S. Basart, A. Zou, M. Mazeika, D. Song, and J. Steinhardt, “Measuring massive multitask language understanding,” arXiv preprint arXiv:2009.03300 , 2020
Original
2020
Earlier work this paper cites.
K. Cobbe, V. Kosaraju, M. Bavarian, M. Chen, H. Jun, L. Kaiser, M. Plappert, J. Tworek, J. Hilton, R. Nakano, C. Hesse, and J. Schulman, “Training verifiers to solve math word problems,” arXiv preprint arXiv:2110.14168 , 2021
Original
2021
Earlier work this paper cites.
M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. de Oliveira Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, A. Paino, N. Tezak, J. Tang, I. Babuschkin, S. Balaji, S. Jain, W. Saunders, C. Hesse, A. N. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, and W. Zaremba, “Evaluating large language models trained on code,” 2021
2021
Earlier work this paper cites.
J. Austin, A. Odena, M. Nye, M. Bosma, H. Michalewski, D. Dohan, E. Jiang, C. Cai, M. Terry, Q. Le et al. , “Program synthesis with large language models,” arXiv preprint arXiv:2108.07732 , 2021
Original
2021
Earlier work this paper cites.
K. Sakaguchi, R. L. Bras, C. Bhagavatula, and Y. Choi, “Winogrande: An adversarial winograd schema challenge at scale,” Communications of the ACM , vol. 64, no. 9, pp. 99–106, 2021
2021
Earlier work this paper cites.

Similar

S. Daulton, M. Balandat, and E. Bakshy, “Parallel bayesian optimization of multiple noisy objectives with expected hypervolume improvement,” Advances in Neural Information Processing Systems , vol. 34, pp. 2187–2200, 2021
2021
Cited alongside, same era.
M. Wortsman, G. Ilharco, S. Y. Gadre, R. Roelofs, R. Gontijo-Lopes, A. S. Morcos, H. Namkoong, A. Farhadi, Y. Carmon, S. Kornblith et al. , “Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time,” in International conference on machine learning . PMLR, 2022, pp. 23 965–23 998
2022
Cited alongside, same era.
G. Ilharco, M. T. Ribeiro, M. Wortsman, S. Gururangan, L. Schmidt, H. Hajishirzi, and A. Farhadi, “Editing models with task arithmetic,” arXiv preprint arXiv:2212.04089 , 2022
Original
2022
Cited alongside, same era.
M. S. Matena and C. A. Raffel, “Merging models with fisher-weighted averaging,” Advances in Neural Information Processing Systems , vol. 35, pp. 17 703–17 716, 2022

Then

M. Davari and E. Belilovsky, “Model breadcrumbs: Scaling multi-task model merging with sparse masks,” arXiv preprint arXiv:2312.06795 , 2023
Original
2023
Later among the works it cites.
O. Contributors, “Opencompass: A universal evaluation platform for foundation models,” https://github.com/open-compass/opencompass
2023
Later among the works it cites.
W. Wang, Z. Chen, X. Chen, J. Wu, X. Zhu, G. Zeng, P. Luo, T. Lu, J. Zhou, Y. Qiao et al. , “Visionllm: Large language model is also an open-ended decoder for vision-centric tasks,” Advances in Neural Information Processing Systems , vol. 36, 2024
2024
Closest in time.
L. Dou, Q. Liu, G. Zeng, J. Guo, J. Zhou, W. Lu, and M. Lin, “Sailor: Open language models for south-east asia,” arXiv preprint arXiv:2404.03608 , 2024
Original
2024
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…