Exploring the True Potential: Evaluating the Black-box Optimization Capability of Large Language Models

I. Beltagy, K. Lo, and A. Cohan, “SciBERT: A Pretrained Language Model for Scientific Text,” Sep. 2019, arXiv:1903.10676 [cs]. [Online]. Available: http://arxiv.org/abs/1903.10676

Original

1903

Earlier work this paper cites.

C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu, “Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer,” Sep. 2023, arXiv:1910.10683 [cs, stat]. [Online]. Available: http://arxiv.org/abs/1910.10683

Original

1910

Earlier work this paper cites.

B. Gavish and S. C. Graves, “The travelling salesman problem and related problems,” 1978

1978

Earlier work this paper cites.

D. BHANDARI, C. A. MURTHY, and S. K. PAL, “GENETIC ALGORITHM WITH ELITIST MODEL AND ITS CONVERGENCE,” International Journal of Pattern Recognition and Artificial Intelligence , vol. 10, no. 06, pp. 731–747, 1996, _eprint: https://doi.org/10.1142/S0218001496000438. [Online]. Available: https://doi.org/10.1142/S0218001496000438

1996

Earlier work this paper cites.

D. Applegate and W. Cook, “Concorde tsp solver,” 2006. [Online]. Available: http://www.math.uwaterloo.ca/tsp/concorde/index.html

2006

Earlier work this paper cites.

S. Goyal, “A survey on travelling salesman problem,” in Midwest instruction and computing symposium , 2010, pp. 1–9

2010

Earlier work this paper cites.

M. Jamil and X.-S. Yang, “A literature survey of benchmark functions for global optimisation problems,” International Journal of Mathematical Modelling and Numerical Optimisation , vol. 4, no. 2, pp. 150–194, 2013

2013

Earlier work this paper cites.

P. Toth and D. Vigo, Vehicle routing: problems, methods, and applications . SIAM, 2014

2014

Earlier work this paper cites.

N. Hansen, D. V. Arnold, and A. Auger, “Evolution strategies,” Springer handbook of computational intelligence , pp. 871–898, 2015

2015

Earlier work this paper cites.

J. K. Pugh, L. B. Soros, and K. O. Stanley, “Quality diversity: A new frontier for evolutionary computation,” Frontiers in Robotics and AI , vol. 3, p. 202845, 2016

2016

Earlier work this paper cites.

A. Gupta, Y.-S. Ong, and L. Feng, “Multifactorial Evolution: Toward Evolutionary Multitasking,” IEEE Transactions on Evolutionary Computation , vol. 20, no. 3, pp. 343–357, Jun. 2016

2016

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, and K. N. Toutanova, “Bert: Pre-training of Deep Bidirectional Transformers for Language Understanding,” 2018. [Online]. Available: https://arxiv.org/abs/1810.04805

Original

2018

Earlier work this paper cites.

A. Holtzman, J. Buys, L. Du, M. Forbes, and Y. Choi, “The curious case of neural text degeneration,” in International Conference on Learning Representations , 2020. [Online]. Available: https://openreview.net/forum?id=rygGQyrFvH

2020

Earlier work this paper cites.

B. Min, H. Ross, E. Sulem, A. P. B. Veyseh, T. H. Nguyen, O. Sainz, E. Agirre, I. Heinz, and D. Roth, “Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey,” Nov. 2021, arXiv:2111.01243 [cs]. [Online]. Available: http://arxiv.org/abs/2111.01243

Original

2021

Earlier work this paper cites.

K. C. Tan, L. Feng, and M. Jiang, “Evolutionary Transfer Optimization - A New Frontier in Evolutionary Computation Research,” IEEE Computational Intelligence Magazine , vol. 16, no. 1, pp. 22–33, Feb. 2021

2021

Earlier work this paper cites.

M. N. Omidvar, X. Li, and X. Yao, “A review of population-based metaheuristics for large-scale black-box global optimization—part i,” IEEE Transactions on Evolutionary Computation , vol. 26, no. 5, pp. 802–822, 2022

2022

Earlier work this paper cites.

——, “A review of population-based metaheuristics for large-scale black-box global optimization—part ii,” IEEE Transactions on Evolutionary Computation , vol. 26, no. 5, pp. 823–843, 2022

2022

Earlier work this paper cites.

Z.-H. Zhan, L. Shi, K. C. Tan, and J. Zhang, “A survey on evolutionary computation for complex continuous optimization,” Artificial Intelligence Review , vol. 55, no. 1, pp. 59–110, Jan. 2022. [Online]. Available: https://doi.org/10.1007/s10462-021-10042-y

2022

Cited alongside, same era.

H. Xu, Y. Chen, Y. Du, N. Shao, W. Yanggang, H. Li, and Z. Yang, “Gps: Genetic Prompt Search for Efficient Few-Shot Learning,” in Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing , 2022, pp. 8162–8171

2022

Cited alongside, same era.

W. X. Zhao, K. Zhou, J. Li, T. Tang, X. Wang, Y. Hou, Y. Min, B. Zhang, J. Zhang, Z. Dong, Y. Du, C. Yang, Y. Chen, Z. Chen, J. Jiang, R. Ren, Y. Li, X. Tang, Z. Liu, P. Liu, J.-Y. Nie, and J.-R. Wen, “A Survey of Large Language Models,” Nov. 2023, arXiv:2303.18223 [cs]. [Online]. Available: http://arxiv.org/abs/2303.18223

Original

2023

Cited alongside, same era.

A. Blair-Stanek, N. Holzenberger, and B. Van Durme, “Can GPT-3 Perform Statutory Reasoning?” May 2023, arXiv:2302.06100 [cs]. [Online]. Available: http://arxiv.org/abs/2302.06100

G. Team, R. Anil, S. Borgeaud, Y. Wu, J.-B. Alayrac, J. Yu, R. Soricut, J. Schalkwyk, A. M. Dai, A. Hauth, K. Millican, D. Silver, S. Petrov, M. Johnson, I. Antonoglou, J. Schrittwieser, A. Glaese, J. Chen et al. , “Gemini: A Family of Highly Capable Multimodal Models,” Dec. 2023, arXiv:2312.11805 [cs]. [Online]. Available: http://arxiv.org/abs/2312.11805

Original

2023

Later among the works it cites.

J. Liang, X. Ban, K. Yu, B. Qu, K. Qiao, C. Yue, K. Chen, and K. C. Tan, “A Survey on Evolutionary Constrained Multiobjective Optimization,” IEEE Transactions on Evolutionary Computation , vol. 27, no. 2, pp. 201–221, 2023

2023

Later among the works it cites.

Q. Guo, R. Wang, J. Guo, B. Li, K. Song, X. Tan, G. Liu, J. Bian, and Y. Yang, “Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers,” Sep. 2023, arXiv:2309.08532 [cs]. [Online]. Available: http://arxiv.org/abs/2309.08532

Original

2023

Later among the works it cites.

C. Fernando, D. Banarse, H. Michalewski, S. Osindero, and T. Rocktäschel, “Promptbreeder: Self-referential self-improvement via prompt evolution,” arXiv preprint arXiv:2309.16797 , 2023

Original