Deep Insights into Automated Optimization with Large Language Models and Evolutionary Algorithms

J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proceedings of International Conference on Neural Networks, Vol. 4, 1995, pp. 1942–1948

1948

Earlier work this paper cites.

G. A. Croes, A method for solving traveling salesman problems, Operations Research 6 (6) (1958) 791–812

1958

Earlier work this paper cites.

J. H. Holland, Adaptation in Natural and Artificial Systems, MIT Press, Cambridge, MA, 1975

1975

Earlier work this paper cites.

S. Kirkpatrick, C. D. Gelatt, M. P. Vecchi, Optimization by simulated annealing, Science 220 (1983) 671–680

1983

Earlier work this paper cites.

M. Mitchell, S. Forrest, J. H. Holland, The royal road for genetic algorithms: fitness landscapes and GA performance, in: Proceedings of the 1st European Conference on Artificial Life, 1992, pp. 245–254

1992

Earlier work this paper cites.

W. M. Spears, Crossover or mutation?, Foundations of Genetic Algorithms 2 (1995) 221–237

1995

Earlier work this paper cites.

T. Jones, S. Forrest, Fitness distance correlation as a measure of problem difficulty for genetic algorithms, in: Proceedings of the 6th International Conference on Genetic Algorithms, 1995, pp. 184–192

1995

Earlier work this paper cites.

M. Dorigo, V. Maniezzo, A. Colorni, Ant system: optimization by a colony of cooperating agents, IEEE Transactions on Systems, Man, and Cybernetics, Part B 26 (1) (1996) 29–41

1996

Earlier work this paper cites.

S. Hochreiter, J. Schmidhuber, Long short-term memory, Neural Computation 9 (8) (1997) 1735–1780

1997

Earlier work this paper cites.

K. Deb, Representation, selection, and variation in genetic algorithms, Genetic Algorithms in Engineering and Computer Science (1997) 78–98

1997

Earlier work this paper cites.

W. E. Hart, N. Krasnogor, Using multiple representations in evolutionary algorithms, in: Proceedings of the Genetic and Evolutionary Computation Conference, 1998, pp. 359–366

1998

Earlier work this paper cites.

C. Voudouris, E. Tsang, Guided local search, in: Handbook of Metaheuristics, 1999, pp. 185–218

1999

Earlier work this paper cites.

F. Glover, G. Gutin, A. Yeo, A. Zverovich, Construction heuristics for the asymmetric TSP, European Journal of Operational Research 129 (3) (2001) 555–568

2001

Earlier work this paper cites.

P. M. Pardalos, M. G. Resende (Eds.), Handbook of Metaheuristics, Springer, Boston, MA, 2003

2003

Earlier work this paper cites.

E. Aarts, J. K. Lenstra, Local Search in Combinatorial Optimization, Princeton University Press, 2003

2003

Earlier work this paper cites.

K. A. De Jong, Evolutionary Computation: A Unified Approach, MIT Press, Cambridge, MA, 2006

2006

Earlier work this paper cites.

J. Dean, S. Ghemawat, MapReduce: simplified data processing on large clusters, Communications of the ACM 51 (1) (2008) 107–113

2008

Earlier work this paper cites.

C. A. Floudas, P. M. Pardalos (Eds.), Encyclopedia of Optimization, 2nd Edition, Springer, New York, NY, 2009

2009

Earlier work this paper cites.

E. K. Burke, M. R. Hyde, G. Kendall, G. Ochoa, E. Ozcan, J. R. Woodward, A comprehensive analysis of hyper-heuristics, Journal of the Operational Research Society 61 (2010) 1697–1724

2010

Earlier work this paper cites.

Y. S. Ong, M. H. Lim, X. S. Chen, Research frontier: memetic computation-past, present & future, IEEE Computational Intelligence Magazine 5 (2) (2010) 24–36

2010

Earlier work this paper cites.

E. K. Burke, M. Gendreau, M. Hyde, G. Kendall, G. Ochoa, R. Qu, Hyper-heuristics: a survey of the state of the art, Journal of the Operational Research Society 64 (12) (2013) 1695–1724

2013

Earlier work this paper cites.

M. Zhou, J. Liu, A memetic algorithm for enhancing the robustness of scale-free networks against malicious attacks, Physica A: Statistical Mechanics and its Applications 410 (2014) 131–143

2014

Earlier work this paper cites.

S. Han, J. Pool, J. Tran, W. Dally, Deep compression: compressing deep neural networks with pruning, trained quantization and huffman coding, arXiv:1510.00149 (2015)

Original

2015

Earlier work this paper cites.

G. Hinton, O. Vinyals, J. Dean, Distilling the knowledge in a neural network, in: Proceedings of the NIPS Deep Learning and Representation Learning Workshop, 2015

2015

Earlier work this paper cites.

A. Alsheddy, C. Voudouris, E. P. K. Tsang, A. Alhindi, Guided local search, in: R. M. et al. (Ed.), Handbook of Heuristics, 2016

2016

Earlier work this paper cites.

M. T. Ribeiro, S. Singh, C. Guestrin, Why should I trust you? Explaining the predictions of any classifier, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 1135–1144

2016

Earlier work this paper cites.

M. T. Ribeiro, S. Singh, C. Guestrin, Lime: local interpretable model-agnostic explanations, in: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016, pp. 1135–1144

2016

Earlier work this paper cites.

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, I. Polosukhin, Attention is all you need, in: Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Vol. 30, 2017

2017

Earlier work this paper cites.

M. Zhou, J. Liu, A two-phase multi-objective evolutionary algorithm for enhancing the robustness of scale-free networks against multiple malicious attacks, IEEE Transactions on Cybernetics 47 (2) (2017) 539–552

2017

Earlier work this paper cites.

W. Samek, T. Wiegand, K.-R. Müller, Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models, arXiv:1708.08296 (2017)

Original

2017

Earlier work this paper cites.

J. Devlin, M.-W. Chang, K. Lee, K. Toutanova, BERT: pre-training of deep bidirectional transformers for language understanding, in: Proceedings of the 2019 Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2019, pp. 4171–4186

2019

Earlier work this paper cites.

F. Arnold, K. Sörensen, Knowledge-guided local search for the vehicle routing problem, Computers and Operations Research 105 (2019) 32–46

2019

Earlier work this paper cites.

J. W. Rae, A. Potapenko, S. M. Jayakumar, T. P. Lillicrap, Compressive transformers for long-range sequence modeling, in: Proceedings of the 32th International Conference on Neural Information Processing Systems, 2019, pp. 4694–4707

2019

Earlier work this paper cites.

T. B. Brown, B. Mann, N. Ryder, M. Subbiah, J. Kaplan, et al., Language models are few-shot learners, arXiv:2005.14165 (2020)

Original

2020

Earlier work this paper cites.

P. Lewis, E. Perez, A. Piktus, F. Petroni, V. Karpukhin, N. Goyal, H. Küttler, M. Lewis, W. tau Yih, T. Rocktäschel, S. Riedel, D. Kiela, Retrieval-augmented generation for knowledge-intensive NLP tasks, in: Proceedings of the 33th International Conference on Neural Information Processing Systems, 2020, pp. 9459–9474

2020

Earlier work this paper cites.

K. Guu, K. Lee, Z. Tung, P. Pasupat, M.-W. Chang, REALM: retrieval-augmented language model pre-training, in: Proceedings of the 37th International Conference on Machine Learning, 2020, pp. 3929–3938

2020

Cited alongside, same era.

M. Burtsev, A. V. Kurenkov, Memorizing transformers, arXiv:2010.06891 (2020)

Original

2020

Cited alongside, same era.

G. Izacard, E. Grave, Fusion-in-Decoder: a novel retrieval-augmented language model, in: Proceedings of the 2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics, 2021, pp. 681–688

2021

Cited alongside, same era.

Y. Tang, Y. Tian, R. Huang, Distributed learning with evolutionary algorithms, in: Proceedings of the Genetic and Evolutionary Computation Conference (GECCO), 2021, pp. 851–859

2021

Cited alongside, same era.

X. Song, Y. Tian, R. T. Lange, C. Lee, Y. Tang, Y. Chen, Leverage foundation models for black-box optimization, in: Proceedings of the 41st International Conference on Machine Learning, Vol. 235 of PMLR, Vienna, Austria, 2024

2024

Closest in time.

F. Jin, Y. Liu, Y. Tan, Zero-shot chain-of-thought reasoning guided by evolutionary algorithms in large language models, arXiv:2402.05376v1 (2024)

Original

2024

Closest in time.

P.-F. Guo, Y.-H. Chen, Y.-D. Tsai, S.-D. Lin, Towards optimizing with large language model, in: Workshop on Knowledge-Infused Learning Co-located with 30th ACM KDD Conference, Barcelona, Spain, 2024

2024

Closest in time.

J. Mao, D. Zou, L. Sheng, S. Liu, C. Gao, Y. Wang, Y. Li, Identify critical nodes in complex network with large language models, arXiv:2403.03962 (2024)

Original

2024

Closest in time.