Fetching the paper…

Reading the bibliography…

2023

PerfRL: A Small Language Model Framework for Efficient Code Optimization

Duan, Shukai, Kanakaris, Nikos, Xiao, Xiongye et al.

Original
PDF
Post on X

Understand

Code optimization is a challenging task requiring a substantial level of expertise from developers.

Nonetheless, this level of human capacity is not sufficient considering the rapid evolution of new hardware architectures and software environments.
In light of this, recent research proposes adopting machine learning and artificial intelligence techniques to automate the code optimization process.
In this paper, we introduce PerfRL, an innovative framework designed to tackle the problem of code optimization.

PerfRL: A Small Language Model Framework for Efficient Code Optimization · Around

Built on

R. Bunel, A. Desmaison, M. P. Kumar, P. H. S. Torr, and P. Kohli, “Learning to superoptimize programs,” CoRR , vol. abs/1611.01787, 2016. [Online]. Available: http://arxiv.org/abs/1611.01787
Original
2016
Earlier work this paper cites.
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” CoRR , vol. abs/1706.03762, 2017. [Online]. Available: http://arxiv.org/abs/1706.03762
Original
2017
Earlier work this paper cites.
J. Gottschlich, A. Solar-Lezama, N. Tatbul, M. Carbin, M. Rinard, R. Barzilay, S. Amarasinghe, J. B. Tenenbaum, and T. Mattson, “The three pillars of machine programming,” in Proceedings of the 2nd ACM SIGPLAN International Workshop on Machine Learning and Programming Languages , 2018, pp. 69–80
2018
Earlier work this paper cites.
——, “The three pillars of machine programming,” in Proceedings of the 2nd ACM SIGPLAN International Workshop on Machine Learning and Programming Languages , ser. MAPL 2018. New York, NY, USA: Association for Computing Machinery, 2018, p. 69–80. [Online]. Available: https://doi.org/10.1145/3211346.3211355
2018
Earlier work this paper cites.
H. Husain, H.-H. Wu, T. Gazit, M. Allamanis, and M. Brockschmidt, “CodeSearchNet challenge: Evaluating the state of semantic code search,” arXiv preprint arXiv:1909.09436 , 2019
Original
2019
Earlier work this paper cites.
C. Raffel, N. Shazeer, A. Roberts, K. Lee, S. Narang, M. Matena, Y. Zhou, W. Li, and P. J. Liu, “Exploring the limits of transfer learning with a unified text-to-text transformer,” Journal of Machine Learning Research , vol. 21, no. 140, pp. 1–67, 2020. [Online]. Available: http://jmlr.org/papers/v21/20-074.html
2020
Earlier work this paper cites.
N. Giarelis, N. Kanakaris, and N. Karacapilidis, “A comparative assessment of state-of-the-art methods for multilingual unsupervised keyphrase extraction,” in Artificial Intelligence Applications and Innovations , I. Maglogiannis, J. Macintyre, and L. Iliadis, Eds. Cham: Springer International Publishing, 2021, pp. 635–645
2021
Earlier work this paper cites.

Similar

Y. Wang, W. Wang, S. Joty, and S. C. Hoi, “CodeT5: Identifier-aware unified pre-trained encoder-decoder models for code understanding and generation,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing . Online and Punta Cana, Dominican Republic: Association for Computational Linguistics, Nov. 2021, pp. 8696–8708. [Online]. Available: https://aclanthology.org/2021.emnlp-main.685
2021
Cited alongside, same era.
S. Lu, D. Guo, S. Ren, J. Huang, A. Svyatkovskiy, A. Blanco, C. B. Clement, D. Drain, D. Jiang, D. Tang, G. Li, L. Zhou, L. Shou, L. Zhou, M. Tufano, M. Gong, M. Zhou, N. Duan, N. Sundaresan, S. K. Deng, S. Fu, and S. Liu, “Codexglue: A machine learning benchmark dataset for code understanding and generation,” CoRR , vol. abs/2102.04664, 2021
Original
2021
Cited alongside, same era.
M. Chen, J. Tworek, H. Jun, Q. Yuan, H. P. de Oliveira Pinto, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, A. Paino, N. Tezak, J. Tang, I. Babuschkin, S. Balaji, S. Jain, W. Saunders, C. Hesse, A. N. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, and W. Zaremba, “Evaluating large language models trained on code,” 2021

Then

P. Shojaee, A. Jain, S. Tipirneni, and C. K. Reddy, “Execution-based code generation using deep reinforcement learning,” 2023
2023
Closest in time.
E. Nijkamp, H. Hayashi, C. Xiong, S. Savarese, and Y. Zhou, “Codegen2: Lessons for training llms on programming and natural languages,” ICLR , 2023
2023
Closest in time.
A. Madaan, A. Shypula, U. Alon, M. Hashemi, P. Ranganathan, Y. Yang, G. Neubig, and A. Yazdanbakhsh, “Learning performance-improving code edits,” arXiv preprint arXiv:2302.07867 , 2023
Original
2023
Closest in time.
Z. Yuan, H. Yuan, C. Tan, W. Wang, S. Huang, and F. Huang, “Rrhf: Rank responses to align language models with human feedback without tears,” 2023
2023
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

2021

Cited alongside, same era.

R. Puri, D. Kung, G. Janssen, W. Zhang, G. Domeniconi, V. Zolotov, J. Dolby, J. Chen, M. Choudhury, L. Decker, V. Thost, L. Buratti, S. Pujar, S. Ramji, U. Finkler, S. Malaika, and F. Reiss, “Codenet: A large-scale ai for code dataset for learning a diversity of coding tasks,” 2021

2021

Cited alongside, same era.

H. Le, Y. Wang, A. D. Gotmare, S. Savarese, and S. Hoi, “CodeRL: Mastering code generation through pretrained models and deep reinforcement learning,” in Advances in Neural Information Processing Systems , A. H. Oh, A. Agarwal, D. Belgrave, and K. Cho, Eds., 2022. [Online]. Available: https://openreview.net/forum?id=WaGvb7OzySA

2022

Cited alongside, same era.

E. Nijkamp, B. Pang, H. Hayashi, L. Tu, H. Wang, Y. Zhou, S. Savarese, and C. Xiong, “Codegen: An open large language model for code with multi-turn program synthesis,” ICLR , 2023

2023

Cited alongside, same era.

S. Duan, H. Ping, N. Kanakaris, X. Xiao, P. Kyriakis, N. K. Ahmed, P. Zhang, G. Ma, M. Capotă, S. Nazarian, T. Willke, and P. Bogdan, “A structure-aware framework for learning device placements on computation graphs,” in Advances in Neural Information Processing Systems , A. Globerson, L. Mackey, D. Belgrave, A. Fan, U. Paquet, J. Tomczak, and C. Zhang, Eds., vol. 37. Curran Associates, Inc., 2024, pp. 81 748–81 772. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2024/file/94bd1b8c906494bada774096bd0fdd73-Paper-Conference.pdf

2024

Closest in time.

I. Siachos, N. Kanakaris, and N. Karacapilidis, “Software bug prediction using graph neural networks and graph-based text representations,” Expert Systems with Applications , vol. 259, p. 125290, 2025. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0957417424021572

2025

Closest in time.