Neuron Patching: Semantic-based Neuron-level Language Model Repair for Code Generation

K. Papineni, S. Roukos, T. Ward, and W.-J. Zhu, “Bleu: a method for automatic evaluation of machine translation,” in Annual Meeting of the Association for Computational Linguistics , 2002

2002

Earlier work this paper cites.

C.-Y. Lin, “Rouge: A package for automatic evaluation of summaries,” in Annual Meeting of the Association for Computational Linguistics , 2004

2004

Earlier work this paper cites.

J. Kirkpatrick, R. Pascanu, N. C. Rabinowitz, J. Veness, G. Desjardins, A. A. Rusu, K. Milan, J. Quan, T. Ramalho, A. Grabska-Barwinska, D. Hassabis, C. Clopath, D. Kumaran, and R. Hadsell, “Overcoming catastrophic forgetting in neural networks,” Proceedings of the National Academy of Sciences , vol. 114, pp. 3521 – 3526, 2016. [Online]. Available: https://api.semanticscholar.org/CorpusID:4704285

2016

Earlier work this paper cites.

A. Vaswani, N. M. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, L. Kaiser, and I. Polosukhin, “Attention is all you need,” ArXiv , vol. abs/1706.03762, 2017

Original

2017

Earlier work this paper cites.

M. Ancona, E. Ceolini, A. C. Öztireli, and M. H. Gross, “A unified view of gradient-based attribution methods for deep neural networks,” ArXiv , vol. abs/1711.06104, 2017

Original

2017

Earlier work this paper cites.

K. Dhamdhere, M. Sundararajan, and Q. Yan, “How important is a neuron?” ArXiv , vol. abs/1805.12233, 2018. [Online]. Available: https://api.semanticscholar.org/CorpusID:44167055

Original

2018

Earlier work this paper cites.

P. Yin, B. Deng, E. Chen, B. Vasilescu, and G. Neubig, “Learning to mine aligned code and natural language pairs from stack overflow,” 2018 IEEE/ACM 15th International Conference on Mining Software Repositories (MSR) , pp. 476–486, 2018

2018

Earlier work this paper cites.

M. E. Peters, S. Ruder, and N. A. Smith, “To tune or not to tune? adapting pretrained representations to diverse tasks,” ArXiv , vol. abs/1903.05987, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:76666127

Original

2019

Earlier work this paper cites.

A. Chattopadhyay, P. Manupriya, A. Sarkar, and V. N. Balasubramanian, “Neural network attributions: A causal perspective,” in International Conference on Machine Learning , 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:59606233

2019

Earlier work this paper cites.

J. Sohn, S. Kang, and S. Yoo, “Arachne: Search-based repair of deep neural networks,” ACM Transactions on Software Engineering and Methodology , vol. 32, pp. 1 – 26, 2019. [Online]. Available: https://api.semanticscholar.org/CorpusID:251623079

2019

Earlier work this paper cites.

T. H. M. Le, H. Chen, and M. A. Babar, “Deep learning for source code modeling and generation,” ACM Computing Surveys (CSUR) , vol. 53, pp. 1 – 38, 2020

2020

Earlier work this paper cites.

M. Geva, R. Schuster, J. Berant, and O. Levy, “Transformer feed-forward layers are key-value memories,” ArXiv , vol. abs/2012.14913, 2020

Original

2020

Earlier work this paper cites.

T. Gao, A. Fisch, and D. Chen, “Making pre-trained language models better few-shot learners,” ArXiv , vol. abs/2012.15723, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:229923710

Original

2021

Earlier work this paper cites.

R. Tufano, L. Pascarella, M. Tufano, D. Poshyvanyk, and G. Bavota, “Towards automating code review activities,” 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) , pp. 163–174, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:230799433

2021

Earlier work this paper cites.

M. Chen, J. Tworek, H. Jun, Q. Yuan, H. Ponde, J. Kaplan, H. Edwards, Y. Burda, N. Joseph, G. Brockman, A. Ray, R. Puri, G. Krueger, M. Petrov, H. Khlaaf, G. Sastry, P. Mishkin, B. Chan, S. Gray, N. Ryder, M. Pavlov, A. Power, L. Kaiser, M. Bavarian, C. Winter, P. Tillet, F. P. Such, D. W. Cummings, M. Plappert, F. Chantzis, E. Barnes, A. Herbert-Voss, W. H. Guss, A. Nichol, I. Babuschkin, S. A. Balaji, S. Jain, A. Carr, J. Leike, J. Achiam, V. Misra, E. Morikawa, A. Radford, M. M. Knight, M. Brundage, M. Murati, K. Mayer, P. Welinder, B. McGrew, D. Amodei, S. McCandlish, I. Sutskever, and W. Zaremba, “Evaluating large language models trained on code,” ArXiv , vol. abs/2107.03374, 2021

Original

2021

Earlier work this paper cites.

J. E. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, and W. Chen, “Lora: Low-rank adaptation of large language models,” ArXiv , vol. abs/2106.09685, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:235458009

Original

2021

Earlier work this paper cites.

N. Dziri, A. Madotto, O. Zaiane, and A. Bose, “Neural path hunter: Reducing hallucination in dialogue systems via path grounding,” ArXiv , vol. abs/2104.08455, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:233296059

Original

2021

Earlier work this paper cites.

J. He, C. Zhou, X. Ma, T. Berg-Kirkpatrick, and G. Neubig, “Towards a unified view of parameter-efficient transfer learning,” ArXiv , vol. abs/2110.04366, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:238583580

Original

2021

Earlier work this paper cites.

X. Cai, J. Huang, Y.-L. Bian, and K. W. Church, “Isotropy in the contextual embedding space: Clusters and manifolds,” in International Conference on Learning Representations , 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:235614342

2021

Earlier work this paper cites.

Y. Zhou, S. Booth, M. T. Ribeiro, and J. A. Shah, “Do feature attribution methods correctly attribute features?” ArXiv , vol. abs/2104.14403, 2021

Original

2021

Cited alongside, same era.

D. Dai, L. Dong, Y. Hao, Z. Sui, and F. Wei, “Knowledge neurons in pretrained transformers,” ArXiv , vol. abs/2104.08696, 2021

Original

2021

Cited alongside, same era.

P. Liguori, E. Al-Hossami, D. Cotroneo, R. Natella, B. Cukic, and S. Shaikh, “Can we generate shellcodes via natural language? an empirical study,” Automated Software Engineering , vol. 29, 2021. [Online]. Available: https://api.semanticscholar.org/CorpusID:233407761

2021

Cited alongside, same era.

E. Mitchell, C. Lin, A. Bosselut, C. Finn, and C. D. Manning, “Fast model editing at scale,” ArXiv , vol. abs/2110.11309, 2021

Original

2021

Cited alongside, same era.

C. Xia, Y. Wei, and L. Zhang, “Automated program repair in the era of large pre-trained language models,” 2023 IEEE/ACM 45th International Conference on Software Engineering (ICSE) , pp. 1482–1494, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:259860439

2023

Closest in time.

D. Jayasuriya, V. Terragni, J. Dietrich, S. Ou, and K. Blincoe, “Understanding breaking changes in the wild,” Proceedings of the 32nd ACM SIGSOFT International Symposium on Software Testing and Analysis , 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:259844850

2023

Closest in time.

Y. Yao, P. Wang, B. Tian, S. Cheng, Z. Li, S. Deng, H. Chen, and N. Zhang, “Editing large language models: Problems, methods, and opportunities,” ArXiv , vol. abs/2305.13172, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:258833129

Original

2023

Closest in time.

H. Deng, N. Zou, M. Du, W. Chen, G.-C. Feng, Z. Yang, Z. Li, and Q. Zhang, “Understanding and unifying fourteen attribution methods with taylor interactions,” ArXiv , vol. abs/2303.01506, 2023. [Online]. Available: https://api.semanticscholar.org/CorpusID:257353582