Log Parsing using LLMs with Self-Generated In-Context Learning and Self-Correction

Y. Liu, X. Zhang, S. He, H. Zhang, L. Li, Y. Kang, Y. Xu, M. Ma, Q. Lin, Y. Dang et al. , “Uniparser: A unified log parser for heterogeneous log data,” in Proceedings of the ACM Web Conference 2022 , 2022, pp. 1893–1901

1901

Earlier work this paper cites.

E. M. Boyd and A. W. Fales, “Reflective learning: Key to learning from experience,” Journal of humanistic psychology , vol. 23, no. 2, pp. 99–117, 1983

1983

Earlier work this paper cites.

R. Vaarandi, “A data clustering algorithm for mining patterns from event logs,” in Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM 2003)(IEEE Cat. No. 03EX764) . Ieee, 2003, pp. 119–126

2003

Earlier work this paper cites.

Z. M. Jiang, A. E. Hassan, P. Flora, and G. Hamann, “Abstracting execution logs to execution events for enterprise applications (short paper),” in 2008 The Eighth International Conference on Quality Software . IEEE, 2008, pp. 181–186

2008

Earlier work this paper cites.

Q. Fu, J.-G. Lou, Y. Wang, and J. Li, “Execution anomaly detection in distributed systems through unstructured log analysis,” in 2009 ninth IEEE international conference on data mining . IEEE, 2009, pp. 149–158

2009

Earlier work this paper cites.

A. A. Makanju, A. N. Zincir-Heywood, and E. E. Milios, “Clustering event logs using iterative partitioning,” in Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining , 2009, pp. 1255–1264

2009

Earlier work this paper cites.

M. Nagappan and M. A. Vouk, “Abstracting log lines to log event types for mining software system logs,” in 2010 7th IEEE Working Conference on Mining Software Repositories (MSR 2010) . IEEE, 2010, pp. 114–117

2010

Earlier work this paper cites.

W. Xu, System problem detection by mining console logs . University of California, Berkeley, 2010

2010

Earlier work this paper cites.

L. Tang, T. Li, and C.-S. Perng, “Logsig: Generating system events from raw textual logs,” in Proceedings of the 20th ACM international conference on Information and knowledge management , 2011, pp. 785–794

2011

Earlier work this paper cites.

A. Pecchia, M. Cinque, G. Carrozza, and D. Cotroneo, “Industry practices and event logging: Assessment of a critical software development process,” in 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering , vol. 2. IEEE, 2015, pp. 169–178

2015

Earlier work this paper cites.

R. Vaarandi and M. Pihelgas, “Logcluster-a data clustering and pattern mining algorithm for event logs,” in 2015 11th International conference on network and service management (CNSM) . IEEE, 2015, pp. 1–7

2015

Earlier work this paper cites.

K. Shima, “Length matters: Clustering system log messages using length of words,” arXiv preprint arXiv:1611.03213 , 2016

Original

2016

Earlier work this paper cites.

H. Hamooni, B. Debnath, J. Xu, H. Zhang, G. Jiang, and A. Mueen, “Logmine: Fast pattern recognition for log analytics,” in Proceedings of the 25th ACM international on conference on information and knowledge management , 2016, pp. 1573–1582

2016

Earlier work this paper cites.

M. Du and F. Li, “Spell: Streaming parsing of system event logs,” in 2016 IEEE 16th International Conference on Data Mining (ICDM) . IEEE, 2016, pp. 859–864

2016

Earlier work this paper cites.

M. Du, F. Li, G. Zheng, and V. Srikumar, “Deeplog: Anomaly detection and diagnosis from system logs through deep learning,” in Proceedings of the 2017 ACM SIGSAC conference on computer and communications security , 2017, pp. 1285–1298

2017

Earlier work this paper cites.

P. He, J. Zhu, Z. Zheng, and M. R. Lyu, “Drain: An online log parsing approach with fixed depth tree,” in 2017 IEEE international conference on web services (ICWS) . IEEE, 2017, pp. 33–40

2017

Earlier work this paper cites.

J. Metcalfe, “Learning from errors,” Annual review of psychology , vol. 68, pp. 465–489, 2017

2017

Earlier work this paper cites.

D. Schipper, M. Aniche, and A. van Deursen, “Tracing back log data to its log statement: from research to practice,” in 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR) . IEEE, 2019, pp. 545–549

2019

Earlier work this paper cites.

X. Zhang, Y. Xu, Q. Lin, B. Qiao, H. Zhang, Y. Dang, C. Xie, X. Yang, Q. Cheng, Z. Li et al. , “Robust log-based anomaly detection on unstable log data,” in Proceedings of the 2019 27th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering , 2019, pp. 807–817

2019

Earlier work this paper cites.

J. Zhu, S. He, J. Liu, P. He, Q. Xie, Z. Zheng, and M. R. Lyu, “Tools and benchmarks for automated log parsing,” in 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) . IEEE, 2019, pp. 121–130

2019

Earlier work this paper cites.

——, “Studying the use of java logging utilities in the wild,” in Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering , 2020, pp. 397–408

2020

Earlier work this paper cites.

H. Dai, H. Li, C.-S. Chen, W. Shang, and T.-H. Chen, “Logram: Efficient log parsing using n n n-gram dictionaries,” IEEE Transactions on Software Engineering , vol. 48, no. 3, pp. 879–892, 2020

2020

Earlier work this paper cites.

B. Chen and Z. M. Jiang, “A survey of software log instrumentation,” ACM Computing Surveys (CSUR) , vol. 54, no. 4, pp. 1–34, 2021

2021

Cited alongside, same era.

A. R. Chen, T.-H. Chen, and S. Wang, “Pathidea: Improving information retrieval-based bug localization by re-constructing execution paths using logs,” IEEE Transactions on Software Engineering , vol. 48, no. 8, pp. 2905–2919, 2021

2021

Cited alongside, same era.

T. Jia, Y. Wu, C. Hou, and Y. Li, “Logflash: Real-time streaming anomaly detection and diagnosis from system logs for large-scale software systems,” in 2021 IEEE 32nd International Symposium on Software Reliability Engineering (ISSRE) . IEEE, 2021, pp. 80–90

2021

Cited alongside, same era.

S. He, P. He, Z. Chen, T. Yang, Y. Su, and M. R. Lyu, “A survey on automated log analysis for reliability engineering,” ACM computing surveys (CSUR) , vol. 54, no. 6, pp. 1–37, 2021

2021

Cited alongside, same era.

J. Liu, J. Huang, Y. Huo, Z. Jiang, J. Gu, Z. Chen, C. Feng, M. Yan, and M. R. Lyu, “Scalable and adaptive log-based anomaly detection with expert in the loop,” arXiv preprint arXiv:2306.05032 , 2023

Original

2023

Later among the works it cites.

Y. Huo, C. Lee, Y. Su, S. Shan, J. Liu, and M. R. Lyu, “Evlog: Identifying anomalous logs over software evolution,” in 2023 IEEE 34th International Symposium on Software Reliability Engineering (ISSRE) . IEEE, 2023, pp. 391–402

2023

Later among the works it cites.

N. Nashid, M. Sintaha, and A. Mesbah, “Retrieval-based prompt selection for code-related few-shot learning,” in Proceedings of the 45th International Conference on Software Engineering (ICSE’23) , 2023

2023

Later among the works it cites.

S. Gao, X.-C. Wen, C. Gao, W. Wang, H. Zhang, and M. R. Lyu, “What makes good in-context demonstrations for code intelligence tasks with llms?” in 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE Computer Society, 2023, pp. 761–773