LILAC: Log Parsing using LLMs with Adaptive Parsing Cache

Language models are few-shot learners

Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al · 1901

Earlier work this paper cites.

Uniparser: A unified log parser for heterogeneous log data. In Proceedings of the ACM Web Conference 2022 (WWW) . 1893–1901

Yudong Liu, Xu Zhang, Shilin He, Hongyu Zhang, Liqun Li, Yu Kang, Yong Xu, Minghua Ma, Qingwei Lin, Yingnong Dang, et al · 1901

Earlier work this paper cites.

A data clustering algorithm for mining patterns from event logs. In Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM)(IEEE Cat. No. 03EX764) . Ieee, 119–126

Risto Vaarandi. 2003 · 2003

Earlier work this paper cites.

Abstracting execution logs to execution events for enterprise applications (short paper). In 2008 The Eighth International Conference on Quality Software . IEEE, 181–186

Zhen Ming Jiang, Ahmed E Hassan, Parminder Flora, and Gilbert Hamann. 2008 · 2008

Earlier work this paper cites.

Clustering event logs using iterative partitioning. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD) . 1255–1264

Adetokunbo AO Makanju, A Nur Zincir-Heywood, and Evangelos E Milios. 2009 · 2009

Earlier work this paper cites.

Largescale system problem detection by mining console logs

Wei Xu, Ling Huang, Armando Fox, David Patterson, and Michael Jordan. 2009 · 2009

Earlier work this paper cites.

Abstracting log lines to log event types for mining software system logs. In 2010 7th IEEE Working Conference on Mining Software Repositories (MSR) . IEEE, 114–117

Meiyappan Nagappan and Mladen A Vouk. 2010 · 2010

Earlier work this paper cites.

LogSig: Generating system events from raw textual logs. In Proceedings of the 20th ACM international conference on Information and knowledge management (CIKM) . 785–794

Liang Tang, Tao Li, and Chang-Shing Perng. 2011 · 2011

Earlier work this paper cites.

Incremental mining of system log format. In 2013 IEEE International Conference on Services Computing . IEEE, 595–602

Masayoshi Mizutani. 2013 · 2013

Earlier work this paper cites.

Industry practices and event logging: Assessment of a critical software development process. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering (ICSE) , Vol. 2. IEEE, 169–178

Antonio Pecchia, Marcello Cinque, Gabriella Carrozza, and Domenico Cotroneo. 2015 · 2015

Earlier work this paper cites.

Logcluster-a data clustering and pattern mining algorithm for event logs. In 2015 11th International conference on network and service management (CNSM) . IEEE, 1–7

Risto Vaarandi and Mauno Pihelgas. 2015 · 2015

Earlier work this paper cites.

Spell: Streaming parsing of system event logs. In 2016 IEEE 16th International Conference on Data Mining (ICDM) . IEEE, 859–864

Min Du and Feifei Li. 2016 · 2016

Earlier work this paper cites.

Logmine: Fast pattern recognition for log analytics. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (CIKM) . 1573–1582

Hossein Hamooni, Biplob Debnath, Jianwu Xu, Hui Zhang, Guofei Jiang, and Abdullah Mueen. 2016 · 2016

Earlier work this paper cites.

An evaluation study on log parsing and its use in log mining. In 2016 46th annual IEEE/IFIP international conference on dependable systems and networks (DSN) . IEEE, 654–661

Pinjia He, Jieming Zhu, Shilin He, Jian Li, and Michael R Lyu. 2016 · 2016

Earlier work this paper cites.

Length matters: Clustering system log messages using length of words

Original

Keiichi Shima. 2016 · 2016

Earlier work this paper cites.

Drain: An online log parsing approach with fixed depth tree. In 2017 IEEE international conference on web services (ICWS) . IEEE, 33–40

Pinjia He, Jieming Zhu, Zibin Zheng, and Michael R Lyu. 2017 · 2017

Earlier work this paper cites.

Interactive learning from policy-dependent human feedback. In International conference on machine learning . PMLR, 2285–2294

James MacGlashan, Mark K Ho, Robert Loftin, Bei Peng, Guan Wang, David L Roberts, Matthew E Taylor, and Michael L Littman. 2017 · 2017

Earlier work this paper cites.

Attention is all you need

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017 · 2017

Earlier work this paper cites.

A search-based approach for accurate identification of log message formats. In Proceedings of the 26th Conference on Program Comprehension . 167–177

Salma Messaoudi, Annibale Panichella, Domenico Bianculli, Lionel Briand, and Raimondas Sasnauskas. 2018 · 2018

Earlier work this paper cites.

Mining historical test logs to predict bugs and localize faults in the test logs. In 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) . IEEE, 140–151

Anunay Amar and Peter C Rigby. 2019 · 2019

Earlier work this paper cites.

Logzip: Extracting hidden structures via iterative clustering for log compression. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 863–873

Jinyang Liu, Jieming Zhu, Shilin He, Pinjia He, Zibin Zheng, and Michael R Lyu. 2019 · 2019

Earlier work this paper cites.

Tracing back log data to its log statement: from research to practice. In 2019 IEEE/ACM 16th International Conference on Mining Software Repositories (MSR) . IEEE, 545–549

Daan Schipper, Maurício Aniche, and Arie van Deursen. 2019 · 2019

Earlier work this paper cites.

Robust log-based anomaly detection on unstable log data. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE) . 807–817

Xu Zhang, Yong Xu, Qingwei Lin, Bo Qiao, Hongyu Zhang, Yingnong Dang, Chunyu Xie, Xinsheng Yang, Qian Cheng, Ze Li, et al · 2019

Earlier work this paper cites.

Tools and benchmarks for automated log parsing. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) . IEEE, 121–130

Jieming Zhu, Shilin He, Jinyang Liu, Pinjia He, Qi Xie, Zibin Zheng, and Michael R Lyu. 2019 · 2019

Cited alongside, same era.

Logram: Efficient Log Parsing Using n n n-Gram Dictionaries

Hetong Dai, Heng Li, Che-Shao Chen, Weiyi Shang, and Tse-Hsun Chen. 2020 · 2020

Cited alongside, same era.

Loghub: A large collection of system log datasets towards automated log analytics

Shilin He, Jieming Zhu, Pinjia He, and Michael R Lyu. 2020 · 2020

Cited alongside, same era.

Root-cause metric location for microservice systems via log anomaly detection. In 2020 IEEE international conference on web services (ICWS) . IEEE, 142–150

Lingzhi Wang, Nengwen Zhao, Junjie Chen, Pinnong Li, Wenchi Zhang, and Kaixin Sui. 2020 · 2020

Cited alongside, same era.

Pathidea: Improving information retrieval-based bug localization by re-constructing execution paths using logs

A Large-scale Benchmark for Log Parsing

Original

Zhihan Jiang, Jinyang Liu, Junjie Huang, Yichen Li, Yintong Huo, Jiazhen Gu, Zhuangbin Chen, Jieming Zhu, and Michael R Lyu. 2023 · 2023

Closest in time.

Log Parsing: How Far Can ChatGPT Go?

Original

Van-Hoang Le and Hongyu Zhang. 2023a · 2023

Closest in time.

Log Parsing with Prompt-based Few-shot Learning

Original

Van-Hoang Le and Hongyu Zhang. 2023b · 2023

Closest in time.

LogShrink: Effective Log Compression by Leveraging Commonality and Variability of Log Data

Original

Xiaoyun Li, Hongyu Zhang, Van-Hoang Le, and Pengfei Chen. 2023c · 2023

Closest in time.

Exploring the Effectiveness of LLMs in Automated Logging Generation: An Empirical Study