A Large-Scale Evaluation for Log Parsing Techniques: How Far Are We?

Uniparser: A unified log parser for heterogeneous log data. In Proceedings of the ACM Web Conference 2022 (WWW) . 1893–1901

Yudong Liu, Xu Zhang, Shilin He, Hongyu Zhang, Liqun Li, Yu Kang, Yong Xu, Minghua Ma, Qingwei Lin, Yingnong Dang, et al · 1901

Earlier work this paper cites.

Testing using log file analysis: tools, methods, and issues. In Proceedings 13th IEEE International Conference on Automated Software Engineering (Cat. No. 98EX239) . IEEE, 157–166

James H Andrews. 1998 · 1998

Earlier work this paper cites.

A data clustering algorithm for mining patterns from event logs. In Proceedings of the 3rd IEEE Workshop on IP Operations & Management (IPOM)(IEEE Cat. No. 03EX764) . Ieee, 119–126

Risto Vaarandi. 2003 · 2003

Earlier work this paper cites.

Abstracting execution logs to execution events for enterprise applications (short paper). In 2008 The Eighth International Conference on Quality Software . IEEE, 181–186

Zhen Ming Jiang, Ahmed E Hassan, Parminder Flora, and Gilbert Hamann. 2008 · 2008

Earlier work this paper cites.

Execution anomaly detection in distributed systems through unstructured log analysis. In 2009 ninth IEEE international conference on data mining (ICDM) . IEEE, 149–158

Qiang Fu, Jian-Guang Lou, Yi Wang, and Jiang Li. 2009 · 2009

Earlier work this paper cites.

Clustering event logs using iterative partitioning. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining (KDD) . 1255–1264

Adetokunbo AO Makanju, A Nur Zincir-Heywood, and Evangelos E Milios. 2009 · 2009

Earlier work this paper cites.

Efficiently extracting operational profiles from execution logs using suffix arrays. In 2009 20th International Symposium on Software Reliability Engineering . IEEE, 41–50

Meiyappan Nagappan, Kesheng Wu, and Mladen A Vouk. 2009 · 2009

Earlier work this paper cites.

Abstracting log lines to log event types for mining software system logs. In 2010 7th IEEE Working Conference on Mining Software Repositories (MSR) . IEEE, 114–117

Meiyappan Nagappan and Mladen A Vouk. 2010 · 2010

Earlier work this paper cites.

Sherlog: error diagnosis by connecting clues from run-time logs. In Proceedings of the fifteenth International Conference on Architectural support for programming languages and operating systems . 143–154

Ding Yuan, Haohui Mai, Weiwei Xiong, Lin Tan, Yuanyuan Zhou, and Shankar Pasupathy. 2010 · 2010

Earlier work this paper cites.

LogSig: Generating system events from raw textual logs. In Proceedings of the 20th ACM international conference on Information and knowledge management (CIKM) . 785–794

Liang Tang, Tao Li, and Chang-Shing Perng. 2011 · 2011

Earlier work this paper cites.

Structured comparative analysis of systems logs to diagnose performance problems. In 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI 12) . 353–366

Karthik Nagaraj, Charles Killian, and Jennifer Neville. 2012 · 2012

Earlier work this paper cites.

Bridging the divide between software developers and operators using logs. In 2012 34th international conference on software engineering (ICSE) . IEEE, 1583–1586

Weiyi Shang. 2012 · 2012

Earlier work this paper cites.

Incremental mining of system log format. In 2013 IEEE International Conference on Services Computing . IEEE, 595–602

Masayoshi Mizutani. 2013 · 2013

Earlier work this paper cites.

Where do developers log? an empirical study on logging practices in industry. In Companion Proceedings of the 36th International Conference on Software Engineering . 24–33

Qiang Fu, Jieming Zhu, Wenlu Hu, Jian-Guang Lou, Rui Ding, Qingwei Lin, Dongmei Zhang, and Tao Xie. 2014 · 2014

Earlier work this paper cites.

Industry practices and event logging: Assessment of a critical software development process. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering (ICSE) , Vol. 2. IEEE, 169–178

Antonio Pecchia, Marcello Cinque, Gabriella Carrozza, and Domenico Cotroneo. 2015 · 2015

Earlier work this paper cites.

Logcluster-a data clustering and pattern mining algorithm for event logs. In 2015 11th International conference on network and service management (CNSM) . IEEE, 1–7

Risto Vaarandi and Mauno Pihelgas. 2015 · 2015

Earlier work this paper cites.

Spell: Streaming parsing of system event logs. In 2016 IEEE 16th International Conference on Data Mining (ICDM) . IEEE, 859–864

Min Du and Feifei Li. 2016 · 2016

Earlier work this paper cites.

Logmine: Fast pattern recognition for log analytics. In Proceedings of the 25th ACM International on Conference on Information and Knowledge Management (CIKM) . 1573–1582

Hossein Hamooni, Biplob Debnath, Jianwu Xu, Hui Zhang, Guofei Jiang, and Abdullah Mueen. 2016 · 2016

Earlier work this paper cites.

Length matters: Clustering system log messages using length of words

Original

Keiichi Shima. 2016 · 2016

Earlier work this paper cites.

Deeplog: Anomaly detection and diagnosis from system logs through deep learning. In Proceedings of the 2017 ACM SIGSAC conference on computer and communications security . 1285–1298

Min Du, Feifei Li, Guineng Zheng, and Vivek Srikumar. 2017 · 2017

Earlier work this paper cites.

Drain: An online log parsing approach with fixed depth tree. In 2017 IEEE international conference on web services (ICWS) . IEEE, 33–40

Pinjia He, Jieming Zhu, Zibin Zheng, and Michael R Lyu. 2017 · 2017

Earlier work this paper cites.

Logsed: Anomaly diagnosis through mining time-weighted control flow graph in logs. In 2017 IEEE 10th International Conference on Cloud Computing (CLOUD) . IEEE, 447–455

Tong Jia, Lin Yang, Pengfei Chen, Ying Li, Fanjing Meng, and Jingmin Xu. 2017 · 2017

Cited alongside, same era.

An automated approach to estimating code coverage measures via execution logs. In Proceedings of the 33rd ACM/IEEE International Conference on Automated Software Engineering . 305–316

Boyuan Chen, Jian Song, Peng Xu, Xing Hu, and Zhen Ming Jiang. 2018 · 2018

Cited alongside, same era.

{ \{ Kernel-Supported } \} { \{ Cost-Effective } \} Audit Logging for Causality Tracking. In 2018 USENIX Annual Technical Conference (USENIX ATC) . 241–254

Shiqing Ma, Juan Zhai, Yonghwi Kwon, Kyu Hyung Lee, Xiangyu Zhang, Gabriela Ciocarlie, Ashish Gehani, Vinod Yegneswaran, Dongyan Xu, and Somesh Jha. 2018 · 2018

Cited alongside, same era.

A search-based approach for accurate identification of log message formats. In Proceedings of the 26th Conference on Program Comprehension . 167–177

Salma Messaoudi, Annibale Panichella, Domenico Bianculli, Lionel Briand, and Raimondas Sasnauskas. 2018 · 2018

Cited alongside, same era.

Guidelines for assessing the accuracy of log message template identification techniques. In Proceedings of the 44th International Conference on Software Engineering (ICSE) . 1095–1106

Zanis Ali Khan, Donghwan Shin, Domenico Bianculli, and Lionel Briand. 2022 · 2022

Later among the works it cites.

Log-based anomaly detection with deep learning: How far are we?. In Proceedings of the 44th international conference on software engineering (ICSE) . 1356–1367

Van-Hoang Le and Hongyu Zhang. 2022 · 2022

Later among the works it cites.

SPINE: a scalable log parser with feedback guidance. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (FSE) . 1198–1208

Xuheng Wang, Xu Zhang, Liqun Li, Shilin He, Hongyu Zhang, Yudong Liu, Lingling Zheng, Yu Kang, Qingwei Lin, Yingnong Dang, et al · 2022

Later among the works it cites.

The replication repository of our evaluation artifacts

2023 · 2023

Closest in time.