2023

Log-based Anomaly Detection based on EVT Theory with feedback

Liu, Jinyang, Huang, Junjie, Huo, Yintong et al.

Understand

System logs play a critical role in maintaining the reliability of software systems.

Fruitful studies have explored automatic log-based anomaly detection and achieved notable accuracy on benchmark datasets.
However, when applied to large-scale cloud systems, these solutions face limitations due to high resource consumption and lack of adaptability to evolving logs.
In this paper, we present an accurate, lightweight, and adaptive log-based anomaly detection framework, referred to as SeaLog.

Built on

Catastrophic forgetting in connectionist networks
Robert M French. 1999 · 1999
Earlier work this paper cites.
Failure diagnosis using decision trees. In International Conference on Autonomic Computing, 2004. Proceedings. IEEE, 36–43
Mike Chen, Alice X Zheng, Jim Lloyd, Michael I Jordan, and Eric Brewer. 2004 · 2004
Earlier work this paper cites.
Failure prediction in ibm bluegene/l event logs. In Seventh IEEE International Conference on Data Mining (ICDM 2007) . IEEE, 583–588
Yinglung Liang, Yanyong Zhang, Hui Xiong, and Ramendra Sahoo. 2007 · 2007
Earlier work this paper cites.
What supercomputers say: A study of five system logs. In 37th annual IEEE/IFIP international conference on dependable systems and networks (DSN’07) . IEEE, 575–584
Adam Oliner and Jon Stearley. 2007 · 2007
Earlier work this paper cites.
Isolation forest. In 2008 eighth IEEE international conference on data mining . IEEE, 413–422
Fei Tony Liu, Kai Ming Ting, and Zhi-Hua Zhou. 2008 · 2008
Earlier work this paper cites.
Largescale system problem detection by mining console logs. In Proceedings of SOSP , Vol. 9. Citeseer, 1–17
Wei Xu, Ling Huang, Armando Fox, David Patterson, and Michael Jordan. 2009 · 2009
Earlier work this paper cites.
Fingerprinting the datacenter: automated classification of performance crises. In Proceedings of the 5th European conference on Computer systems . 111–124
Peter Bodik, Moises Goldszmidt, Armando Fox, Dawn B Woodard, and Hans Andersen. 2010 · 2010
Earlier work this paper cites.
Mining Invariants from Console Logs for System Problem Detection.. In USENIX annual technical conference . 1–14
Jian-Guang Lou, Qiang Fu, Shengqi Yang, Ye Xu, and Jiang Li. 2010 · 2010
Earlier work this paper cites.
System problem detection by mining console logs
Wei Xu. 2010 · 2010
Earlier work this paper cites.
Efficient estimation of word representations in vector space
Original
Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. 2013 · 2013
Earlier work this paper cites.
Distilling the knowledge in a neural network
Original
Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015 · 2015
Earlier work this paper cites.
Why does the cloud stop computing? lessons from hundreds of service outages. In Proceedings of the Seventh ACM Symposium on Cloud Computing (SOCC) . 1–16
Haryadi S Gunawi, Mingzhe Hao, Riza O Suminto, Agung Laksono, Anang D Satria, Jeffry Adityatama, and Kurnia J Eliazar. 2016 · 2016
Earlier work this paper cites.
Experience report: System log analysis for anomaly detection. In 2016 IEEE 27th international symposium on software reliability engineering (ISSRE) . IEEE, 207–218
Shilin He, Jieming Zhu, Pinjia He, and Michael R Lyu. 2016 · 2016
Earlier work this paper cites.

Similar

Log clustering based problem identification for online service systems. In Proceedings of the 38th International Conference on Software Engineering Companion . 102–111
Qingwei Lin, Hongyu Zhang, Jian-Guang Lou, Yu Zhang, and Xuewei Chen. 2016 · 2016
Cited alongside, same era.
Deeplog: Anomaly detection and diagnosis from system logs through deep learning. In Proceedings of the 2017 ACM SIGSAC conference on computer and communications security . 1285–1298
Min Du, Feifei Li, Guineng Zheng, and Vivek Srikumar. 2017 · 2017
Cited alongside, same era.
Drain: An online log parsing approach with fixed depth tree. In 2017 IEEE international conference on web services (ICWS) . IEEE, 33–40
Pinjia He, Jieming Zhu, Zibin Zheng, and Michael R Lyu. 2017 · 2017
Cited alongside, same era.
Anomaly detection in streams with extreme value theory. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining . 1067–1075
Alban Siffer, Pierre-Alain Fouque, Alexandre Termier, and Christine Largouet. 2017 · 2017
Cited alongside, same era.
Identifying impactful service system problems via log analysis. In Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 60–70
Shilin He, Qingwei Lin, Jian-Guang Lou, Hongyu Zhang, Michael R Lyu, and Dongmei Zhang. 2018 · 2018
Cited alongside, same era.
Detecting anomaly in big data system logs using convolutional neural network. In 2018 IEEE 16th Intl Conf on Dependable, Autonomic and Secure Computing, 16th Intl Conf on Pervasive Intelligence and Computing, 4th Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress (DASC/PiCom/DataCom/CyberSciTech) . IEEE, 151–158
Siyang Lu, Xiang Wei, Yandong Li, and Liqiang Wang. 2018 · 2018
Cited alongside, same era.
An empirical investigation of incident triage for online service systems. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) . IEEE, 111–120
Junjie Chen, Xiaoting He, Qingwei Lin, Yong Xu, Hongyu Zhang, Dan Hao, Feng Gao, Zhangwei Xu, Yingnong Dang, and Dongmei Zhang. 2019 · 2019
Cited alongside, same era.
Logzip: extracting hidden structures via iterative clustering for log compression. In 2019 34th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 863–873
Jinyang Liu, Jieming Zhu, Shilin He, Pinjia He, Zibin Zheng, and Michael R Lyu. 2019 · 2019
Cited alongside, same era.
LogAnomaly: Unsupervised detection of sequential and quantitative anomalies in unstructured logs.. In IJCAI , Vol. 19. 4739–4745
Weibin Meng, Ying Liu, Yichen Zhu, Shenglin Zhang, Dan Pei, Yuqing Liu, Yihao Chen, Ruizhi Zhang, Shimin Tao, Pei Sun, et al · 2019
Cited alongside, same era.
Automated reporting of anti-patterns and decay in continuous integration. In 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) . IEEE, 105–115
Carmine Vassallo, Sebastian Proksch, Harald C Gall, and Massimiliano Di Penta. 2019 · 2019
Cited alongside, same era.
Robust log-based anomaly detection on unstable log data. In Proceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 807–817
Xu Zhang, Yong Xu, Qingwei Lin, Bo Qiao, Hongyu Zhang, Yingnong Dang, Chunyu Xie, Xinsheng Yang, Qian Cheng, Ze Li, et al · 2019
Cited alongside, same era.
Tools and benchmarks for automated log parsing. In 2019 IEEE/ACM 41st International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) . IEEE, 121–130
Jieming Zhu, Shilin He, Jinyang Liu, Pinjia He, Qi Xie, Zibin Zheng, and Michael R Lyu. 2019 · 2019
Cited alongside, same era.

Then

Experience report: Deep learning-based system log analysis for anomaly detection
Original
Zhuangbin Chen, Jinyang Liu, Wenwei Gu, Yuxin Su, and Michael R Lyu. 2021 · 2021
Later among the works it cites.
Log-based anomaly detection without log parsing. In 2021 36th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 492–504
Van-Hoang Le and Hongyu Zhang. 2021 · 2021
Later among the works it cites.
Recent advances in natural language processing via large pre-trained language models: A survey
Original
Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen, Oscar Sainz, Eneko Agirre, Ilana Heinz, and Dan Roth. 2021 · 2021
Later among the works it cites.
Fast outage analysis of large-scale production clouds with service correlation mining. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) . IEEE, 885–896
Yaohui Wang, Guozheng Li, Zijian Wang, Yu Kang, Yangfan Zhou, Hongyu Zhang, Feng Gao, Jeffrey Sun, Li Yang, Pochian Lee, et al · 2021
Later among the works it cites.
Plelog: Semi-supervised log-based anomaly detection via probabilistic label estimation. In 2021 IEEE/ACM 43rd International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) . IEEE, 230–231
Lin Yang, Junjie Chen, Zan Wang, Weijing Wang, Jiajun Jiang, Xuyuan Dong, and Wenbin Zhang. 2021a · 2021
Later among the works it cites.
Semi-supervised log-based anomaly detection via probabilistic label estimation. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE) . IEEE, 1448–1460
Lin Yang, Junjie Chen, Zan Wang, Weijing Wang, Jiajun Jiang, Xuyuan Dong, and Wenbin Zhang. 2021b · 2021
Later among the works it cites.
How to fight production incidents? an empirical study on a large-scale cloud service. In Proceedings of the 13th Symposium on Cloud Computing . 126–141
Supriyo Ghosh, Manish Shetty, Chetan Bansal, and Suman Nath. 2022 · 2022
Later among the works it cites.
Log-based anomaly detection with deep learning: How far are we?. In Proceedings of the 44th International Conference on Software Engineering . 1356–1367
Van-Hoang Le and Hongyu Zhang. 2022 · 2022
Later among the works it cites.
Looking Beyond { \{ GPUs } \} for { \{ DNN } \} Scheduling on { \{ Multi-Tenant } \} Clusters. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22) . 579–596
Jayashree Mohan, Amar Phanishayee, Janardhan Kulkarni, and Vijay Chidambaram. 2022 · 2022
Later among the works it cites.
Introducing ChatGPT
OpenAI. 2022 · 2022
Later among the works it cites.
Memory Profiler
Fabian Pedregosa and Philippe Gervais. 2022 · 2022
Later among the works it cites.
SPINE: a scalable log parser with feedback guidance. In Proceedings of the 30th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 1198–1208
Xuheng Wang, Xu Zhang, Liqun Li, Shilin He, Hongyu Zhang, Yudong Liu, Lingling Zheng, Yu Kang, Qingwei Lin, Yingnong Dang, et al · 2022
Later among the works it cites.
MLaaS in the wild: Workload analysis and scheduling in Large-Scale heterogeneous GPU clusters. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22) . USENIX Association, 945–960
Qizhen Weng, Wencong Xiao, Yinghao Yu, Wei Wang, Cheng Wang, Jian He, Yong Li, Liping Zhang, Wei Lin, and Yu Ding. 2022 · 2022
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…