Fetching the paper…
Reading the bibliography…
As Large Language Models (LLMs) show their capabilities across various applications, training customized LLMs has become essential for modern enterprises.
Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit
Jacob Cohen. 1968 · 1968
Earlier work this paper cites.
The three sigma rule
Friedrich Pukelsheim. 1994 · 1994
Earlier work this paper cites.
Dynamic time warping
Meinard Müller. 2007 · 2007
Earlier work this paper cites.
Isolation forest. In 2008 eighth ieee international conference on data mining . IEEE, 413–422
Fei Tony Liu, Kai Ming Ting, and Zhi-Hua Zhou. 2008 · 2008
Earlier work this paper cites.
Anomaly detection: A survey
Varun Chandola, Arindam Banerjee, and Vipin Kumar. 2009 · 2009
Earlier work this paper cites.
Mining invariants from console logs for system problem detection. In 2010 USENIX Annual Technical Conference (USENIX ATC 10)
Jian-Guang Lou, Qiang Fu, Shenqi Yang, Ye Xu, and Jiang Li. 2010 · 2010
Earlier work this paper cites.
Be conservative: Enhancing failure diagnosis with proactive logging. In 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI 12) . 293–306
Ding Yuan, Soyeon Park, Peng Huang, Yang Liu, Michael M Lee, Xiaoming Tang, Yuanyuan Zhou, and Stefan Savage. 2012 · 2012
Earlier work this paper cites.
A characteristic study on failures of production distributed data-parallel programs. In 2013 35th International Conference on Software Engineering (ICSE) . IEEE, 963–972
Sihan Li, Hucheng Zhou, Haoxiang Lin, Tian Xiao, Haibo Lin, Wei Lin, and Tao Xie. 2013 · 2013
Earlier work this paper cites.
Understanding GPU errors on large-scale HPC systems and the implications for system design and operation. In 2015 IEEE 21st International Symposium on High Performance Computer Architecture (HPCA) . IEEE, 331–342
Devesh Tiwari, Saurabh Gupta, James Rogers, Don Maxwell, Paolo Rech, Sudharshan Vazhkudai, Daniel Oliveira, Dave Londo, Nathan DeBardeleben, Philippe Navaux, et al · 2015
Earlier work this paper cites.
An empirical study on quality issues of production big data platform. In 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering , Vol. 2. IEEE, 17–26
Hucheng Zhou, Jian-Guang Lou, Hongyu Zhang, Haibo Lin, Haoxiang Lin, and Tingting Qin. 2015 · 2015
Earlier work this paper cites.
CNTK: Microsoft’s open-source deep-learning toolkit. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining . 2135–2135
Frank Seide and Amit Agarwal. 2016 · 2016
Earlier work this paper cites.
Drain: An online log parsing approach with fixed depth tree. In 2017 IEEE international conference on web services (ICWS) . IEEE, 33–40
Pinjia He, Jieming Zhu, Zibin Zheng, and Michael R Lyu. 2017 · 2017
Earlier work this paper cites.
Mining historical test logs to predict bugs and localize faults in the test logs. In 2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE) . IEEE, 140–151
Anunay Amar and Peter C Rigby. 2019 · 2019
Earlier work this paper cites.
Analysis of { \{ Large-Scale } \} { \{ Multi-Tenant } \} { \{ GPU } \} clusters for { \{ DNN } \} training workloads. In 2019 USENIX Annual Technical Conference (USENIX ATC 19) . 947–960
Myeongjae Jeon, Shivaram Venkataraman, Amar Phanishayee, Junjie Qian, Wencong Xiao, and Fan Yang. 2019 · 2019
Earlier work this paper cites.
What bugs cause production cloud incidents?. In Proceedings of the Workshop on Hot Topics in Operating Systems . 155–162
Haopeng Liu, Shan Lu, Madan Musuvathi, and Suman Nath. 2019 · 2019
Earlier work this paper cites.
Loganomaly: Unsupervised detection of sequential and quantitative anomalies in unstructured logs.. In IJCAI , Vol. 19. 4739–4745
Weibin Meng, Ying Liu, Yichen Zhu, Shenglin Zhang, Dan Pei, Yuqing Liu, Yihao Chen, Ruizhi Zhang, Shimin Tao, Pei Sun, et al · 2019
Earlier work this paper cites.
Megatron-lm: Training multi-billion parameter language models using model parallelism
Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. 2019 · 2019
Earlier work this paper cites.
Robust log-based anomaly detection on unstable log data. In Proceedings of the 2019 27th ACM joint meeting on European software engineering conference and symposium on the foundations of software engineering . 807–817
Xu Zhang, Yong Xu, Qingwei Lin, Bo Qiao, Hongyu Zhang, Yingnong Dang, Chunyu Xie, Xinsheng Yang, Qian Cheng, Ze Li, et al · 2019
Earlier work this paper cites.
Scaling laws for neural language models
Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. 2020 · 2020
Earlier work this paper cites.
SwissLog: Robust and Unified Deep Learning Based Log Anomaly Detection for Diverse Faults. In Proceedings of the31st International Symposium on Software Reliability Engineering . 92–103
Xiaoyun Li, Pengfei Chen, Linxiao Jing, Zilong He, and Guangba Yu. 2020 · 2020
Earlier work this paper cites.
Fast dimensional analysis for root cause investigation in a large-scale service environment
Fred Lin, Keyur Muzumdar, Nikolay Pavlovich Laptev, Mihai-Valentin Curelea, Seunghak Lee, and Sriram Sankar. 2020 · 2020
Earlier work this paper cites.
Spectrum-based log diagnosis. In Proceedings of the 14th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM) . 1–12
Carl Martin Rosenberg and Leon Moonen. 2020 · 2020
Earlier work this paper cites.
How are distributed bugs diagnosed and fixed through system logs?
Wei Yuan, Shan Lu, Hailong Sun, and Xudong Liu. 2020 · 2020
Earlier work this paper cites.
An empirical study on program failures of deep learning jobs. In Proceedings of the ACM/IEEE 42nd international conference on software engineering . 1159–1170
Ru Zhang, Wencong Xiao, Hongyu Zhang, Yu Liu, Haoxiang Lin, and Mao Yang. 2020 · 2020
Earlier work this paper cites.
NeuralLog: Natural language inference with joint neural and logical reasoning
Zeming Chen, Qiyue Gao, and Lawrence S Moss. 2021 · 2021
Earlier work this paper cites.
A survey on automated log analysis for reliability engineering
Shilin He, Pinjia He, Zhuangbin Chen, Tianyi Yang, Yuxin Su, and Michael R Lyu. 2021 · 2021
Earlier work this paper cites.
Ascend: a scalable and unified architecture for ubiquitous deep neural network computing: Industry track paper. In 2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA) . IEEE, 789–801
Heng Liao, Jiajin Tu, Jing Xia, Hu Liu, Xiping Zhou, Honghui Yuan, and Yuxing Hu. 2021 · 2021
Cited alongside, same era.
CheckFreq: Frequent, Fine-Grained DNN Checkpointing. In 19th USENIX Conference on File and Storage Technologies (FAST 21) . 203–216
Jayashree Mohan, Amar Phanishayee, and Vijay Chidambaram. 2021 · 2021
Cited alongside, same era.
Onion: identifying incident-indicating logs for cloud systems. In Proceedings of the 29th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering . 1253–1263
Xu Zhang, Yong Xu, Si Qin, Shilin He, Bo Qiao, Ze Li, Hongyu Zhang, Xukun Li, Yingnong Dang, Qingwei Lin, et al · 2021
Cited alongside, same era.
The Technology Behind BLOOM Training
2022 · 2022
Cited alongside, same era.
DeepSpeed
2024 · 2024
Later among the works it cites.
ECC failure
2024 · 2024
Later among the works it cites.
Failed to load checkpoint after write failure to S3 backend
2024 · 2024
Later among the works it cites.
Google Vertex AI
2024 · 2024
Later among the works it cites.
Invalid Ranktable Configuration
2024 · 2024
Later among the works it cites.
MindSpore LLM Platform
2024 · 2024
Later among the works it cites.
NPU network port Link failure
2024 · 2024
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Leveraging log instructions in log-based anomaly detection. In 2022 IEEE International Conference on Services Computing (SCC) . IEEE, 321–326
Jasmin Bogatinovski, Gjorgji Madjarov, Sasho Nedelkoski, Jorge Cardoso, and Odej Kao. 2022 · 2022
Cited alongside, same era.
{ \{ Check-N-Run } \} : A checkpointing system for training deep learning recommendation models. In 19th USENIX Symposium on Networked Systems Design and Implementation (NSDI 22) . 929–943
Assaf Eisenman, Kiran Kumar Matam, Steven Ingram, Dheevatsa Mudigere, Raghuraman Krishnamoorthi, Krishnakumar Nair, Misha Smelyanskiy, and Murali Annavaram. 2022 · 2022
Cited alongside, same era.
Perfsig: extracting performance bug signatures via multi-modality causal analysis. In Proceedings of the 44th International Conference on Software Engineering . 1669–1680
Jingzhu He, Yuhang Lin, Xiaohui Gu, Chin-Chia Michael Yeh, and Zhongfang Zhuang. 2022 · 2022
Cited alongside, same era.
Log-based anomaly detection with deep learning: How far are we?. In Proceedings of the 44th international conference on software engineering . 1356–1367
Van-Hoang Le and Hongyu Zhang. 2022 · 2022
Cited alongside, same era.
Characterizing and detecting bugs in WeChat mini-programs. In Proceedings of the 44th International Conference on Software Engineering . 363–375
Tao Wang, Qingxin Xu, Xiaoning Chang, Wensheng Dou, Jiaxin Zhu, Jinhui Xie, Yuetang Deng, Jianbo Yang, Jiaheng Yang, Jun Wei, et al · 2022
Cited alongside, same era.
Vicuna: An open-source chatbot impressing gpt-4 with 90%* chatgpt quality
Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E Gonzalez, et al · 2023
Cited alongside, same era.
What makes good in-context demonstrations for code intelligence tasks with llms?. In 2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE) . IEEE, 761–773
Shuzheng Gao, Xin-Cheng Wen, Cuiyun Gao, Wenxuan Wang, Hongyu Zhang, and Michael R Lyu. 2023b · 2023
Cited alongside, same era.
An Empirical Study on Quality Issues of Deep Learning Platform. In 2023 IEEE/ACM 45th International Conference on Software Engineering: Software Engineering in Practice (ICSE-SEIP) . IEEE, 455–466
Yanjie Gao, Xiaoxiang Shi, Haoxiang Lin, Hongyu Zhang, Hao Wu, Rui Li, and Mao Yang. 2023a · 2023
Cited alongside, same era.
2024 · 2024
Later among the works it cites.
Stream mode cannot be set in current driver version
2024 · 2024
Later among the works it cites.
Transformers
2024 · 2024
Later among the works it cites.
The wait execution of the Notify register times out
2024 · 2024
Later among the works it cites.
Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Abhishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, et al · 2024
Later among the works it cites.
DeepSeek-Coder: When the Large Language Model Meets Programming–The Rise of Code Intelligence
Daya Guo, Qihao Zhu, Dejian Yang, Zhenda Xie, Kai Dong, Wentao Zhang, Guanting Chen, Xiao Bi, Yu Wu, YK Li, et al · 2024
Later among the works it cites.
Just-In-Time Checkpointing: Low Cost Error Recovery from Deep Learning Training Failures. In Proceedings of the Nineteenth European Conference on Computer Systems . 1110–1125
Tanmaey Gupta, Sanjeev Krishnan, Rituraj Kumar, Abhishek Vijeev, Bhargav Gulavani, Nipun Kwatra, Ramachandran Ramjee, and Muthian Sivathanu. 2024 · 2024
Later among the works it cites.
Characterization of large language model development in the datacenter. In 21st USENIX Symposium on Networked Systems Design and Implementation (NSDI 24) . 709–729
Qinghao Hu, Zhisheng Ye, Zerui Wang, Guoteng Wang, Meng Zhang, Qiaoling Chen, Peng Sun, Dahua Lin, Xiaolin Wang, Yingwei Luo, et al · 2024
Later among the works it cites.
LUNAR: Unsupervised LLM-based Log Parsing
Junjie Huang, Zhihan Jiang, Zhuangbin Chen, and Michael R Lyu. 2024a · 2024
Later among the works it cites.
Demystifying and Extracting Fault-indicating Information from Logs for Failure Diagnosis. In 2024 IEEE 35th International Symposium on Software Reliability Engineering (ISSRE) . IEEE, 511–522
Junjie Huang, Zhihan Jiang, Jinyang Liu, Yintong Huo, Jiazhen Gu, Zhuangbin Chen, Cong Feng, Hui Dong, Zengyin Yang, and Michael R Lyu. 2024b · 2024
Later among the works it cites.
Lilac: Log parsing using llms with adaptive parsing cache
Zhihan Jiang, Jinyang Liu, Zhuangbin Chen, Yichen Li, Junjie Huang, Yintong Huo, Pinjia He, Jiazhen Gu, and Michael R Lyu. 2024b · 2024
Later among the works it cites.
Revisiting Reliability in Large-Scale Machine Learning Research Clusters
Apostolos Kokolis, Michael Kuchnik, John Hoffman, Adithya Kumar, Parth Malani, Faye Ma, Zachary DeVito, Shubho Sengupta, Kalyan Saladi, and Carole-Jean Wu. 2024 · 2024
Later among the works it cites.
Go Static: Contextualized Logging Statement Generation
Yichen Li, Yintong Huo, Renyi Zhong, Zhihan Jiang, Jinyang Liu, Junjie Huang, Jiazhen Gu, Pinjia He, and Michael R Lyu. 2024 · 2024
Later among the works it cites.
RedPajama: an Open Dataset for Training Large Language Models
Maurice Weber, Daniel Y. Fu, Quentin Anthony, Yonatan Oren, Shane Adams, Anton Alexandrov, Xiaozhong Lyu, Huu Nguyen, Xiaozhe Yao, Virginia Adams, Ben Athiwaratkun, Rahul Chalamala, Kezhen Chen, Max Ryabinin, Tri Dao, Percy Liang, Christopher Ré, Irina Rish, and Ce Zhang. 2024 · 2024
Later among the works it cites.
Harnessing the power of llms in practice: A survey on chatgpt and beyond
Jingfeng Yang, Hongye Jin, Ruixiang Tang, Xiaotian Han, Qizhang Feng, Haoming Jiang, Shaochen Zhong, Bing Yin, and Xia Hu. 2024 · 2024
Later among the works it cites.
A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems
Zihao Yi, Jiarui Ouyang, Yuwen Liu, Tianhao Liao, Zhe Xu, and Ying Shen. 2024 · 2024
Later among the works it cites.
A Survey on Failure Analysis and Fault Injection in AI Systems
Guangba Yu, Gou Tan, Haojia Huang, Zhenyu Zhang, Pengfei Chen, Roberto Natella, and Zibin Zheng. 2024 · 2024
Later among the works it cites.
HeMiRCA: Fine-Grained Root Cause Analysis for Microservices with Heterogeneous Data Sources
Zhouruixing Zhu, Cheryl Lee, Xiaoying Tang, and Pinjia He. 2024 · 2024
Later among the works it cites.
COCA: Generative Root Cause Analysis for Distributed Systems with Code Knowledge. In 2025 IEEE/ACM 47th International Conference on Software Engineering (ICSE) . IEEE Computer Society, 770–770
Yichen Li, Yulun Wu, Jinyang Liu, Zhihan Jiang, Zhuangbin Chen, Guangba Yu, and Michael Lyu. 2025 · 2025
Closest in time.