Fetching the paper…
Reading the bibliography…
In this work, we share our experience on tele-knowledge pre-training for fault analysis, a crucial task in telecommunication applications that requires a wide range of knowledge normally found in both machine log data and product documents.
H. Gong, Y. Sun, X. Feng, B. Qin, W. Bi, X. Liu, and T. Liu, “Tablegpt: Few-shot table-to-text generation with table structure reconstruction and content matching,” in COLING . International Committee on Computational Linguistics, 2020, pp. 1978–1988
1988
Earlier work this paper cites.
M. Schmidt, M. Meier, and G. Lausen, “Foundations of SPARQL query optimization,” in ICDT , ser. ACM International Conference Proceeding Series. ACM, 2010, pp. 4–33
2010
Earlier work this paper cites.
A. Bordes, N. Usunier, A. García-Durán, J. Weston, and O. Yakhnenko, “Translating embeddings for modeling multi-relational data,” in NIPS , 2013, pp. 2787–2795
2013
Earlier work this paper cites.
Z. Wang, J. Zhang, J. Feng, and Z. Chen, “Knowledge graph embedding by translating on hyperplanes,” in AAAI . AAAI Press, 2014, pp. 1112–1119
2014
Earlier work this paper cites.
R. Sennrich, B. Haddow, and A. Birch, “Neural machine translation of rare words with subword units,” in ACL (1) . The Association for Computer Linguistics, 2016
2016
Earlier work this paper cites.
H. Guo, R. Tang, Y. Ye, Z. Li, and X. He, “Deepfm: A factorization-machine based neural network for CTR prediction,” in IJCAI . ijcai.org, 2017, pp. 1725–1731
2017
Earlier work this paper cites.
A. Brock, T. Lim, J. M. Ritchie, and N. Weston, “Neural photo editing with introspective adversarial networks,” in ICLR (Poster) . OpenReview.net, 2017
2017
Earlier work this paper cites.
T. N. Kipf and M. Welling, “Semi-supervised classification with graph convolutional networks,” in ICLR (Poster) . OpenReview.net, 2017
2017
Earlier work this paper cites.
A. Radford, K. Narasimhan, T. Salimans, I. Sutskever et al. , “Improving language understanding by generative pre-training,” 2018
2018
Earlier work this paper cites.
A. Kendall, Y. Gal, and R. Cipolla, “Multi-task learning using uncertainty to weigh losses for scene geometry and semantics,” in CVPR . Computer Vision Foundation / IEEE Computer Society, 2018, pp. 7482–7491
2018
Earlier work this paper cites.
Z. Sun, Z. Deng, J. Nie, and J. Tang, “Rotate: Knowledge graph embedding by relational rotation in complex space,” in ICLR (Poster) . OpenReview.net, 2019
2019
Earlier work this paper cites.
J. Devlin, M. Chang, K. Lee, and K. Toutanova, “BERT: pre-training of deep bidirectional transformers for language understanding,” in NAACL-HLT (1) . Association for Computational Linguistics, 2019, pp. 4171–4186
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
W. Song, C. Shi, Z. Xiao, Z. Duan, Y. Xu, M. Zhang, and J. Tang, “Autoint: Automatic feature interaction learning via self-attentive neural networks,” in CIKM . ACM, 2019, pp. 1161–1170
2019
Earlier work this paper cites.
Z. Zhang, X. Han, Z. Liu, X. Jiang, M. Sun, and Q. Liu, “ERNIE: enhanced language representation with informative entities,” in ACL (1) . Association for Computational Linguistics, 2019, pp. 1441–1451
2019
Earlier work this paper cites.
2019
Earlier work this paper cites.
N. Kertkeidkachorn, X. Liu, and R. Ichise, “Gtranse: Generalizing translation-based model on uncertain knowledge graph embedding,” in JSAI , ser. Advances in Intelligent Systems and Computing, Y. Ohsawa, K. Yada, T. Ito, Y. Takama, E. Sato-Shimokawara, A. Abe, J. Mori, and N. Matsumura, Eds., vol. 1128. Springer, 2019, pp. 170–178
2019
Earlier work this paper cites.
B. D. Trisedya, J. Qi, and R. Zhang, “Entity alignment between knowledge graphs using attribute embeddings,” in AAAI . AAAI Press, 2019, pp. 297–304
2019
Cited alongside, same era.
Q. Zhang, Z. Sun, W. Hu, M. Chen, L. Guo, and Y. Qu, “Multi-view knowledge graph embedding for entity alignment,” in IJCAI . ijcai.org, 2019, pp. 5429–5435
2019
Cited alongside, same era.
P. Yin, G. Neubig, W. Yih, and S. Riedel, “Tabert: Pretraining for joint understanding of textual and tabular data,” in ACL . Association for Computational Linguistics, 2020, pp. 8413–8426
2020
Cited alongside, same era.
K. Clark, M. Luong, Q. V. Le, and C. D. Manning, “ELECTRA: pre-training text encoders as discriminators rather than generators,” in ICLR . OpenReview.net, 2020
2020
Cited alongside, same era.
Y. Sun, S. Wang, Y. Li, S. Feng, H. Tian, H. Wu, and H. Wang, “ERNIE 2.0: A continual pre-training framework for language understanding,” in AAAI . AAAI Press, 2020, pp. 8968–8975
Y. Cui, W. Che, T. Liu, B. Qin, and Z. Yang, “Pre-training with whole word masking for chinese BERT,” IEEE ACM Trans. Audio Speech Lang. Process. , vol. 29, pp. 3504–3514, 2021
2021
Later among the works it cites.
W. Che, Y. Feng, L. Qin, and T. Liu, “N-LTP: an open-source neural language technology platform for chinese,” in EMNLP (Demos) . Association for Computational Linguistics, 2021, pp. 42–49
2021
Later among the works it cites.
X. Wang, T. Gao, Z. Zhu, Z. Zhang, Z. Liu, J. Li, and J. Tang, “KEPLER: A unified model for knowledge embedding and pre-trained language representation,” Trans. Assoc. Comput. Linguistics , vol. 9, pp. 176–194, 2021
2021
Later among the works it cites.
Z. Wang, H. Dong, R. Jia, J. Li, Z. Fu, S. Han, and D. Zhang, “TUTA: tree-based transformers for generally structured table pre-training,” in KDD . ACM, 2021, pp. 1780–1790
2021
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2020
Cited alongside, same era.
T. Lin, P. Goyal, R. B. Girshick, K. He, and P. Dollár, “Focal loss for dense object detection,” IEEE Trans. Pattern Anal. Mach. Intell. , vol. 42, no. 2, pp. 318–327, 2020
2020
Cited alongside, same era.
M. Joshi, D. Chen, Y. Liu, D. S. Weld, L. Zettlemoyer, and O. Levy, “Spanbert: Improving pre-training by representing and predicting spans,” Trans. Assoc. Comput. Linguistics , vol. 8, pp. 64–77, 2020
2020
Cited alongside, same era.
W. Wang, B. Bi, M. Yan, C. Wu, J. Xia, Z. Bao, L. Peng, and L. Si, “Structbert: Incorporating language structures into pre-training for deep language understanding,” in ICLR . OpenReview.net, 2020
2020
Cited alongside, same era.
W. Liu, P. Zhou, Z. Zhao, Z. Wang, Q. Ju, H. Deng, and P. Wang, “K-BERT: enabling language representation with knowledge graph,” in AAAI . AAAI Press, 2020, pp. 2901–2908
2020
Cited alongside, same era.
J. Herzig, P. K. Nowak, T. Müller, F. Piccinno, and J. M. Eisenschlos, “Tapas: Weakly supervised table parsing via pre-training,” in ACL . Association for Computational Linguistics, 2020, pp. 4320–4333
2020
Cited alongside, same era.
W. Zhang, C. M. Wong, G. Ye, B. Wen, W. Zhang, and H. Chen, “Billion-scale pre-trained e-commerce product knowledge graph model,” in ICDE . IEEE, 2021, pp. 2476–2487
2021
Cited alongside, same era.
W. Zhang, S. Deng, M. Chen, L. Wang, Q. Chen, F. Xiong, X. Liu, and H. Chen, “Knowledge graph embedding in e-commerce applications: Attentive reasoning, explanations, and transferable rules,” in IJCKG . ACM, 2021, pp. 71–79
2021
Cited alongside, same era.
H. Guo, S. Yuan, and X. Wu, “Logbert: Log anomaly detection via BERT,” in IJCNN . IEEE, 2021, pp. 1–8
2021
Later among the works it cites.
V. Le and H. Zhang, “Log-based anomaly detection without log parsing,” in ASE . IEEE, 2021, pp. 492–504
2021
Later among the works it cites.
X. Chen, N. Zhang, X. Xie, S. Deng, Y. Yao, C. Tan, F. Huang, L. Si, and H. Chen, “Knowprompt: Knowledge-aware prompt-tuning with synergistic optimization for relation extraction,” in WWW . ACM, 2022, pp. 2778–2788
2022
Closest in time.
H. Dong, Z. Cheng, X. He, M. Zhou, A. Zhou, F. Zhou, A. Liu, S. Han, and D. Zhang, “Table pre-training: A survey on model architectures, pre-training objectives, and downstream tasks,” in IJCAI . ijcai.org, 2022, pp. 5426–5435
2022
Closest in time.
Q. Liu, B. Chen, J. Guo, M. Ziyadi, Z. Lin, W. Chen, and J. Lou, “TAPEX: table pre-training via learning a neural SQL executor,” in ICLR . OpenReview.net, 2022
2022
Closest in time.
J. Yang, A. Gupta, S. Upadhyay, L. He, R. Goel, and S. Paul, “Tableformer: Robust transformer modeling for table-text encoding,” in ACL (1) . Association for Computational Linguistics, 2022, pp. 528–537
2022
Closest in time.
2022
Closest in time.
E. J. Hu, Y. Shen, P. Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, and W. Chen, “Lora: Low-rank adaptation of large language models,” in ICLR . OpenReview.net, 2022
2022
Closest in time.
2022
Closest in time.
V. Le and H. Zhang, “Log-based anomaly detection with deep learning: How far are we?” in ICSE . ACM, 2022, pp. 1356–1367
2022
Closest in time.
M. Catillo, A. Pecchia, and U. Villano, “Autolog: Anomaly detection by deep autoencoding of system logs,” Expert Syst. Appl. , vol. 191, p. 116263, 2022
2022
Closest in time.
2022
Closest in time.
T. Trouillon, J. Welbl, S. Riedel, É. Gaussier, and G. Bouchard, “Complex embeddings for simple link prediction,” in ICML , ser. JMLR Workshop and Conference Proceedings, vol. 48. JMLR.org, 2016, pp. 2071–2080
2080
Closest in time.