Fetching the paper…
Reading the bibliography…
Code representation learning, which aims to encode the semantics of source code into distributed vectors, plays an important role in recent deep-learning-based models for code intelligence.
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Liu, Y.; Ott, M.; Goyal, N.; Du, J.; Joshi, M.; Chen, D.; Levy, O.; Lewis, M.; Zettlemoyer, L.; and Stoyanov, V. 2019 · 1907
Earlier work this paper cites.
CodeSearchNet Challenge: Evaluating the State of Semantic Code Search
Husain, H.; Wu, H.-H.; Gazit, T.; Allamanis, M.; and Brockschmidt, M. 2019 · 1909
Earlier work this paper cites.
Statistical phrase-based translation
Koehn, P.; Och, F. J.; and Marcu, D. 2003 · 2003
Earlier work this paper cites.
CERT: Contrastive Self-supervised Learning for Language Understanding
Fang, H.; and Xie, P. 2020 · 2005
Earlier work this paper cites.
DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations
Giorgi, J. M.; Nitski, O.; Bader, G. D.; and Wang, B. 2020 · 2006
Earlier work this paper cites.
Contrastive Multi-View Representation Learning on Graphs
Hassani, K.; and Ahmadi, A. H. K. 2020 · 2006
Earlier work this paper cites.
CLEAR: Contrastive Learning for Sentence Representation
Wu, Z.; Wang, S.; Gu, J.; Khabsa, M.; Sun, F.; and Ma, H. 2020 · 2012
Earlier work this paper cites.
On the Properties of Neural Machine Translation: Encoder–Decoder Approaches
Cho, K.; van Merrienboer, B.; Bahdanau, D.; and Bengio, Y. 2014 · 2014
Earlier work this paper cites.
Convolutional Neural Networks for Sentence Classification
Kim, Y. 2014 · 2014
Earlier work this paper cites.
Towards a Big Data Curated Benchmark of Inter-project Code Clones
Svajlenko, J.; Islam, J. F.; Keivanloo, I.; Roy, C. K.; and Mia, M. M. 2014 · 2014
Earlier work this paper cites.
Effective Approaches to Attention-based Neural Machine Translation
Luong, M.-T.; Pham, H.; and Manning, C. D. 2015 · 2015
Earlier work this paper cites.
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks
Tai, K. S.; Socher, R.; and Manning, C. D. 2015 · 2015
Earlier work this paper cites.
Convolutional neural networks over tree structures for programming language processing
Mou, L.; Li, G.; Zhang, L.; Wang, T.; and Jin, Z. 2016 · 2016
Earlier work this paper cites.
Neural Machine Translation of Rare Words with Subword Units
Sennrich, R.; Haddow, B.; and Birch, A. 2016 · 2016
Earlier work this paper cites.
Deep learning code fragments for code clone detection
White, M.; Tufano, M.; Vendome, C.; and Poshyvanyk, D. 2016 · 2016
Earlier work this paper cites.
Software Defect Prediction via Convolutional Neural Network
Li, J.; He, P.; Zhu, J.; and Lyu, M. R. 2017 · 2017
Earlier work this paper cites.
Attention is All You Need
Vaswani, A.; Shazeer, N.; Parmar, N.; Uszkoreit, J.; Jones, L.; Gomez, A. N.; Kaiser, L.; and Polosukhin, I. 2017 · 2017
Earlier work this paper cites.
Tree-to-tree neural networks for program translation
Chen, X.; Liu, C.; and Song, D. 2018 · 2018
Cited alongside, same era.
Deep code search
Gu, X.; Zhang, H.; and Kim, S. 2018 · 2018
Cited alongside, same era.
Improving language understanding by generative pre-training
Radford, A.; Narasimhan, K.; Salimans, T.; and Sutskever, I. 2018 · 2018
Cited alongside, same era.
code2vec: learning distributed representations of code
Alon, U.; Zilberstein, M.; Levy, O.; and Yahav, E. 2019 · 2019
Cited alongside, same era.
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J.; Chang, M.-W.; Lee, K.; and Toutanova, K. N. 2018 · 2019
Cited alongside, same era.
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer
Raffel, C.; Shazeer, N.; Roberts, A.; Lee, K.; Narang, S.; Matena, M.; Zhou, Y.; Li, W.; and Liu, P. J. 2019 · 2019
Multi-task learning based pre-trained language model for code completion
Liu, F.; Li, G.; Zhao, Y.; and Jin, Z. 2020 · 2020
Later among the works it cites.
Self-Supervised Learning of Pretext-Invariant Representations
Misra, I.; and van der Maaten, L. 2020 · 2020
Later among the works it cites.
Intellicode compose: Code generation using transformer
Svyatkovskiy, A.; Deng, S. K.; Fu, S.; and Sundaresan, N. 2020 · 2020
Later among the works it cites.
On Mutual Information Maximization for Representation Learning
Tschannen, M.; Djolonga, J.; Rubenstein, P. K.; Gelly, S.; and Lucic, M. 2020 · 2020
Later among the works it cites.
Unified Pre-training for Program Understanding and Generation
Ahmad, W. U.; Chakraborty, S.; Ray, B.; and Chang, K.-W. 2021 · 2021
Closest in time.
Self-Supervised Contrastive Learning for Code Retrieval and Summarization via Semantic-Preserving Transformations
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Cited alongside, same era.
Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks
Reimers, N.; and Gurevych, I. 2019 · 2019
Cited alongside, same era.
Tree transformer: Integrating tree structures into self-attention
Wang, Y.; Lee, H.-Y.; and Chen, Y.-N. 2019 · 2019
Cited alongside, same era.
Devign: Effective Vulnerability Identification by Learning Comprehensive Program Semantics via Graph Neural Networks
Zhou, Y.; Liu, S.; Siow, J. K.; Du, X.; and Liu, Y. 2019 · 2019
Cited alongside, same era.
A Simple Framework for Contrastive Learning of Visual Representations
Chen, T.; Kornblith, S.; Norouzi, M.; and Hinton, G. 2020 · 2020
Cited alongside, same era.
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Clark, K.; Luong, M.-T.; Le, Q. V.; and Manning, C. D. 2020 · 2020
Cited alongside, same era.
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Feng, Z.; Guo, D.; Tang, D.; Duan, N.; Feng, X.; Gong, M.; Shou, L.; Qin, B.; Liu, T.; Jiang, D.; and Zhou, M. 2020 · 2020
Cited alongside, same era.
Bui, N. D. Q.; Yu, Y.; and Jiang, L. 2021 · 2021
Closest in time.
On using distributed representations of source code for the detection of C security vulnerabilities
Coimbra, D.; Reis, S.; Abreu, R.; Pasareanu, C. S.; and Erdogmus, H. 2021 · 2021
Closest in time.
GraphCodeBERT: Pre-training Code Representations with Data Flow
Guo, D.; Ren, S.; Lu, S.; Feng, Z.; Tang, D.; Liu, S.; Zhou, L.; Duan, N.; Svyatkovskiy, A.; Fu, S.; Tufano, M.; Deng, S. K.; Clement, C.; Drain, D.; Sundaresan, N.; Yin, J.; Jiang, D.; and Zhou, M. 2021 · 2021
Closest in time.
Contrastive Code Representation Learning
Jain, P.; Jain, A.; Zhang, T.; Abbeel, P.; Gonzalez, J. E.; and Stoica, I. 2021 · 2021
Closest in time.
TreeBERT: A Tree-Based Pre-Trained Model for Programming Language
Jiang, X.; Zheng, Z.; Lyu, C.; Li, L.; and Lyu, L. 2021 · 2021
Closest in time.
CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation
Lu, S.; Guo, D.; Ren, S.; Huang, J.; Svyatkovskiy, A.; Blanco, A.; Clement, C. B.; Drain, D.; Jiang, D.; Tang, D.; Li, G.; Zhou, L.; Shou, L.; Zhou, L.; Tufano, M.; Gong, M.; Zhou, M.; Duan, N.; Sundaresan, N.; Deng, S. K.; Fu, S.; and Liu, S. 2021 · 2021
Closest in time.
CoTexT: Multi-task Learning with Code-Text Transformer
Phan, L.; Tran, H.; Le, D.; Nguyen, H.; Anibal, J.; Peltekian, A.; and Ye, Y. 2021 · 2021
Closest in time.
Contrastive Multi-Modal Clustering
Xu, J.; Tang, H.; Ren, Y.; Zhu, X.; and He, L. 2021 · 2021
Closest in time.
ConSERT: A Contrastive Framework for Self-Supervised Sentence Representation Transfer
Yan, Y.; Li, R.; Wang, S.; Zhang, F.; Wu, W.; and Xu, W. 2021 · 2021
Closest in time.
Multimodal Contrastive Training for Visual Representation Learning
Yuan, X.; Lin, Z.; Kuen, J.; Zhang, J.; Wang, Y.; Maire, M.; Kale, A.; and Faieta, B. 2021 · 2021
Closest in time.
Language-Agnostic Representation Learning of Source Code from Structure and Context
Zugner, D.; Kirschstein, T.; Catasta, M.; Leskovec, J.; and Günnemann, S. 2021 · 2021
Closest in time.