2021

Contrastive Learning for Recommender System

Liu, Zhuang, Ma, Yunpu, Ouyang, Yuanxin et al.

Understand

Recommender systems, which analyze users' preference patterns to suggest potential targets, are indispensable in today's society.

Collaborative Filtering (CF) is the most popular recommendation model.
Specifically, Graph Neural Network (GNN) has become a new state-of-the-art for CF.
In the GNN-based recommender system, message dropout is usually used to alleviate the selection bias in the user-item bipartite graph.

Built on

Self-Organization in a Perceptual Network
Ralph Linsker. 1988 · 1988
Earlier work this paper cites.
Contrastive Learning for Debiased Candidate Generation in Large-Scale Recommender Systems
Original
Chang Zhou, Jianxin Ma, Jianwei Zhang, Jingren Zhou, and Hongxia Yang. 2020 · 2005
Earlier work this paper cites.
Dimensionality Reduction by Learning an Invariant Mapping. In CVPR (2) . IEEE Computer Society, 1735–1742
Raia Hadsell, Sumit Chopra, and Yann LeCun. 2006 · 2006
Earlier work this paper cites.
ItemRank: A Random-Walk Based Scoring Algorithm for Recommender Engines. In IJCAI . 2766–2771
Marco Gori and Augusto Pucci. 2007 · 2007
Earlier work this paper cites.
BPR: Bayesian Personalized Ranking from Implicit Feedback. In UAI . AUAI Press, 452–461
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2009 · 2009
Earlier work this paper cites.
Understanding the difficulty of training deep feedforward neural networks. In AISTATS (JMLR Proceedings, Vol. 9) . JMLR.org, 249–256
Xavier Glorot and Yoshua Bengio. 2010 · 2010
Earlier work this paper cites.
BPR: Bayesian Personalized Ranking from Implicit Feedback
Original
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme. 2012 · 2012
Earlier work this paper cites.
Distributed Representations of Words and Phrases and their Compositionality. In NIPS . 3111–3119
Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. 2013 · 2013
Earlier work this paper cites.
Adam: A Method for Stochastic Optimization. In ICLR (Poster)
Diederik P. Kingma and Jimmy Ba. 2015 · 2015
Earlier work this paper cites.
Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering
Original
Ruining He and Julian J. McAuley. 2016 · 2016
Earlier work this paper cites.
Improved Deep Metric Learning with Multi-class N-pair Loss Objective. In NIPS . 1849–1857
Kihyuk Sohn. 2016 · 2016
Earlier work this paper cites.

Similar

On Sampling Strategies for Neural Network-based Collaborative Filtering. In KDD . ACM, 767–776
Ting Chen, Yizhou Sun, Yue Shi, and Liangjie Hong. 2017 · 2017
Cited alongside, same era.
Representation Learning on Graphs: Methods and Applications
William L. Hamilton, Rex Ying, and Jure Leskovec. 2017a · 2017
Cited alongside, same era.
BiRank: Towards Ranking on Bipartite Graphs
Xiangnan He, Ming Gao, Min-Yen Kan, and Dingxian Wang. 2017 · 2017
Cited alongside, same era.
Semi-Supervised Classification with Graph Convolutional Networks. In ICLR (Poster) . OpenReview.net
Thomas N. Kipf and Max Welling. 2017 · 2017
Cited alongside, same era.
Graph Convolutional Matrix Completion
Original
Rianne van den Berg, Thomas N. Kipf, and Max Welling. 2017 · 2017
Cited alongside, same era.
Deep Matrix Factorization Models for Recommender Systems. In Proceedings of the Twenty-Sixth International Joint Conference on Artificial Intelligence, IJCAI-17 . 3203–3209
Hong-Jian Xue, Xinyu Dai, Jianbing Zhang, Shujian Huang, and Jiajun Chen. 2017 · 2017
Cited alongside, same era.
Self-Attentive Sequential Recommendation. In 2018 IEEE International Conference on Data Mining (ICDM)
Wang Cheng Kang and Julian Mcauley. 2018 · 2018
Cited alongside, same era.
An efficient framework for learning sentence representations. In ICLR (Poster) . OpenReview.net
Lajanugen Logeswaran and Honglak Lee. 2018 · 2018
Cited alongside, same era.
Representation Learning with Contrastive Predictive Coding
Original
Aäron van den Oord, Yazhe Li, and Oriol Vinyals. 2018 · 2018
Cited alongside, same era.
Unsupervised Feature Learning via Non-Parametric Instance Discrimination. In CVPR . IEEE Computer Society, 3733–3742
Zhirong Wu, Yuanjun Xiong, Stella X. Yu, and Dahua Lin. 2018 · 2018
Cited alongside, same era.
HOP-rec: high-order proximity for implicit recommendation. In RecSys . ACM, 140–144
Jheng-Hong Yang, Chih-Ming Chen, Chuan-Ju Wang, and Ming-Feng Tsai. 2018 · 2018
Cited alongside, same era.
Revisiting Graph Based Collaborative Filtering: A Linear Residual Graph Convolutional Network Approach. In AAAI . AAAI Press, 27–34
Lei Chen, Le Wu, Richang Hong, Kun Zhang, and Meng Wang. 2020b
Cited in the paper.

Then

Graph Convolutional Neural Networks for Web-Scale Recommender Systems. In KDD . ACM, 974–983
Rex Ying, Ruining He, Kaifeng Chen, Pong Eksombatchai, William L. Hamilton, and Jure Leskovec. 2018 · 2018
Later among the works it cites.
Learning Representations by Maximizing Mutual Information Across Views. In NeurIPS . 15509–15519
Philip Bachman, R. Devon Hjelm, and William Buchwalter. 2019 · 2019
Later among the works it cites.
Learning deep representations by mutual information estimation and maximization. In ICLR . OpenReview.net
R. Devon Hjelm, Alex Fedorov, Samuel Lavoie-Marchildon, Karan Grewal, Philip Bachman, Adam Trischler, and Yoshua Bengio. 2019 · 2019
Later among the works it cites.
BERT4Rec: Sequential Recommendation with Bidirectional Encoder Representations from Transformer
Fei Sun, Jun Liu, Jian Wu, Changhua Pei, Xiao Lin, Wenwu Ou, and Peng Jiang. 2019 · 2019
Later among the works it cites.
Contrastive Multiview Coding
Original
Yonglong Tian, Dilip Krishnan, and Phillip Isola. 2019 · 2019
Later among the works it cites.
Neural Graph Collaborative Filtering. In the 42nd International ACM SIGIR Conference
Xiang Wang, Xiangnan He, Meng Wang, Fuli Feng, and Tat Seng Chua. 2019 · 2019
Later among the works it cites.
Personalizing Graph Neural Networks with Attention Mechanism for Session-based Recommendation
Original
Shu Wu, Mengqi Zhang, Xin Jiang, Ke Xu, and Liang Wang. 2019b · 2019
Later among the works it cites.
Graph Contextualized Self-Attention Network for Session-based Recommendation. In IJCAI . ijcai.org, 3940–3946
Chengfeng Xu, Pengpeng Zhao, Yanchi Liu, Victor S. Sheng, Jiajie Xu, Fuzhen Zhuang, Junhua Fang, and Xiaofang Zhou. 2019 · 2019
Later among the works it cites.
A Simple Framework for Contrastive Learning of Visual Representations
Original
Ting Chen, Simon Kornblith, Mohammad Norouzi, and Geoffrey E. Hinton. 2020a · 2020
Later among the works it cites.
Debiased Contrastive Learning
Original
Ching-Yao Chuang, Joshua Robinson, Yen-Chen Lin, Antonio Torralba, and Stefanie Jegelka. 2020 · 2020
Later among the works it cites.
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere
Original
Tongzhou Wang and Phillip Isola. 2020 · 2020
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Reading the bibliography…