Fetching the paper…

Reading the bibliography…

2021

GraphFM: Graph Factorization Machines for Feature Interaction Modeling

Wu, Shu, Li, Zekun, Su, Yunyue et al.

Original
PDF
Post on X

Understand

Factorization machine (FM) is a prevalent approach to modeling pairwise (second-order) feature interactions when dealing with high-dimensional sparse data.

However, on the one hand, FM fails to capture higher-order feature interactions suffering from combinatorial expansion.
On the other hand, taking into account interactions between every pair of features may introduce noise and degrade prediction accuracy.
To solve the problems, we propose a novel approach, Graph Factorization Machine (GraphFM), by naturally representing features in the graph structure.

GraphFM: Graph Factorization Machines for Feature Interaction Modeling · Around

Built on

Gori, M., Monfardini, G., Scarselli, F.: A new model for learning in graph domains. In: IJCNN (2005)
2005
Earlier work this paper cites.
Scarselli, F., Gori, M., Tsoi, A.C., Hagenbuchner, M., Monfardini, G.: The graph neural network model. IEEE Transactions on Neural Networks (2009)
2009
Earlier work this paper cites.
Rendle, S.: Factorization machines. In: ICDM (2010)
2010
Earlier work this paper cites.
Rendle, S.: Factorization machines with libfm. ACM TIST (2012)
2012
Earlier work this paper cites.
Bruna, J., Zaremba, W., Szlam, A., LeCun, Y.: Spectral networks and locally connected networks on graphs. arXiv preprint arXiv:1312.6203 (2013)
Original
2013
Earlier work this paper cites.
Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)
Original
2014
Earlier work this paper cites.
Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., Bengio, Y.: Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078 (2014)
Original
2014
Earlier work this paper cites.
Kingma, D., Ba, J.: Adam: A method for stochastic optimization. Computer Science (2014)
2014
Earlier work this paper cites.
Li, Y., Tarlow, D., Brockschmidt, M., Zemel, R.: Gated graph sequence neural networks. arXiv preprint arXiv:1511.05493 (2015)
Original
2015
Earlier work this paper cites.
Hinton, G., Vinyals, O., Dean, J.: Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)
Original
2015
Earlier work this paper cites.
Zhang, W., Du, T., Wang, J.: Deep learning over multi-field categorical data: A case study on user response prediction. arXiv preprint arXiv:1601.02376 (2016)
Original
2016
Earlier work this paper cites.
Cheng, H.-T., Koc, L., Harmsen, J., Shaked, T., Chandra, T., Aradhye, H., Anderson, G., Corrado, G., Chai, W., Ispir, M., et al
2016
Earlier work this paper cites.
Zhang, C., Bengio, S., Hardt, M., Recht, B., Vinyals, O.: Understanding deep learning requires rethinking generalization. arXiv preprint arXiv:1611.03530 (2016)
Original
2016
Earlier work this paper cites.
Juan, Y., Zhuang, Y., Chin, W.-S., Lin, C.-J.: Field-aware factorization machines for ctr prediction. In: RecSys (2016). ACM
2016
Earlier work this paper cites.
Qu, Y., Cai, H., Ren, K., Zhang, W., Yu, Y., Wen, Y., Wang, J.: Product-based neural networks for user response prediction. In: ICDM (2016)
2016
Earlier work this paper cites.
Blondel, M., Fujino, A., Ueda, N., Ishihata, M.: Higher-order factorization machines. In: NIPS (2016)
2016
Earlier work this paper cites.
Shan, Y., Hoens, T.R., Jiao, J., Wang, H., Yu, D., Mao, J.: Deep crossing: Web-scale modeling without manually crafted combinatorial features. In: SIGKDD (2016)
2016
Earlier work this paper cites.
Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., Isard, M., et al
2016
Earlier work this paper cites.
He, X., Liao, L., Zhang, H., Nie, L., Hu, X., Chua, T.-S.: Neural collaborative filtering. In: WWW (2017). International World Wide Web Conferences Steering Committee
2017
Earlier work this paper cites.
He, X., Chua, T.-S.: Neural factorization machines for sparse predictive analytics. In: SIGIR (2017)
2017
Earlier work this paper cites.

Similar

Guo, H., Tang, R., Ye, Y., Li, Z., He, X.: Deepfm: a factorization-machine based neural network for ctr prediction. In: IJCAI (2017)
2017
Cited alongside, same era.
Xiao, J., Ye, H., He, X., Zhang, H., Wu, F., Chua, T.-S.: Attentional factorization machines: Learning the weight of feature interactions via attention networks. arXiv preprint arXiv:1708.04617 (2017)
Original
2017
Cited alongside, same era.
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: ICLR (2017)
2017
Cited alongside, same era.
Hamilton, W., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: NIPS (2017)
2017
Cited alongside, same era.
Li, R., Tapaswi, M., Liao, R., Jia, J., Urtasun, R., Fidler, S.: Situation recognition with graph neural networks. In: ICCV (2017)
2017
Cited alongside, same era.

Then

Tao, Z., Wang, X., He, X., Huang, X., Chua, T.-S.: Hoafm: A high-order attentive factorization machine for ctr prediction. Information Processing & Management, 102076 (2019)
2019
Later among the works it cites.
Song, W., Shi, C., Xiao, Z., Duan, Z., Xu, Y., Zhang, M., Tang, J.: Autoint: Automatic feature interaction learning via self-attentive neural networks. In: CIKM (2019)
2019
Later among the works it cites.
Cui, Z., Li, Z., Wu, S., Zhang, X.-Y., Wang, L.: Dressing as a whole: Outfit compatibility learning based on node-wise graph neural networks. In: WWW, pp. 307–317 (2019)
2019
Later among the works it cites.
Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., Antiga, L., et al.: Pytorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32
2019
Later among the works it cites.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…

Marcheggiani, D., Titov, I.: Encoding sentences with graph convolutional networks for semantic role labeling. arXiv preprint arXiv:1703.04826 (2017)

2017

Cited alongside, same era.

Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., Polosukhin, I.: Attention is all you need. In: Advances in Neural Information Processing Systems, pp. 5998–6008 (2017)

2017

Cited alongside, same era.

Wang, R., Fu, B., Fu, G., Wang, M.: Deep & cross network for ad click predictions. In: ADKDD (2017)

2017

Cited alongside, same era.

Qi, X., Liao, R., Jia, J., Fidler, S., Urtasun, R.: 3d graph neural networks for rgbd semantic segmentation. In: ICCV (2017)

2017

Cited alongside, same era.

Marino, K., Salakhutdinov, R., Gupta, A.: The more you know: Using knowledge graphs for image classification. In: CVPR (2017)

2017

Cited alongside, same era.

Veličković, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y.: Graph attention networks. In: ICLR (2018)

2018

Cited alongside, same era.

Lian, J., Zhou, X., Zhang, F., Chen, Z., Xie, X., Sun, G.: xdeepfm: Combining explicit and implicit feature interactions for recommender systems. In: SIGKDD (2018)

2018

Cited alongside, same era.

Su, Y., Zhang, R., Erfani, S., Xu, Z.: Detecting beneficial feature interactions for recommender systems via graph neural networks. arXiv e-prints, 2008 (2020)

2020

Later among the works it cites.

Cheng, W., Shen, Y., Huang, L.: Adaptive factorization network: Learning adaptive-order feature interactions. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 3609–3616 (2020)

2020

Later among the works it cites.

Xi, D., Zhuang, F., Zhu, Y., Zhao, P., Zhang, X., He, Q.: Graph factorization machines for cross-domain recommendation. arXiv preprint arXiv:2007.05911 (2020)

2020

Later among the works it cites.

Li, Z., Cheng, W., Chen, Y., Chen, H., Wang, W.: Interpretable click-through rate prediction through hierarchical attention. In: Proceedings of the 13th International Conference on Web Search and Data Mining, pp. 313–321 (2020)

2020

Later among the works it cites.

Liu, B., Zhu, C., Li, G., Zhang, W., Lai, J., Tang, R., He, X., Li, Z., Yu, Y.: Autofis: Automatic feature interaction selection in factorization models for click-through rate prediction. In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2636–2645 (2020)

2020

Later among the works it cites.

Chen, L., Wu, L., Hong, R., Zhang, K., Wang, M.: Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach. arXiv preprint arXiv:2001.10167 (2020)

2020

Later among the works it cites.

Kazi, A., Cosmo, L., Navab, N., Bronstein, M.: Differentiable graph module (dgm) graph convolutional networks. arXiv preprint arXiv:2002.04999 (2020)

2020

Later among the works it cites.

Wu, S., Yu, F., Yu, X., Liu, Q., Wang, L., Tan, T., Shao, J., Huang, F.: Tfnet: Multi-semantic feature interaction for ctr prediction. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 1885–1888 (2020)

2020

Later among the works it cites.

Zheng, Y., Wei, P., Chen, Z., Cao, Y., Lin, L.: Graph-convolved factorization machines for personalized recommendation. IEEE Transactions on Knowledge and Data Engineering (2021)

2021

Closest in time.

Sun, Y., Pan, J., Zhang, A., Flores, A.: Fm2: Field-matrixed factorization machines for recommender systems. In: Proceedings of the Web Conference 2021, pp. 2828–2837 (2021)

2021

Closest in time.

Wang, R., Shivanna, R., Cheng, D., Jain, S., Lin, D., Hong, L., Chi, E.: Dcn v2: Improved deep & cross network and practical lessons for web-scale learning to rank systems. In: Proceedings of the Web Conference 2021, pp. 1785–1797 (2021)

2021

Closest in time.

Xu, Y., Zhu, Y., Yu, F., Liu, Q., Wu, S.: Disentangled self-attentive neural networks for click-through rate prediction. In: Proceedings of the 30th ACM International Conference on Information & Knowledge Management, pp. 3553–3557 (2021)

2021

Closest in time.

Zhang, S., Zheng, N., Wang, D.-L.: A novel attention-based global and local information fusion neural network for group recommendation. Machine Intelligence Research 19

2022

Closest in time.

Dudzik, A.J., Veličković, P.: Graph neural networks are dynamic programmers. Advances in Neural Information Processing Systems 35

2022

Closest in time.

Tian, Z., Bai, T., Zhang, Z., Xu, Z., Lin, K., Wen, J.-R., Zhao, W.X.: Directed acyclic graph factorization machines for ctr prediction via knowledge distillation. In: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining, pp. 715–723 (2023)

2023

Closest in time.