AI Chat Paper
Note: Please note that the following content is generated by AMiner AI. SciOpen does not take any responsibility related to this content.
{{lang === 'zh_CN' ? '文章概述' : 'Summary'}}
{{lang === 'en_US' ? '中' : 'Eng'}}
Chat more with AI
PDF (1.1 MB)
Collect
Submit Manuscript AI Chat Paper
Show Outline
Outline
Show full outline
Hide outline
Outline
Show full outline
Hide outline
Open Access

Graph Structure Learning for Robust Recommendation

School of Computer Science and Technology, Anhui University, Hefei 230601, China
School of Public Health, Wannan Medical College, Wuhu 241002, China
Show Author Information

Abstract

Recommendation systems play a crucial role in uncovering concealed interactions among users and items within online social networks. Recently, Graph Neural Network (GNN)-based recommendation systems exploit higher-order interactions within the user-item interaction graph, demonstrating cutting-edge performance in recommendation tasks. However, GNN-based recommendation models are susceptible to different types of noise attacks, such as deliberate perturbations or false clicks. These attacks propagate through the graph and adversely affect the robustness of recommendation results. Conventional two-stage method that purifies the graph before training the GNN model is suboptimal. To strengthen the model’s resilience to noise, we propose Graph Structure Learning for Robust Recommendation (GSLRRec), a joint learning framework that integrates graph structure learning and GNN model training for recommendation. Specifically, GSLRRec considers the graph adjacency matrix as adjustable parameters, and simultaneously optimizes both the graph structure and the representations of user/item nodes for recommendation. During the joint training process, the graph structure learning employs low-rank and sparse constraints to effectively denoise the graph. Our experiments illustrate that the simultaneous learning of both structure and GNN parameters can provide more robust recommendation results under various noise levels.

References

[1]

S. Wu, F. Sun, W. Zhang, X. Xie, and B. Cui, Graph neural networks in recommender systems: A survey, ACM Comput. Surv., vol. 55, no. 5, p. 97, 2023.

[2]

L. Wu, X. He, X. Wang, K. Zhang, and M. Wang, A survey on accuracy-oriented neural recommendation: From collaborative filtering to information-rich recommendation, IEEE Trans. Knowledge Data Eng., vol. 35, no. 5, pp. 4425–4445, 2023.

[3]
F. Ricci, L. Rokach, and B. Shapira, Recommender systems: Techniques, applications, and challenges, in Recommender Systems Handbook (3rd ed.) , F. Ricci, L. Rokach, and B. Shapira, eds., New York, NY, USA: Springer, 2022, pp. 1–35.
[4]
L. He, X. Wang, D. Wang, H. Zou, H. Yin, and G. Xu, Simplifying graph-based collaborative filtering for recommendation, in Proc. 16 th ACM Int. Conf. Web Search and Data Mining, Singapore, 2023, pp. 60–68.
[5]
W. Fan, Y. Ma, Q. Li, Y. He, E. Zhao, J. Tang, and D. Yin, Graph neural networks for social recommendation, in Proc. the World Wide Web Conf., San Francisco, CA, USA, 2019, pp. 417–426.
[6]

W. Fan, Y. Ma, Q. Li, J. Wang, G. Cai, J. Tang, and D. Yin, A graph neural network framework for social recommendations, IEEE Trans. Knowl. Data Eng., vol. 34, no. 5, pp. 2033–2047, 2022.

[7]
X. He, K. Deng, X. Wang, Y. Li, Y. D. Zhang, and M. Wang, LightGCN: Simplifying and powering graph convolution network for recommendation, in Proc. 43 rd Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Virtual Event, 2020, pp. 639–648.
[8]

Z. Wu, S. Pan, F. Chen, G. Long, C. Zhang, and P. S. Yu, A comprehensive survey on graph neural networks, IEEE Trans. Neural Netw. Learn. Syst., vol. 32, no. 1, pp. 4–24, 2021.

[9]

Y. Zhang, Y. Zhang, D. Yan, S. Deng, and Y. Yang, Revisiting graph-based recommender systems from the perspective of variational auto-encoder, ACM Trans. Inf. Syst., vol. 41, no. 3, p. 81, 2022.

[10]

S. Zhang, H. Tong, J. Xu, and R. Maciejewski, Graph convolutional networks: A comprehensive review, Comput. Soc. Netw., vol. 6, no. 1, p. 11, 2019.

[11]

A. A. Kardan and M. Ebrahimi, A novel approach to hybrid recommendation systems based on association rules mining for content recommendation in asynchronous discussion groups, Inf. Sci., vol. 219, pp. 93–110, 2013.

[12]
C. Gao, X. Wang, X. He, and Y. Li, Graph neural networks for recommender system, in Proc. 15 th ACM Int. Conf. Web Search and Data Mining, Tempe, AZ, USA, 2022, pp. 1623–1625.
[13]

W. Jin, Y. Li, H. Xu, Y. Wang, S. Ji, C. Aggarwal, and J. Tang, Adversarial attacks and defenses on graphs, ACM SIGKDD Explor. Newsl., vol. 22, no. 2, pp. 19–34, 2021.

[14]
D. Zügner, A. Akbarnejad, and S. Günnemann, Adversarial attacks on neural networks for graph data, in Proc. 24 th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, London, UK, 2018, pp. 2847–2856.
[15]

F. Zhang and S. Wang, Detecting group shilling attacks in online recommender systems based on bisecting K-means clustering, IEEE Trans. Conput. Soc. Syst., vol. 7, no. 5, pp. 1189–1199, 2020.

[16]
C. Lin, S. Chen, H. Li, Y. Xiao, L. Li, and Q. Yang, Attacking recommender systems with augmented user profiles, in Proc. 29 th ACM Int. Conf. Information & Knowledge Management, Virtual Event, 2020, pp. 855–864.
[17]

F. Wang, H. Zhu, G. Srivastava, S. Li, M. R. Khosravi, and L. Qi, Robust collaborative filtering recommendation with user-item-trust records, IEEE Trans. Comput. Soc. Syst., vol. 9, no. 4, pp. 986–996, 2022.

[18]

S. Zhao, W. Wang, Z. Du, J. Chen, and Z. Duan, A black-box adversarial attack method via nesterov accelerated gradient and rewiring towards attacking graph neural networks, IEEE Trans. Big Data, vol. 9, no. 6, pp. 1586–1597, 2023.

[19]
W. Fan, T. Derr, X. Zhao, Y. Ma, H. Liu, J. Wang, J. Tang, and Q. Li, Attacking black-box recommendations via copying cross-domain user profiles, in Proc. 37th IEEE Int. Conf. Data Engineering, Chania, Greece, 2021, pp. 1583–1594.
[20]
J. Chen, W. Fan, G. Zhu, X. Zhao, C. Yuan, Q. Li, and Y. Huang, Knowledge-enhanced black-box attacks for recommendations, in Proc. 28 th ACM SIGKDD Conf. Knowledge Discovery and Data Mining, Washington, DC, USA, 2022, pp. 108–117.
[21]
W. Fan, H. Xu, W. Jin, X. Liu, X. Tang, S. Wang, Q. Li, J. Tang, J. Wang, and C. Aggarwal, Jointly attacking graph neural network and its explanations, in Proc. 39th IEEE Int. Conf. Data Engineering, Anaheim, CA, USA, 2023, pp. 654–667.
[22]

H. Xu, Y. Ma, H. C. Liu, D. Deb, H. Liu, J. L. Tang, and A. K. Jain, Adversarial attacks and defenses in images, graphs and text: A review, Int. J. Autom. Comput., vol. 17, no. 2, pp. 151–178, 2020.

[23]
M. Fang, G. Yang, N. Z. Gong, and J. Liu, Poisoning attacks to graph-based recommender systems, in Proc. 34 th Annu. Computer Security Applications Conf., San Juan, PR, USA, 2018, pp. 381–392.
[24]
M. Aktukmak, Y. Yilmaz, and I. Uysal, Quick and accurate attack detection in recommender systems through user attributes, in Proc. 13 th ACM Conf. Recommender Systems, Copenhagen, Denmark, 2019, pp. 348–352.
[25]

X. Ma, J. Wu, S. Xue, J. Yang, C. Zhou, Q. Z. Sheng, H. Xiong, and L. Akoglu, A comprehensive survey on graph anomaly detection with deep learning, IEEE Trans. Knowl. Data Eng., vol. 35, no. 12, pp. 12012–12038, 2023.

[26]
M. Pang, W. Gao, M. Tao, and Z. H. Zhou, Unorganized malicious attacks detection, in Proc. 32 nd Int. Conf. Neural Information Processing Systems, Montréal, Canada, 2018, pp. 6976–6985.
[27]
Y. Zhang, F. Regol, S. Pal, S. Khan, L. Ma, and M. Coates, Detection and defense of topological adversarial attacks on graphs, in Proc. 24 th Int. Conf. Artificial Intelligence and Statistics, Virtual Event, 2021, pp. 2989–2997.
[28]
Y. Zhu, W. Xu, J. Zhang, Q. Liu, S. Wu, and L. Wang, Deep graph structure learning for robust representations: A survey, arXiv preprint arXiv: 2103.03036, 2021.
[29]
Y. Lai and K. Zhou, How fraudster detection contributes to robust recommendation, https://api.semanticscholar.org/CorpusID:253734623, 2023.
[30]
V. W. Anelli, Y. Deldjoo, T. DiNoia, and F. A. Merra, Adversarial recommender systems: Attack, defense, and advances, in Recommender Systems Handbook (3rd ed.), F. Ricci, L. Rokach, and B. Shapira, eds., (3rd ed.) New York, NY, USA: Springer, 2022, pp. 335–379.
[31]
W. Jin, Y. Ma, X. Liu, X. Tang, S. Wang, and J. Tang, Graph structure learning for robust graph neural networks, in Proc. 26 th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, Virtual Event, 2020, pp. 66–74.
[32]
X. Wang, X. He, M. Wang, F. Feng, and T. S. Chua, Neural graph collaborative filtering, in Proc. 42 nd Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Paris, France, 2019, pp. 165–174.
[33]
H. Xu, L. Xiang, J. Yu, A. Cao, and X. Wang, Speedup robust graph structure learning with low-rank information, in Proc. 30 th ACM Int. Conf. Information & Knowledge Management, Virtual Event, 2021, pp. 2241–2250.
[34]
N. Entezari, S. A. Al-Sayouri, A. Darvishzadeh, and E. E. Papalexakis, All you need is low (rank): Defending against adversarial attacks on graphs, in Proc. 13 th Int. Conf. Web Search and Data Mining, Houston, TX, USA, 2020, pp. 169–177.
[35]

S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, Distributed optimization and statistical learning via the alternating direction method of multipliers, Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1–122, 2011.

[36]
T. Goldstein, C. Studer, and R. Baraniuk, A field guide to forward-backward splitting with a FASTA implementation, arXiv preprint arXiv: 1411.3406, 2014.
[37]
Y. Li, W. Jin, H. Xu, and J. Tang, DeepRobust: A platform for adversarial attacks and defenses, in Proc. 35 th AAAI Conf. Artificial Intelligence, Virtual Event, 2021, pp. 16078–16080.
[38]
D. Liang, L. Charlin, J. McInerney, and D. M. Blei, Modeling user exposure in recommendation, in Proc. 25 th Int. Conf. World Wide Web, Montréal, Canada, 2016, pp. 951–961.
[39]
D. K. Chae, J. S. Kang, S. W. Kim, and J. T. Lee, CFGAN: A generic collaborative filtering framework based on generative adversarial networks, in Proc. 27 th ACM Int. Conf. Information and Knowledge Management, Torino, Italy, 2018, pp. 137–146.
[40]
X. He, L. Liao, H. Zhang, L. Nie, X. Hu, and T. S. Chua, Neural collaborative filtering, in Proc. 26 th Int. Conf. World Wide Web, Perth, Australia, 2017, pp. 173–182.
[41]
S. Ji, Y. Feng, R. Ji, X. Zhao, W. Tang, and Y. Gao, Dual channel hypergraph collaborative filtering, in Proc. 26 th ACM SIGKDD Int. Conf. Knowledge Discovery & Data Mining, Virtual Event, 2020, pp. 2020–2029.
[42]
R. van den Berg, T. N. Kipf, and M. Welling, Graph convolutional matrix completion, arXiv preprint arXiv: 1706.02263, 2017.
[43]
L. Chen, L. Wu, R. Hong, K. Zhang, and M. Wang, Revisiting graph based collaborative filtering: A linear residual graph convolutional network approach, in Proc. 34 th AAAI Conf. Artificial Intelligence, New York, NY, USA, 2020, pp. 27–34.
[44]
F. Liu, Z. Cheng, L. Zhu, Z. Gao, and L. Nie, Interest-aware message-passing GCN for recommendation, in Proc. 30 th Web Conf., Ljubljana, Slovenia, 2021, pp. 1296–1305.
[45]

C. Pu, K. Wang, and Y. Xia, Robustness of link prediction under network attacks, IEEE Trans. Circuits Syst. II: Express Briefs, vol. 67, no. 8, pp. 1472–1476, 2020.

[46]

S. Zhang, L. Yao, A. Sun, and Y. Tay, Deep learning based recommender system: A survey and new perspectives, ACM Comput. Surv., vol. 52, no. 1, p. 5, 2020.

[47]

Y. Koren, R. Bell, and C. Volinsky, Matrix factorization techniques for recommender systems, Computer, vol. 42, no. 8, pp. 30–37, 2009.

[48]
J. B. Schafer, D. Frankowski, J. Herlocker, and S. Sen, Collaborative filtering recommender systems, in The Adaptive Web : Methods and Strategies of Web Personalization, P. Brusilovsky, A. Kobsa, and W. Nejdl, eds. Berlin, Germany: Springer, 2007, pp. 291–324.
[49]
P. Lops, M. de Gemmis, and G. Semeraro, Content-based recommender systems: State of the art and trends, in Recommender Systems Handbook, F. Ricci, L. Rokach, B. Shapira, and P. B. Kantor, eds. New York, NY, USA: Springer, 2011, pp. 73–105.
[50]

J. Zhou, G. Cui, S. Hu, Z. Zhang, C. Yang, Z. Liu, L. Wang, C. Li, and M. Sun, Graph neural networks: A review of methods and applications, AI Open, vol. 1, pp. 57–81, 2020.

[51]
W. Fan, X. Zhao, X. Chen, J. Su, J. Gao, L. Wang, Q. Liu, Y. Wang, H. Xu, L. Chen, et al., A comprehensive survey on trustworthy recommender systems, arXiv preprint arXiv: 2209.10117, 2022.
[52]
B. Ding, R. Zhang, L. Xu, G. Liu, S. Yang, Y. Liu, and Q. Zhang, U2D2Net: Unsupervised unified image dehazing and denoising network for single hazy image enhancement, IEEE Trans. Multimedia, vol. 26, pp. 202–217, 2024.
[53]

R. Zhang, L. Xu, Z. Yu, Y. Shi, C. Mu, and M. Xu, Deep-IRTarget: An automatic target detector in infrared imagery using dual-domain feature extraction and allocation, IEEE Trans. Multimedia, vol. 24, pp. 1735–1749, 2022.

[54]

R. Zhang, L. Wu, Y. Yang, W. Wu, Y. Chen, and M. Xu, Multi-camera multi-player tracking with deep player identification in sports video, Pattern Recognit., vol. 102, p. 107260, 2020.

[55]
F. Yuan, L. Yao, and B. Benatallah, Adversarial collaborative neural network for robust recommendation, in Proc. 42 nd Int. ACM SIGIR Conf. Research and Development in Information Retrieval, Paris, France, 2019, pp. 1065–1068.
[56]
F. Yuan, L. Yao, and B. Benatallah, Adversarial collaborative auto-encoder for top-N recommendation, in Proc. 2019 Int. Joint Conf. Neural Networks, Budapest, Hungary, 2019, pp. 1–8.
[57]

H. Chen, F. Qian, C. Liu, Y. Zhang, H. Su, and S. Zhao, Training robust deep collaborative filtering models via adversarial noise propagation, ACM Trans. Inf. Syst., vol. 42, no. 1, p. 9, 2024.

[58]

J. Tang, X. Du, X. He, F. Yuan, Q. Tian, and T. S. Chua, Adversarial training towards robust multimedia recommender system, IEEE Trans. Knowl. Data Eng., vol. 32, no. 5, pp. 855–867, 2020.

[59]
Y. Deldjoo, T. Di Noia, and F. A. Merra, Adversarial machine learning in recommender systems (AML-RecSys), in Proc. 13 th Int. Conf. Web Search and Data Mining, Houston, TX, USA, 2020, pp. 869–872.
[60]
B. Jiang, Z. Zhang, D. Lin, and J. Tang, Graph learning-convolutional networks, arXiv preprint arXiv: 1811.09971, 2018.
[61]
J. Zhao, X. Wang, C. Shi, B. Hu, G. Song, and Y. Ye, Heterogeneous graph structure learning for graph neural networks, in Proc. 35 th AAAI Conf. Artificial Intelligence, Virtual Event, 2021, pp. 4697–4705.
[62]
S. Zhang, Y. Liu, Y. Sun, and N. Shah, Graph-less neural networks: Teaching old MLPs new tricks via distillation, in Proc. 10 th Int. Conf. Learning Representations, https://doi.org/10.48550/arXiv.2110.08727, 2023.
Tsinghua Science and Technology
Pages 1617-1635
Cite this article:
Sang L, Yuan H, Huang Y, et al. Graph Structure Learning for Robust Recommendation. Tsinghua Science and Technology, 2025, 30(4): 1617-1635. https://doi.org/10.26599/TST.2024.9010048

49

Views

5

Downloads

0

Crossref

0

Web of Science

0

Scopus

0

CSCD

Altmetrics

Received: 19 December 2023
Revised: 26 February 2024
Accepted: 01 March 2024
Published: 28 June 2024
© The Author(s) 2025.

The articles published in this open access journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/).

Return