Journal of Guangxi Normal University(Natural Science Edition) ›› 2022, Vol. 40 ›› Issue (3): 151-160.doi: 10.16088/j.issn.1001-6600.2021071405

Previous Articles     Next Articles

Research on Graph Neural Network Recommendation Algorithms for Reinforcing Current Interest

KONG Yayu1+, LU Yujie1+, SUN Zhongtian2, XIAO Jingxian1, HOU Haochen1, CHEN Tingwei1*   

  1. 1. College of Information, Liaoning University, Shenyang Liaoning 110036, China;
    2. Durham University, Durham, DH1 3LE, UK
  • Received:2021-07-14 Revised:2021-09-09 Online:2022-05-25 Published:2022-05-27

Abstract: Compared with traditional sequence modeling in session-based recommendation, modeling the session sequence as a graph structure performs better in this field. However, the existing research methods are limited in their ability to capture user’s current interest by only using the graph structure to mine the session characteristics between items. A current interest reinforced Graph neural network for session-based recommendation is proposed in the paper. By introducing position embedding and combining with graph neural network, the advantages of sequential perception model and graph perception model are complemented. The session sequence is modeled as a graph structure. Take the last click of the original sequence, and calculate its attention weight for graph node information through the multi-head attention mechanism, so as to obtain user’s current interest expression more accurately. Extensive experiments on two real-world datasets show that, the proposed method achieved the best performance of all methods, especially on the Diginetica data set, all evaluation indicators have increased by more than 7%, and the MRR@10 indicator has even increased by 9.52%. These results show the correctness and effectiveness of the proposed method for session-based recommendation.

Key words: session-based recommendation, session graph, graph neural network, multi-head attention, position embedding

CLC Number: 

  • TP391.3
[1]SARWAR B, KARYPIS G, KONSTAN J, et al. Item-based collaborative filtering recommendation algorithms[C]// Proceedings of the 10th International Conference on World Wide Web. New York: ACM, 2001: 285-295.
[2]SHANI G, HECKERMAN D, BRAFMAN R I. An MDP-based recommender system[J]. Journal of Machine Learning Research, 2005, 6:1265-1295.
[3]TAN Y K, XU X X, LIU Y. Improved recurrent neural networks for session-based recommendations[C]// Proceedings of the 1st Workshop on Deep Learning for Recommender Systems. New York: ACM, 2016: 17-22.
[4]祁明明,马文明,单荣杰.基于循环神经网络的旅游地点推荐系统设计与实现[J].电子技术与软件工程,2020(1):184-185.
[5]纪强. 基于循环神经网络的深度推荐模型研究[D].合肥:安徽大学,2020.
[6]LIU Q, ZENG Y F, MOKHOSIR, et al. STAMP: short-term attention/memory priority model for session-based recommendation[C]// Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. New York: ACM, 2018: 1831-1839.
[7]SCARSELLI F, GORI M, TSOI A C, et al. The graph neural network model[J]. IEEE Transactions on Neural Networks, 2009, 20(1): 61-80.
[8]WU S, TANG Y Y, ZHU Y Q, et al. Session-based recommendation with graph neural networks[C]// Proceedings of the AAAI Conference on Artificial Intelligence. California: AAAI, 2019: 346-353.
[9]LI Y J, ZEMEL R, BROCKSCHMIDT M, et al. Gated graph sequence neural networks[EB/OL].(2016-05-03)[2021-09-09].https://www.microsoft.com/en-us/research/wp-content/uploads/2015/11/1511.05493.pdf.
[10]XU C F, ZHAO P P, LIU Y C, et al. Graph contextualized self-attention network for session-based recommendation[C]// Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. California: IJCAI, 2019: 3940-3946.
[11]RENDLE S, FREUDENTHALER C, GANTNER Z. BPR: Bayesian personalized ranking from implicit feedback[C]// Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence. New York: ACM, 2009:452-461.
[12]RENDLE S, FREUDENTHALER C, SCHMIDT-THIEME L. Factorizing personalized markov chains for next-basket recommendation[C]// Proceedings of the 19th International Conference on World wide web. New York: ACM, 2010: 811-820.
[13]HIDASI B, KARATZOGLOU A, BALTRUNAS L, et al. Session-based recommendations with recurrent neural networks[EB/OL].(2016-03-29)[2021-09-09]. https://arxiv.org/abs/1511.06939.
[14]ZHANG Y Y, DAI H J, XU C,et al. Sequential click prediction for sponsored search with recurrent neural networks[C]// Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence. New York: ACM, 2014:1369-1375.
[15]LI J, REN P J, CHEN Z M, et al. Neural attentive session-based recommendation[C]// Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. New York: ACM, 2017: 1419-1428.
[16]WANG P F, GUO J F, LAN Y Y, et al. Learning hierarchical representation model for next basket recommendation[C]// Proceedings of the 38th International ACM SIGIR conference on Research and Development in Information Retrieval. New York: ACM, 2015: 403-412.
[17]YANARDAG P, VISHWANATHAN S V N. Deep graph kernels[C]// Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New York: ACM, 2015: 1365-1374.
[18]MICHELI A. Neural network for graphs: a contextual constructive approach[J]. IEEE Transactions on Neural Networks, 2009, 20(3): 498-511.
[19]YU F, ZHU Y Q, LIUQ, et al. TAGNN: target attentive graph neural networks for session-based recommendation[C]// Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM,2020:1921-1924.
[20]CHEN T W, WONG R C W. Handling information loss of graph neural networks for session-based recommendation[C]// Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. New York: ACM, 2020: 1172-1180.
[21]孙鑫,刘学军,李斌,等.基于图神经网络和时间注意力的会话序列推荐[J].计算机工程与设计,2020,41(10): 2913-2920.
[22]南宁,杨程屹,武志昊.基于多图神经网络的会话感知推荐模型[J].计算机应用,2021,41(2):330-336.
[23]任俊伟,曾诚,肖丝雨,等.基于会话的多粒度图神经网络推荐模型[J].计算机应用,2021,41(11):3164-3170.
[24]KANG W C, MCAULEY J L. Self-attentive sequential recommendation[C]// 2018 IEEE International Conference on Data Mining(ICDM). Piscataway,NJ:IEEE, 2018: 197-206.
[25]JI W D, WANG K Q, WANG X L, et al. Hybrid sequential recommender via time-aware attentive memory network[EB/OL].(2020-05-18)[2021-09-09]. https://arxiv.org/pdf/2005.08598v1.
[1] WU Jun, OUYANG Aijia, ZHANG Lin. Phosphorylation Site Prediction Model Based on Multi-head Attention Mechanism [J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(3): 161-171.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] AI Yan, JIA Nan, WANG Yuan, GUO Jing, PAN Dongdong. Review of Statistical Methods and Applications of Genetic Association Analysis for Multiple Traits and Multiple Locus[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(1): 1 -14 .
[2] BAI Defa, XU Xin, WANG Guochang. Review of Generalized Linear Models and Classification for Functional Data[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(1): 15 -29 .
[3] ZENG Qingfan, QIN Yongsong, LI Yufang. Empirical Likelihood Inference for a Class of Spatial Panel Data Models[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(1): 30 -42 .
[4] ZHANG Zhifei, DUAN Qian, LIU Naijia, HUANG Lei. High-dimensional Nonlinear Regression Model Based on JMI[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(1): 43 -56 .
[5] YANG Di, FANG Yangxin, ZHOU Yan. New Category Classification Research Based on MEB and SVM Methods[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(1): 57 -67 .
[6] CHEN Zhongxiu, ZHANG Xingfa, XIONG Qiang, SONG Zefang. Estimation and Test for Asymmetric DAR Model[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(1): 68 -81 .
[7] DU Jinfeng, WANG Hairong, LIANG Huan, WANG Dong. Progress of Cross-modal Retrieval Methods Based on Representation Learning[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(3): 1 -12 .
[8] LI Muhang, HAN Meng, CHEN Zhiqiang, WU Hongxin, ZHANG Xilong. Survey of Algorithms Oriented to Complex High Utility Pattern Mining[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(3): 13 -30 .
[9] CHAO Rui, ZHANG Kunli, WANG Jiajia, HU Bin, ZHANG Weicong, HAN Yingjie, ZAN Hongying. Construction of Chinese Multimodal Knowledge Base[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(3): 31 -39 .
[10] LI Zhengguang, CHEN Heng, LIN Hongfei. Identification of Adverse Drug Reaction on Social Media Using Bi-directional Language Model[J]. Journal of Guangxi Normal University(Natural Science Edition), 2022, 40(3): 40 -48 .