Abstract
The goal of session-based recommendation is to make item predictions at the next timestamp based on the anonymous ongoing session. Previous work mainly models user’s preference by exploring the transition pattern between the interacted items in the session. However, they generally fail to pay enough attention to the item importance in terms of the relevance of the items to user’s main purpose. This paper proposes a Session-based Recommendation approach with an Importance Extraction Module, i.e., SR-IEM\(_{{{\text{improved}}}}\), which can simultaneously consider user’s long-term interactions and recent behavior in current session. Specifically, we modify the self-attention mechanism to avoid introducing bias for estimating the importance of each item in the session. Then, the item importances are utilized to produce user’s long-term preference, and the sequential signals are incorporated in the long-term interest modeling. Next, the long-term preference and user’s current interest which is conveyed by the last interacted item in the session are combined to obtain user’s final preference representation. Finally, item predictions are generated using the user preference, where a normalization layer is adopted to solve the long-tail problem. Extensive experiments are conducted on three public benchmark datasets, i.e., Yoochoose 1/64, Yoochoose 1/4 and Diginetica. The experimental results show that SR-IEM\(_{{{\text{improved}}}}\) can outperform the start-of-the-art baselines in terms of Recall and MRR for session-based recommendation. In addition, compared to the state-of-the-art neural methods, SR-IEM\(_{{{\text{improved}}}}\) can obviously reduce the computational complexity.






Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
In [32], it has been proved that the last item can represent user’s instant interest and contribute much to capturing user’s main intent.
References
G. Adomavicius and A. Tuzhilin. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng., 17(6):734–749, 2005. DOI: https://doi.org/10.1109/TKDE.2005.99
Chen W, Cai F, Chen H, de Rijke M (2019) A dynamic co-attention network for session-based recommendation. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 1461–1470. ACM. https://doi.org/10.1145/3357384.3357964
Chen W, Cai F, Chen H, de Rijke M (2019) Joint neural collaborative filtering for recommender systems. ACM Trans. Inf. Syst. 37(4):39–39. https://doi.org/10.1145/3343117
Du G, Zhang J, Luo Z, Ma F, Ma L, Li S (2020) Joint imbalanced classification and feature selection for hospital readmissions. Knowl. Based Syst. 200:106020. https://doi.org/10.1016/j.knosys.2020.106020
He X, Deng K, Wang X, Li Y, Zhang Y, Wang M (2020) Lightgcn: Simplifying and powering graph convolution network for recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in Information Retrieval, pp 639–648. ACM. https://doi.org/10.1145/3397271.3401063
He X, Liao L, Zhang H, Nie L, Hu X, Chua T (2017) Neural collaborative filtering. In: Proceedings of the 26th international conference on world wide web, pp 173–182. ACM. https://doi.org/10.1145/3038912.3052569
Hidasi B, Karatzoglou A, Baltrunas L, Tikk D (2016) Session-based recommendations with recurrent neural networks. In: 4th international conference on learning representations. arxiv:1511.06939
Jin R, Chai J Y, Si L (2004) An automatic weighting scheme for collaborative filtering. In: Proceedings of the 27th annual international ACM SIGIR conference on research and development in Information Retrieval, pp 337–344. ACM. https://doi.org/10.1145/1008992.1009051
Kang W, McAuley J J (2018) Self-attentive sequential recommendation. In: IEEE international conference on data mining, pp 197–206. IEEE Computer Society . https://doi.org/10.1109/ICDM.2018.00035
Kipf T N, Welling M (2017) Semi-supervised classification with graph convolutional networks. In: 5th international conference on learning representations. https://openreview.net/forum?id=SJU4ayYgl
Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD international conference on knowledge discovery and data mining, pp 426–434. ACM. https://doi.org/10.1145/1401890.1401944
Y. Koren, R. M. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. Computer, 42(8), 30–37, 2009. DOI: https://doi.org/10.1109/MC.2009.263
Lee D D, Seung H S (2000) Algorithms for non-negative matrix factorization. In: Proceedings of the international conference on neural information processing systems, pp 556–562. MIT Press. https://proceedings.neurips.cc/paper/2000/hash/f9d1152547c0bde01830b7e8bd60024c-Abstract.html
H. Li, H. Li, S. Zhang, Z. Zhong, and J. Cheng. Intelligent learning system based on personalized recommendation technology. Neural Comput. Appl., 31(9):4455–4462, 2019. DOI: https://doi.org/10.1007/s00521-018-3510-5
Li J, Ren P, Chen Z, Ren Z, Lian T, Ma J (2017) Neural attentive session-based recommendation. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 1419–1428. ACM. https://doi.org/10.1145/3132847.3132926
Linden G, Smith B, York J (2003) Amazon.com recommendations: Item-to-item collaborative filtering. IEEE Internet Comput 7(1):76–80. https://doi.org/10.1109/MIC.2003.1167344
Liu Q, Zeng Y, Mokhosi R, Zhang H (2018) STAMP: short-term attention/memory priority model for session-based recommendation. In: Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pp 1831–1839. ACM. https://doi.org/10.1145/3219819.3219950
Meng W, Yang D, Xiao Y (2020) Incorporating user micro-behaviors and item knowledge into multi-task learning for session-based recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in Information Retrieval, pp 1091–1100. ACM. https://doi.org/10.1145/3397271.3401098
Pan Z, Cai F, Ling Y, de Rijke M (2020) Rethinking item importance in session-based recommendation. In: Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, pp 1837–1840. ACM. https://doi.org/10.1145/3397271.3401274
Qiu R, Li J, Huang Z, Yin H (2019) Rethinking the item order in session-based recommendation with graph neural networks. In: Proceedings of the 28th ACM international conference on information and knowledge management, pp 579–588. ACM. https://doi.org/10.1145/3357384.3358010
L. Ravi, V. Subramaniyaswamy, M. Devarajan, S. Natarajan, and V. Vijayakumar. Enhancing recommendation stability of collaborative filtering recommender system through bio-inspired clustering ensemble method. Neural Comput. Appl., 32(7):2141–2164, 2020. DOI: https://doi.org/10.1007/s00521-018-3891-5
Rendle S, Freudenthaler C, Schmidt-Thieme L (2010) Factorizing personalized markov chains for next-basket recommendation. In: Proceedings of the 19th international conference on world wide web, pp 811–820. ACM. https://doi.org/10.1145/1772690.1772773
Sarwar B. M., Karypis G, Konstan J. A., Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the tenth international world wide web conference, pp 285–295. ACM. https://doi.org/10.1145/371920.372071
Shani G, Heckerman D, Brafman R I (2005) An mdp-based recommender system. J Mach Learn Res 6:1265–1295. http://jmlr.org/papers/v6/shani05a.html
Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, Kaiser L, Polosukhin I (2017) Attention is all you need. In: Proceedings of the international conference on neural information processing systems, pp 5998–6008. MIT Press. https://proceedings.neurips.cc/paper/2017/hash/3f5ee243547dee91fbd053c1c4a845aa-Abstract.html
Vinyals O, Bengio S, Kudlur M (2016) Order matters: sequence to sequence for sets. In: 4th international conference on learning representations . arxiv:1511.06391
Wang F, Xiang X, Cheng J, Yuille A L (2017) Normface: L\({}_{\text{2}}\) hypersphere embedding for face verification. In: Proceedings of the 2017 ACM on multimedia conference, pp 1041–1049. ACM. https://doi.org/10.1145/3123266.3123359
Wang M, Ren P, Mei L, Chen Z, Ma J, de Rijke M (2019) A collaborative session-based recommendation approach with parallel memory modules. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 345–354. ACM. https://doi.org/10.1145/3331184.3331210
Wang X, He X, Wang M, Feng F, Chua T (2019) Neural graph collaborative filtering. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 165–174. ACM. https://doi.org/10.1145/3331184.3331267
Wang Z, Wei W, Cong G, Li X, Mao X, Qiu M (2020) Global context enhanced graph neural networks for session-based recommendation. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in Information Retrieval, pp 169–178. ACM. https://doi.org/10.1145/3397271.3401142
Weston J, Chopra S, Bordes A (2015) Memory networks. In: 3rd international conference on learning representations. arxiv:1410.3916
Wu S, Tang Y, Zhu Y, Wang L, Xie X, Tan T (2019) Session-based recommendation with graph neural networks. In: The thirty-third AAAI conference on artificial intelligence, pp 346–353. AAAI Press. https://doi.org/10.1609/aaai.v33i01.3301346
Xu C, Zhao P, Liu Y, Sheng V S, Xu J, Zhuang F, Fang J, Zhou X (2019) Graph contextualized self-attention network for session-based recommendation. In: Proceedings of the twenty-eighth international joint conference on artificial intelligence, pp 3940–3946. https://doi.org/10.24963/ijcai.2019/547
Ying H, Zhuang F, Zhang F, Liu Y, Xu G, Xie X, Xiong H, Wu J (2018) Sequential recommender system based on hierarchical attention networks. In: Proceedings of the twenty-seventh international joint conference on artificial intelligence, pp 3926–3932. https://doi.org/10.24963/ijcai.2018/546
H. Zhang, Y. Ji, J. Li, and Y. Ye. A triple wing harmonium model for movie recommendation. IEEE Trans. Ind. Informatics, 12(1), 231–239, 2016. DOI: https://doi.org/10.1109/TII.2015.2475218
H. Zhang, Y. Sun, M. Zhao, T. W. S. Chow, and Q. M. J. Wu. Bridging user interest to item content for recommender systems: An optimization model. IEEE Trans. Cybern., 50(10):4268–4280, 2020. DOI: https://doi.org/10.1109/TCYB.2019.2900159
Zhang J, Lin Y, Jiang M, Li S, Tang Y, Tan K C (2020) Multi-label feature selection via global relevance and redundancy optimization. In: Proceedings of the twenty-ninth international joint conference on artificial intelligence, pp 2512–2518. https://doi.org/10.24963/ijcai.2020/348
Zhang S, Tay Y, Yao L, Sun A (2018) Next item recommendation with self-attention. arXiv preprint arXiv:1808.06414
Zhang S, Yao L, Sun A, Tay Y (2019) Deep learning based recommender system: a survey and new perspectives. ACM Comput Surv 52(1):51–53. https://doi.org/10.1145/3285029
Acknowledgements
This work was partially supported by the National Natural Science Foundation of China under No. 61702526 and the Postgraduate Scientific Research Innovation Project of Hunan Province under No. CX20200055. All content represents the opinion of the authors, which is not necessarily shared or endorsed by their respective employers and/or sponsors.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
A preliminary version of this paper has appeared in the proceedings of SIGIR 2020 [19]. Compared to the conference version, we (1) propose a new model SR-IEM\(_{{{\text{improved}}}}\) which extends our previous work on accurately obtaining user’s preference by utilizing the layer normalization to solve the long-tail problem and adding the position embeddings to incorporate the sequential signal; (2) include a large scale dataset Yoochoose 1/4 to conduct additional experiments for verifying the effectiveness of our model; (3) conduct an ablation study for validating the utility of each module in the recommendation approach; (4) give a case study to show how the IEM module works on distinguishing the items according to their corresponding importances; and (5) include more related work and present the analysis of our proposal as well as the experimental results in detail.
Rights and permissions
About this article
Cite this article
Pan, Z., Cai, F., Chen, W. et al. Session-based recommendation with an importance extraction module. Neural Comput & Applic 34, 9813–9829 (2022). https://doi.org/10.1007/s00521-022-06966-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-022-06966-3