News Recommendation with Gated Linear Attention and Simplified Gated Linear Units

Authors

  • Debiao Yan
  • Jian Sun
  • Jing Huang

DOI:

https://doi.org/10.31449/inf.v48i16.6228

Abstract

As a novel approach, the News Recommendation Algorithm Based on Gated Linear Attention and Simplified Gated Linear Units (NRAGLS) designed to enhance the precision and personalization of digital news dissemination is introduced. At the core of NRAGLS are two advanced techniques: Gated Linear Attention (GLA) and Simplified Gated Linear Units (SGLU), supplemented by tensor normalization to adeptly process and analyze the multifaceted nature of news content and user interactions. This research systematically outlines the development and implementation of the NRAGLS model, emphasizing its capacity to address prevalent challenges within the news recommendation domain, including data sparsity, the dynamic evolution of news content, and the absence of explicit user feedback. Through rigorous experimental validation on the Microsoft News Dataset (MIND) and its variant, MIND-small, the NRAGLS model's performance was benchmarked against four existing recommendation systems. Metrics such as Area Under the Curve (AUC), Mean Reciprocal Rank (MRR), and Normalized Discounted Cumulative Gain (nDCG) were employed to evaluate each model's ability to predict user engagement accurately and to rank news articles effectively. The NRAGLS model demonstrated superior performance across all metrics, highlighting its robustness in handling the complexities of real-world news recommendation scenarios. Furthermore, this paper explores the resilience of the NRAGLS model to data sparsity and its adaptability to the temporal dynamics of user preferences, key factors in sustaining the relevance and effectiveness of recommendation systems. The findings reveal that the NRAGLS model exhibits remarkable consistency in performance, even under varying levels of data omission, and maintains or improves its recommendation accuracy over time.

References

C. Feng, M. Khan, A. U. Rahman and A. Ahmad, News Recommendation Systems - Accomplishments, Challenges & Future Directions. IEEE Access, vol. 8, pp. 16702-16725, 2020.

S. Feng, J. Meng and J. Zhang, News Recommendation Systems in the Era of Information Overload. Journal of Web Engineering, vol. 20, no. 2, pp. 459-470, March 2021.

A. Darvishy, H. Ibrahim, F. Sidi and A. Mustapha, HYPNER: A Hybrid Approach for Personalized News Recommendation. IEEE Access, vol. 8, pp. 46877-46894, 2020

M. Li and L. Wang, A Survey on Personalized News Recommendation Technology. IEEE Access, vol. 7, pp. 145861-145879, 2019.

Z. Zhu, D. Li, J. Liang, G. Liu and H. Yu, A Dynamic Personalized News Recommendation System Based on BAP User Profiling Method. IEEE Access, vol. 6, pp. 41068-41078, 2018.

Z. Yang, L. Cui, X. Wang, T. Zhang and Y. Cheng, MIAR: Interest-Activated News Recommendation by Fusing Multichannel Information. IEEE Transactions on Computational Social Systems, vol. 10, no. 6, pp. 3433-3443, Dec. 2023.

H.-S. Sheu, Z. Chu, D. Qi and S. Li, Knowledge-Guided Article Embedding Refinement for Session-Based News Recommendation. IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 12, pp. 7921-7927, Dec. 2022.

B. Shi, G. Poghosyan, G. Ifrim and N. Hurley, Hashtagger+: Efficient High-Coverage Social Tagging of Streaming News. IEEE Transactions on Knowledge and Data Engineering, vol. 30, no. 1, pp. 43-58, 1 Jan. 2018.

C. Chen, X. Meng, Z. Xu and T. Lukasiewicz, Location-Aware Personalized News Recommendation with Deep Semantic Analysis. IEEE Access, vol. 5, pp. 1624-1638, 2017.

G. D. S. P. Moreira, D. Jannach and A. M. D. Cunha, Contextual Hybrid Session-Based News Recommendation with Recurrent Neural Networks. IEEE Access, vol. 7, pp. 169185-169203, 2019.

M. He, X. Wu, J. Zhang and R. Dong, UP-TreeRec: Building dynamic user profiles tree for news recommendation. China Communications, vol. 16, no. 4, pp. 219-233, April 2019.

Y. Zhou, J. Wu, T. H. Chan, S. -W. Ho, D. -M. Chiu and D. Wu, Interpreting Video Recommendation Mechanisms by Mining View Count Traces. IEEE Transactions on Multimedia, vol. 20, no. 8, pp. 2153-2165, Aug. 2018.

H. Aboutorab, O. K. Hussain, M. Saberi, F. K. Hussain and D. Prior, Reinforcement Learning-Based News Recommendation System. IEEE Transactions on Services Computing, vol. 16, no. 6, pp. 4493-4502, Nov.-Dec. 2023.

V. Kumar, D. Khattar, S. Gupta and V. Varma, Word Semantics Based 3-D Convolutional Neural Networks for News Recommendation. 2017 IEEE International Conference on Data Mining Workshops (ICDMW), New Orleans, LA, USA, 2017, pp. 761-764.

S. Yang, H. Wang, C. Zhang and Y. Gao, Contextual Bandits with Hidden Features to Online Recommendation via Sparse Interactions. IEEE Intelligent Systems, vol. 35, no. 5, pp. 62-72, 1 Sept.-Oct. 2020.

X. Xue, S. Huangfu, L. Zhang and S. Wang, Research on Escaping the Big-Data Traps in O2O Service Recommendation Strategy. IEEE Transactions on Big Data, vol. 7, no. 1, pp. 199-213, 1 March 2021.

S. Bangari, S. Nayak, L. Patel and K. T. Rashmi, A Review on Reinforcement Learning based News Recommendation Systems and its challenges. 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), Coimbatore, India, 2021, pp. 260-265.

B. Dellal-Hedjazi and Z. Alimazighi, Deep learning for recommendation systems. 2020 6th IEEE Congress on Information Science and Technology (CiSt), Agadir - Essaouira, Morocco, 2020, pp. 90-97.

S. Cui, Z. Yang, H. Wan and H. Liu, AGLGCN: Graph Convolution Recommendation Algorithm based on Multi-Head Attention and Gated Recurrent Unit. 2022 2nd International Conference on Algorithms, High Performance Computing and Artificial Intelligence (AHPCAI), Guangzhou, China, 2022, pp. 170-175.

S. Elfwing, E. Uchibe, K. Doy, Sigmoid-weighted linear units for neural network function approximation in reinforcement learning. Neural Networks, 2018, 107:3-11.

X. Wu, Y. Fan, J. Zhang and Z. Gao, Federated Latent Dirichlet Allocation for User Preference Mining. Journal of Web Engineering, vol. 22, no. 4, pp. 639-677, June 2023.

W. Zhang, X. Zhang, H. Wang, D. Chen, A deep variational matrix factorization method for recommendation on large scale sparse dataset. Neurocomputing, 2019, 334:206-218.

L. Zhang, P. Liu and J. A. Gulla, Dynamic attention-integrated neural network for session-based news recommendation. Machine Learning, 2019, 108:1851-1875.

K. Cheng, X. Guo, X. Cui, and F. Shan, Dynamical Modeling, Analysis, and Control of Information Diffusion over Social Networks: A Deep Learning-Based Recommendation Algorithm in Social Network. Discrete Dynamics in Nature and Society, vol. 2020, Article ID 3273451, 8 pages, 2020.

C. Wu, J. Wang, J. Liu, W. Liu, Recurrent neural network-based recommendation for time heterogeneous feedback. Knowledge-Based Systems, 2016, 109:90-103.

S. Liu, Y. Dong and J. Chai, Research of personalized news recommendation system based on hybrid collaborative filtering algorithm. 2016 2nd IEEE International Conference on Computer and Communications (ICCC), Chengdu, 2016, pp. 865-869.

Y. Zhang et al., DCDN: Estimating Handover Parameter Adjusting Effect with Causal Inference. 2023 IEEE 98th Vehicular Technology Conference (VTC2023-Fall), Hong Kong, Hong Kong, 2023, pp. 1-5.

Downloads

Published

2024-10-02

How to Cite

Yan, D., Sun, J., & Huang, J. (2024). News Recommendation with Gated Linear Attention and Simplified Gated Linear Units. Informatica, 48(16). https://doi.org/10.31449/inf.v48i16.6228

Issue

Vol. 48 No. 16 (2024): Online-only issue

Section

Online-only

License

I assign to Informatica, An International Journal of Computing and Informatics ("Journal") the copyright in the manuscript identified above and any additional material (figures, tables, illustrations, software or other information intended for publication) submitted as part of or as a supplement to the manuscript ("Paper") in all forms and media throughout the world, in all languages, for the full term of copyright, effective when and if the article is accepted for publication. This transfer includes the right to reproduce and/or to distribute the Paper to other journals or digital libraries in electronic and online forms and systems.

I understand that I retain the rights to use the pre-prints, off-prints, accepted manuscript and published journal Paper for personal use, scholarly purposes and internal institutional use.

In certain cases, I can ask for retaining the publishing rights of the Paper. The Journal can permit or deny the request for publishing rights, to which I fully agree.

I declare that the submitted Paper is original, has been written by the stated authors and has not been published elsewhere nor is currently being considered for publication by any other journal and will not be submitted for such review while under review by this Journal.  The Paper contains no material that violates proprietary rights of any other person or entity. I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in my article. I have informed the co-author(s) of the terms of this publishing agreement.


Copyright ©  Slovenian Society Informatika