Downloads

https://doi.org/10.62836/iaet.v3i1.213
Gan, Y., & Zhu, D. . (2024). The Research on Intelligent News Advertisement Recommendation Algorithm Based on Prompt Learning in End-to-End Large Language Model Architecture. Innovations in Applied Engineering and Technology, 3(1), 1–19. https://doi.org/10.62836/iaet.v3i1.213
Volume 3, Issue 1

The Research on Intelligent News Advertisement Recommendation Algorithm Based on Prompt Learning in End-to-End Large Language Model Architecture

With the explosive growth of information on the internet, users are increasingly facing the problem of information overload, making precise news and ad recommendations an important area of research. While traditional recommendation algorithms can meet user needs to some extent, they still have limitations in dealing with complex and changing user behaviors and dynamic content environments. This paper addresses the shortcomings of existing news and ad recommendation systems by proposing an intelligent recommendation algorithm based on an end-to-end large language model architecture. Firstly, we utilize the BERT model as the foundation, leveraging its powerful text representation capabilities to achieve deep semantic understanding of news and ad content, thereby capturing more detailed content features. Secondly, we apply prompt learning to fine-tune the BERT model, designing specific prompts for the model to better understand the implicit needs and preferences of users. Finally, we integrate these steps into an end-to-end architecture, enabling the model to achieve automated learning and optimization throughout the entire process from input to output, thus improving the precision and efficiency of recommendations. Experimental results demonstrate that the proposed method significantly outperforms traditional methods in the task of news and ad recommendation, not only enhancing the accuracy and relevance of recommendations but also effectively improving the model's interpretability and flexibility. This research explores new possibilities for the application of large language models in recommendation systems.

Intelligent Recommendation Algorithm; BERT model; Prompt Learning

References

  1. Wu C, Wu F, Huang Y, Xie X. Personalized News Recommendation: Methods and Challenges. ACM Transactions on Information Systems 2023; 41(1): 1–50.
  2. Chen J, et al. When Large Language Models Meet Personalization: Perspectives of Challenges and Opportunities. World Wide Web 2024; 27(4): 42.
  3. Wang M, Zhang H, Zhou N. Star Map Recognition and Matching Based on Deep Triangle Model. Journal of Information, Technology and Policy 2024; 1(1): 1–18.
  4. Ye X, Luo K, Wang H, Zhao Y, Zhang J, Liu A. An Advanced AI–Based Lightweight Two–Stage Underwater Structural Damage Detection Model. Advanced Engineering Informatics 2024; 62: 102553.
  5. Jihu L. Green Supply Chain Management Optimization Based on Chemical Industrial Clusters. arXiv preprint 2024; arXiv:2406.00478.
  6. Chen X, Wang M, Zhang H. Machine Learning–based Fault Prediction and Diagnosis of Brushless Motors. Engineering Advances 2024; 4(3): 130–142.
  7. Wang X, Zhao Y, Wang Z, Hu N. An Ultrafast and Robust Structural Damage Identification Framework Enabled by an Optimized Extreme Learning Machine. Mechanical Systems and Signal Processing 2024; 216: 111509.
  8. Li X, Sun L, Ling M, Peng Y. A Survey of Graph Neural Network Based Recommendation in Social Networks. Neurocomputing 2023; 549: 126441.
  9. Li S, Kou P, Ma M, Yang H, Huang S, Yang Z. Application of Semi–Supervised Learning in Image Classification: Research on Fusion of Labeled and Unlabeled Data. IEEE Access 2024; 12: 27331–27343.
  10. Zhao F, Yu F. Enhancing Multi–Class News Classification through Bert–Augmented Prompt Engineering in Large Language Models: A Novel Approach.In Proceedings of the 10th International Scientific and Practical Conference “Problems and Prospects of Modern Science and Education”, Stockholm, Sweden, 12–15 March 2024.
  11. Wang H, et al. A Dnn–Based Cross–Domain Recommender System for Alleviating Cold–Start Problem in E–Commerce. IEEE Open Journal of the Industrial Electronics Society 2020; 1: 194–206.
  12. Jiang Z, Gao S. An Intelligent Recommendation Approach for Online Advertising Based on Hybrid Deep Neural Network and Parallel Computing. Cluster Computing 2020; 23(3): 1987–2000.
  13. Gao Y, Guo H, Lin D, Zhang Y, Tang R, He X. Content Filtering Enriched GNN Framework for News Recommendation. arXiv preprint 2021; arXiv:2110.12681.
  14. Xiong S, Zhang H. A Multi–model Fusion Strategy for Android Malware Detection Based on Machine Learning Algorithms. Journal of Computer Science Research 2024; 6(2): 1–11.
  15. Xiong S, Chen X, Zhang H, Wang M. Domain Adaptation–Based Deep Learning Framework for Android Malware Detection Across Diverse Distributions. Artificial Intelligence Advances 2024; 6(1): 13–24.
  16. Yuan E, Guo W, He Z, Guo H, Liu C, Tang R. Multi–Behavior Sequential Transformer Recommender. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, 11–15 July 2022.
  17. Hao Y, Chen Z, Jin J, Sun X. Joint Operation Planning of Drivers and Trucks for Semi–Autonomous Truck Platooning. Transportmetrica A: Transport Science 2023; 1–37. DOI: 10.1080/23249935.2023.2266041.
  18. Hao Y, Chen Z, Sun X, Tong L. Planning of Truck Platooning for Road–Network Capacitated Vehicle Routing Problem. arXiv preprint 2024; arXiv:2404.13512.
  19. Ford J, Jain V, Wadhwani K, Gupta DG. AI Advertising: An Overview and Guidelines. Journal of Business Research 2023; 166: 114124.
  20. Xiong S, Zhang H, Wang M. Ensemble Model of Attention Mechanism–Based DCGAN and Autoencoder for Noised OCR Classification. Journal of Electronic & Information Systems 2022; 4(1): 33–41.
  21. Li L, Li Z, Guo F, Yang H, Wei J, Yang Z. Prototype Comparison Convolutional Networks for One–Shot Segmentation. IEEE Access 2024; 12: 54978–54990.
  22. Wang J, et al. Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges. ACM Computing Surveys 2024; 56(7): 1–33.
  23. Qiu Y, Wang J. A Machine Learning Approach to Credit Card Customer Segmentation for Economic Stability. In Proceedings of the 4th International Conference on Economic Management and Big Data Applications, Tianjin, China, 27–29 October 2023.
  24. Qiu Y. Financial Deepening and Economic Growth in Select Emerging Markets with Currency Board Systems: Theory and Evidence. arXiv preprint 2024; arXiv:2406.00472.
  25. Xin X, Pimentel T, Karatzoglou A, Ren P, Christakopoulou K, Ren Z. Rethinking Reinforcement Learning for Recommendation: A Prompt Perspective. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, 11–15 July 2022.
  26. Ye M, Zhou H, Yang H, Hu B, Wang X. Multi–Strategy Improved Dung Beetle Optimization Algorithm and Its Applications. Biomimetics 2024; 9(5): 291.
  27. Chen Z, Fu C, Wu R, Wang Y, Tang X, Liang X. LGFat–RGCN: Faster Attention with Heterogeneous RGCN for Medical ICD Coding Generation. In Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada, 29 October–3 November 2023.
  28. Xu H, Shi C, Fan W, Chen Z. Improving Diversity and Discriminability Based Implicit Contrastive Learning for Unsupervised Domain Adaptation. Applied Intelligence 2024; 54: 10007–10017.
  29. Du S, Chen Z, Wu H, Tang Y, Li Y. Image Recommendation Algorithm Combined with Deep Neural Network Designed for Social Networks. Complexity 2021; 2021(1): 5196190.
  30. Chen Z, Fu C, Tang X. Multi–domain Fake News Detection with Fuzzy Labels. In Proceedings of the DASFAA 2023: The 28th International Conference on Database Systems for Advanced Applications, Tianjin, China, 17–20 April 2023.
  31. Li Y, Liu K, Satapathy R, Wang S, Cambria E. Recent Developments in Recommender Systems: A Survey. IEEE Computational Intelligence Magazine 2024; 19(2): 78–95.
  32. Wang Z, Zhao Y, Song C, Wang X, Li Y. A New Interpretation on Structural Reliability Updating with Adaptive Batch Sampling–Based Subset Simulation. Structural and Multidisciplinary Optimization, 2024; 67(1): 7.
  33. Sharma K, et al. A Survey of Graph Neural Networks for Social Recommender Systems. ACM Computing Surveys 2024; 56(10): 1–34.
  34. Wang Y, Chen Z, Fu C. Synergy Masks of Domain Attribute Model DaBERT: Emotional Tracking on Time–Varying Virtual Space Communication. Sensors 2022; 22(21): 450.
  35. Li B, Ma Y, Liu Y, Gu H, Chen Z, Huang X. Federated Learning on Distributed Graphs Considering Multiple Heterogeneities. In Proceedings of the ICASSP 2024–2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Korea, 14–19 April 2024.
  36. Yang Y, et al. Enhanced Video BERT for Fast Video Advertisement Retrieval. In Proceedings of the 2022 IEEE International Conference on Big Data (Big Data), Osaka, Japan, 17–20 December 2022.
  37. Lu K, Zhang Q, Zhang G, Lu J. BERT–RS: A Neural Personalized Recommender System with BERT. In Proceedings of the Machine Learning, Multi Agent and Cyber Physical Systems: Proceedings of the 15th International FLINS Conference (FLINS 2022), Tianjin, China, 26–28 August 2022.
  38. Karabila I, Darraz N, EL–Ansari A, Alami N, Mallahi M EL. BERT–Enhanced Sentiment Analysis for Personalized E–Commerce Recommendations. Multimedia Tools and Applications 2024; 83(19): 56463–56488.
  39. Li L, Zhang Y, Chen L. Personalized Prompt Learning for Explainable Recommendation. ACM Transactions on Information Systems 2023; 41(4): 1–26.
  40. Jiang Y, Yu X, Wang Y, Xu X, Song X, Maynard D. Similarity–Aware Multimodal Prompt Learning for Fake News Detection. Information Sciences 2023; 647: 119446.
  41. Guo T, Guo S, Wang J. Pfedprompt: Learning Personalized Prompt for Vision–Language Models in Federated Learning. In Proceedings of the ACM Web Conference 2023, Austin, TX, USA, 30 April–4 May 2023.
  42. He C, Li W, Jin Z, Xu C, Wang B, Lin D. Opendatalab: Empowering General Artificial Intelligence with Open Datasets. arXiv preprint 2024; arXiv:2407.13773.
  43. Wu F, et al. Mind: A Large–Scale Dataset for News Recommendation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online Meeting, 5–10July 2020.
  44. Zhang X, Zhao J, LeCun Y. Character–Level Convolutional Networks for Text Classification. Advances in Neural Information Processing Systems 2015; 28: 649–657.
  45. Trischler A, et al. Newsqa: A Machine Comprehension Dataset. arXiv preprint 2016; arXiv:1611.09830.
  46. Azizi A, Momtazi S. SNRBERT: Session–Based News Recommender Using BERT. User Modeling and User–Adapted Interaction 2024; 1–15. DOI: 10.1007/s11257-024-09409-x.
  47. Vo T. An Integrated Topic Modeling and Auto–Encoder for Semantic–Rich Network Embedding and News Recommendation. Neural Computing and Applications 2023; 35(25): 18681–18696.
  48. Suhartono D, Subalie A. Book Recommendation Using Double–Stack BERT: Utilizing BERT to Extract Sentence Relation Feature for a Content–Based Filtering System. In Proceedings of the International Conference on Multi–Disciplinary Trends in Artificial Intelligence, Hyderabad, India, 21–22 July 2023.
  49. Wang S, Guo S, Wang L, Liu T, Xu H. Multi–Interest Extraction Joint with Contrastive Learning for News Recommendation. In Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases 2022, Grenoble, France, 19–23 September 2022.
  50. Dang TK, Nguyen QP, Nguyen VS. A Study of Deep Learning–Based Approaches for Session–Based Recommendation Systems. SN Computer Science 2020; 1(4): 216.
  51. Li Z, Shen Z. Deep Semantic Mining of Big Multimedia Data Advertisements Based on Needs Ontology Construction. Multimedia Tools and Applications 2022; 81(20): 28079–28102.
  52. Y Gu, K Chen. GAN–Based Domain Inference Attack. In Proceedings of the AAAI Conference on Artificial Intelligence, Washington, DC, USA, 13–14 February 2023.
  53. Gu Y, Sharma S, Chen K. November. Image Disguising for Scalable GPU–accelerated Confidential Deep Learning. In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, Copenhagen, Denmark, 26-30 November 2023.
  54. Gu Y, Yan D, Yan S, Jiang Z. Price Forecast with High–Frequency Finance Data: An Autoregressive Recurrent Neural Network Model with Technical Indicators. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management, Virtual Event, 19–23 October 2020.
  55. Chen Z, Fu C, Wu R, Wang Y, Tang X, Liang X. LGFat-RGCN: Faster Attention with Heterogeneous RGCN for Medical ICD Coding Generation. In Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada, 29 October–3 November 2023.
  56. Chen Z, Fu C, Tang X. Multi-domain Fake News Detection with Fuzzy Labels. In Proceedings of the Database Systems for Advanced Applications. DASFAA 2023 International Workshops: BDMS 2023, BDQM 2023, GDMA 2023, BundleRS 2023, Tianjin, China, 17–20 April 2023.
  57. Yin N, Wang M, Chen Z, De Masi G, Xiong H, Gu B. Dynamic Spiking Graph Neural Networks. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 20–27 February 2024.
  58. Su J, et al. GSENet: Global Semantic Enhancement Network for Lane Detection. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 20–27 February 2024.
  59. Su H, et al. Sharpness-Aware Model-Agnostic Long-Tailed Domain Generalization. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 20–27 February 2024.
  60. Lu L, Chen Z, Lu X, Rao Y, Li L, Pang S. Uniads: Universal Architecture-Distiller Search for Distillation Gap. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 20–27 February 2024.
  61. Chen J, et al. Sparse Enhanced Network: An Adversarial Generation Method for Robust Augmentation in Sequential Recommendation. In Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, Vancouver, Canada, 20–27 February 2024.
  62. Wang Y, et al. A Closer Look at Classifier in Adversarial Domain Generalization. In Proceedings of the 31st ACM International Conference on Multimedia, Ottawa, ON, Canada, 29 October–3 November 2023.
  63. Wang M, et al. Joint Adversarial Domain Adaptation with Structural Graph Alignment. IEEE Transactions on Network Science and Engineering 2024; 11(1): 604–612.
  64. Fu C, et al. HAG: Hierarchical Attention with Graph Network for Dialogue Act Classification in Conversation. In Proceedings of the ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 4–10 June 2023.
  65. Gu Y, Sharma S, Chen K. Image Disguising for Scalable GPU-accelerated Confidential Deep Learning. In Proceedings of the 2023 ACM SIGSAC Conference on Computer and Communications Security, Copenhagen, Denmark, 26–30 November 2023.

Supporting Agencies

  1. Funding: Not applicable.