Year
Month
(Preprint) CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation
Xidong Feng ¹, Chen Chen ², Dong Li ², Mengchen Zhao ², Jianye Hao 郝建业 ², Jun Wang 汪军 ¹
¹ University College London
² Noah’s Ark Lab, Huawei
华为诺亚方舟实验室
arXiv, 2021-08-24
Abstract

Practical recommender systems experience a cold-start problem when observed user-item interactions in the history are insufficient. Meta learning, especially gradient based one, can be adopted to tackle this problem by learning initial parameters of the model and thus allowing fast adaptation to a specific task from limited data examples.

Though with significant performance improvement, it commonly suffers from two critical issues: the non-compatibility with mainstream industrial deployment and the heavy computational burdens, both due to the inner-loop gradient operation. These two issues make them hard to be applied in practical recommender systems. To enjoy the benefits of meta learning framework and mitigate these problems, we propose a recommendation framework called Contextual Modulation Meta Learning (CMML).

CMML is composed of fully feed-forward operations so it is computationally efficient and completely compatible with the mainstream industrial deployment. CMML consists of three components, including a context encoder that can generate context embedding to represent a specific task, a hybrid context generator that aggregates specific user-item features with task-level context, and a contextual modulation network, which can modulate the recommendation model to adapt effectively.

We validate our approach on both scenario-specific and user-specific cold-start setting on various real-world datasets, showing CMML can achieve comparable or even better performance with gradient based methods yet with much higher computational efficiency and better interpretability.
CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation_1
CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation_2
CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation_3
CMML: Contextual Modulation Meta Learning for Cold-Start Recommendation_4
  • Soliton microcombs in optical microresonators with perfect spectral envelopes
  • Mulong Liu, Ziqi Wei, Haotong Zhu, Hongwei Wang, Xiao Yu, Xilin Han, Wei Zhao, Guangwei Hu, Peng Xie
  • Opto-Electronic Advances
  • 2025-03-12
  • Terahertz active multi-channel vortices with parity symmetry breaking and near/far field multiplexing based on a dielectric-liquid crystal-plasmonic metadevice
  • Yiming Wang, Fei Fan, Huijun Zhao, Yunyun Ji, Jing Liu, Shengjiang Chang
  • Opto-Electronic Advances
  • 2025-03-06
  • Spin-dependent amplitude and phase modulation with multifold interferences via single-layer diatomic all-silicon metasurfaces
  • Hui Li, Chenhui Zhao, Jie Li, Hang Xu, Wenhui Xu, Qi Tan, Chunyu Song, Yun Shen, Jianquan Yao
  • Opto-Electronic Science
  • 2025-02-19
  • Highly sensitive laser spectroscopy sensing based on a novel four-prong quartz tuning fork
  • Runqiu Wang, Shunda Qiao, Ying He, Yufei Ma
  • Opto-Electronic Advances
  • 2025-01-22
  • A novel approach towards robust construction of physical colors on lithium niobate crystal
  • Quanxin Yang, Menghan Yu, Zhixiang Chen, Siwen Ai, Ulrich Kentsch, Shengqiang Zhou, Yuechen Jia, Feng Chen, Hongliang Liu
  • Opto-Electronic Advances
  • 2025-01-22
  • Multi-photon neuron embedded bionic skin for high-precision complex texture and object reconstruction perception research
  • Hongyu Zhou, Chao Zhang, Hengchang Nong, Junjie Weng, Dongying Wang, Yang Yu, Jianfa Zhang, Chaofan Zhang, Jinran Yu, Zhaojian Zhang, Huan Chen, Zhenrong Zhang, Junbo Yang
  • Opto-Electronic Advances
  • 2025-01-22
  • Single-beam optical trap-based surface-enhanced raman scattering optofluidic molecular fingerprint spectroscopy detection system
  • Ning Sun, Yuan Gan, Yujie Wu, Xing Wang, Shen Shen, Yong Zhu, Jie Zhang
  • Opto-Electronic Advances
  • 2025-01-22
  • High-frequency enhanced ultrafast compressed active photography
  • Yizhao Meng, Yu Lu, Pengfei Zhang, Yi Liu, Fei Yin, Lin Kai, Qing Yang, Feng Chen
  • Opto-Electronic Advances
  • 2025-01-15
  • Efficient generation of vectorial terahertz beams using surface-wave excited metasurfaces
  • Zhuo Wang, Weikang Pan, Yu He, Zhiyan Zhu, Xiangyu Jin, Muhan Liu, Shaojie Ma, Qiong He, Shulin Sun, Lei Zhou
  • Opto-Electronic Science
  • 2025-01-15
  • High-efficiency RGB achromatic liquid crystal diffractive optical elements
  • Yuqiang Ding, Xiaojin Huang, Yongziyan Ma, Yan Li, Shin-Tson Wu
  • Opto-Electronic Advances
  • 2025-01-07
  • On-chip light control of semiconductor optoelectronic devices using integrated metasurfaces
  • Cheng-Long Zheng, Pei-Nan Ni, Yi-Yang Xie, Patrice Genevet
  • Opto-Electronic Advances
  • 2025-01-07
  • Ferroelectric domain engineering of lithium niobate
  • Jackson J. Chakkoria, Aditya Dubey, Arnan Mitchell, Andreas Boes
  • Opto-Electronic Advances
  • 2025-01-03



  • Context-aware Telco Outdoor Localization                                Contrastive Learning of User Behavior Sequence for Context-Aware Document Ranking
    About
    |
    Contact
    |
    Copyright © PubCard