Time-Aware Diffusion based on Preference Disentanglement for Generative Recommendation
Summary
TDPM, a novel Generative Recommender (GR) framework, addresses a critical limitation in existing diffusion-based GRs by integrating time-evolving user preferences into the diffusion process on semantic ID (SID) tokens. While prior diffusion GRs apply uniformly across historical interactions, TDPM disentangles user preference into a long-term consistent "period preference" and a "point preference" triggered by recent events. This approach accounts for the non-stationary, multifaceted nature of user preferences over time. Extensive experiments on three public real-world datasets demonstrate TDPM's significant superiority, achieving average improvements of up to 29.21% in HR@20 and 25.45% in NDCG@20 over leading baselines. An ablation study further confirms the necessity of its time-aware token diffusion mechanism.
Key takeaway
For machine learning engineers developing generative recommendation systems, you should consider incorporating time-aware diffusion mechanisms. Your models can achieve substantial performance gains by disentangling user preferences into long-term "period" and recent "point" components, as demonstrated by TDPM's 29.21% HR@20 improvement. This approach directly addresses the non-stationary nature of user interests, leading to more accurate and relevant recommendations.
Key insights
Time-aware diffusion and preference disentanglement significantly enhance generative recommender performance by modeling evolving user interests.
Principles
- User preferences are non-stationary and time-evolving.
- Disentangling preference into period and point components improves modeling.
- Time-aware diffusion is crucial for generative recommenders.
Method
TDPM designs time-aware diffusion on SID tokens by disentangling user preference into a long-term "period preference" and a "point preference" from recent events, integrating these into the diffusion process.
In practice
- Implement time-aware mechanisms in diffusion models.
- Decompose user preferences into stable and event-driven components.
- Utilize semantic ID tokens for generative recommendation.
Topics
- Generative Recommenders
- Diffusion Models
- Time-Aware Modeling
- Preference Disentanglement
- Semantic IDs
- Recommendation Systems
Code references
Best for: Research Scientist, AI Scientist, Machine Learning Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Takara TLDR - Daily AI Papers.