Towards Sustainable Growth: A Multi-Value-Aware Retrieval Framework for E-Commerce Search
Summary
Taobao has deployed GrowthGR, a Multi-Value-Aware retrieval framework for e-commerce search, to address the "Matthew effect" where popular items dominate search results, hindering new item growth. The framework aims to align training objectives with online business metrics and measure an item's growth potential. GrowthGR comprises two main components: an Item Long-term Transaction Value Prediction (ItemLTV) module, which uses counterfactual inference to quantify long-term value from user interactions, and a Multi-Value-Aware Generative Retrieval (MultiGR) module. The MultiGR module, built on a semantic-ID-based generative retrieval architecture, utilizes structured samples with search cascade signals and a Multi-Value-Aware Policy Optimization (MoPO) training paradigm. This balances short-term transactional value with long-term growth potential estimated by ItemLTV. Online deployment on Taobao resulted in a 5.3% lift in new item GMV and a 0.3% gain in overall search GMV.
Key takeaway
For AI Product Managers optimizing e-commerce search, your strategy should integrate mechanisms that explicitly balance immediate conversion with the long-term growth potential of new items. Consider adopting a multi-value-aware framework like GrowthGR to mitigate the "Matthew effect" and achieve significant lifts in new item GMV, ensuring a healthier and more sustainable platform ecosystem.
Key insights
Balancing immediate conversions with long-term item growth is crucial for e-commerce platform sustainability.
Principles
- Counterfactual inference quantifies long-term value.
- Align training with multi-stage online values.
- Generative retrieval can balance short-term and long-term goals.
Method
GrowthGR uses an ItemLTV module for long-term value prediction via counterfactual inference and a MultiGR module with MoPO training to balance short-term transactional value and ItemLTV-estimated long-term growth potential.
In practice
- Implement counterfactual inference for item LTV.
- Use semantic-ID generative retrieval.
- Apply policy optimization for multi-objective alignment.
Topics
- E-commerce Search
- Generative Retrieval
- Cold-Start Problem
- Multi-Value-Aware Policy Optimization
- Item Long-term Transaction Value
Best for: Research Scientist, AI Product Manager, Product Manager, AI Scientist, Machine Learning Engineer, AI Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Takara TLDR - Daily AI Papers.