Presentation: Dynamic Moments: Weaving LLMs into Deep Personalization at DoorDash
Summary
DoorDash is transforming its personalization strategy from static merchandising to dynamic, moment-aware experiences using a hybrid approach that combines Large Language Models (LLMs) with traditional deep learning. This shift addresses the challenges of abundance in its massive catalog and rapidly changing user intent across diverse offerings like groceries, convenience, and electronics. LLMs are employed to generate natural-language "consumer profiles" and content blueprints, leveraging their world knowledge and ability to understand in-session intent. Traditional deep learning models, such as two-tower embeddings and multi-task deep learning, handle last-mile ranking and real-time inventory adjustments. This architecture enables DoorDash to adapt to short-lived user needs, like Black Friday deals or late-night snack cravings, by blending offline LLM-generated content with online, real-time signal processing for hyper-personalized user experiences.
Key takeaway
For AI Architects and Machine Learning Engineers building large-scale recommendation systems, you should integrate LLMs for high-level content ideation and user profiling, while retaining traditional deep learning for efficient, low-latency last-mile ranking and real-time inventory management. This hybrid strategy allows for dynamic, context-aware personalization without incurring excessive costs or latency, ensuring your system can adapt to rapidly changing user intent and diverse product catalogs effectively.
Key insights
DoorDash combines LLMs and deep learning for dynamic, moment-aware personalization, generating profiles and content blueprints while optimizing real-time ranking.
Principles
- Blend LLM world knowledge with classic ML for enhanced personalization.
- Represent consumer profiles as natural language narratives for expressiveness.
- Optimize compound AI systems using reward functions and human feedback.
Method
DoorDash's method involves LLMs for product understanding and consumer profile generation, followed by traditional ML for item retrieval and last-mile ranking, blending offline content generation with online real-time adjustments.
In practice
- Use LLMs for product feature extraction and small merchant onboarding.
- Generate natural language consumer profiles for shared use across features.
- Employ GEPA with LLM-as-a-judge and human feedback for system optimization.
Topics
- Hyper-Personalization
- Large Language Models
- Consumer Profiles
- Dynamic Moments
- Deep Learning Ranking
Best for: AI Engineer, Machine Learning Engineer, AI Architect
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by InfoQ.