From Clicks to Intent: Cross-Platform Session Embeddings with LLM-Distilled Taxonomy for Financial Services Recommendations
Summary
A new intent prediction framework addresses the challenge of integrating pre-login web interactions with authenticated in-app experiences for financial services recommendations. This approach tackles the underutilization of web-based intent signals for post-authentication personalization, a common issue due to cross-channel entity resolution difficulties. The framework transforms raw web clickstreams into two outputs: a self-supervised Transformer generates compact session embeddings from multi-modal clickstreams, while an LLM-based taxonomy pipeline distills interpretable intent labels. This dual-purpose system demonstrates significant performance gains in production. On mobile homepage tile ranking, the session embedding improves macro Recall@1 by 1.88% and reduces Log Loss by 13.38% compared to production baselines. For user conversion prediction, the embedding achieves a 4.3% higher micro F1 score than LLM labels, with the distillation layer providing interpretable labels at ultra-low latency with only a 7% performance drop.
Key takeaway
For Machine Learning Engineers building financial services recommender systems, integrating cross-platform intent signals is crucial for enhanced personalization. You should consider adopting a dual-purpose framework that combines self-supervised session embeddings with LLM-distilled taxonomies to bridge pre-login web and in-app experiences. This approach can significantly improve metrics like Recall@1 and micro F1, while also providing interpretable intent labels for better qualitative understanding of user behavior.
Key insights
The framework combines self-supervised session embeddings with LLM-distilled taxonomies for cross-platform financial service recommendations, improving both quantitative and qualitative understanding.
Principles
- Cross-channel intent signals enhance personalization.
- Dual-purpose models serve quantitative and qualitative tasks.
- LLM distillation provides interpretable labels efficiently.
Method
The method involves a self-supervised Transformer encoding multi-modal clickstreams into session embeddings, alongside an LLM-based pipeline for taxonomy generation and distillation to produce interpretable intent labels from raw web clickstreams.
In practice
- Improve mobile homepage tile ranking.
- Enhance user conversion prediction.
- Generate interpretable intent labels for analysis.
Topics
- Financial Services
- Recommender Systems
- Session Embeddings
- LLM Taxonomy Distillation
- Cross-Platform Personalization
- Clickstream Analysis
Best for: AI Engineer, AI Scientist, Research Scientist, Machine Learning Engineer, NLP Engineer, Data Scientist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.