From GPS Points to Travel Patterns: Flexible and Semantic Trajectory Generation with LLMs

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics, Robotics & Autonomous Systems · Depth: Advanced, quick

Summary

HTP, a novel model, addresses limitations in urban trajectory generation by hierarchically synthesizing travel patterns before generating GPS points using large language models. Existing methods struggle with privacy concerns and cannot explicitly capture diverse travel patterns or generate flexible-length trajectories under varied conditions. HTP first employs a trajectory-specific residual quantization variational autoencoder (RQ-VAE) to convert micro-level GPS data into macro-level travel pattern tokens, capturing segment spatial irregularities. It then extends an LLM's vocabulary with these tokens and applies supervised fine-tuning to enable conditional generation of travel pattern sequences. Experiments on two real-world datasets demonstrate HTP's effectiveness, outperforming the strongest baseline by an average of 29.78% in generation quality.

Key takeaway

For AI Scientists developing smart city applications, HTP offers a robust solution for generating high-quality, privacy-preserving urban trajectory data. If you are constrained by limited access to real-world datasets due to privacy concerns, consider implementing HTP's hierarchical LLM-based approach. This method allows for flexible, conditional trajectory synthesis, potentially accelerating research and development in urban dynamics modeling without compromising sensitive information.

Key insights

HTP uses LLMs and a hierarchical RQ-VAE to generate realistic urban trajectories by first modeling travel patterns.

Principles

Method

HTP first quantizes micro-level GPS trajectories into macro-level travel pattern tokens using an RQ-VAE. It then extends an LLM's vocabulary with these tokens and applies supervised fine-tuning for conditional sequence generation.

In practice

Topics

Code references

Best for: AI Scientist, Machine Learning Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.