Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training

· Source: cs.CV updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Software Development & Engineering · Depth: Expert, extended

Summary

A novel framework, Disjoint Parameter Training (DPT) combined with Sparse Merging, addresses "Skill Conflict" in compact, unified prediction and planning models for social robot navigation. Skill Conflict arises when distinct tasks, like predicting neighbor behaviors and ego-centric safety planning, compete for shared parameters in resource-constrained edge devices. DPT mitigates this by separating key parameter regions for each task during fine-tuning using binary masks, ensuring their core capabilities are preserved. Sparse Merging then selectively integrates only the most influential parameters, preventing interference. Evaluated on JRDB and JTA crowd navigation benchmarks, the framework demonstrates superior performance over baselines such as DIPP and DTPP. It also shows broad applicability to other merging methods and extends to end-to-end autonomous driving, achieving an inference latency of 10.4 ms with 6.44M parameters on an NVIDIA RTX 3090.

Key takeaway

For Machine Learning Engineers deploying unified prediction and planning models on resource-constrained edge devices, you should adopt Disjoint Parameter Training (DPT) and Sparse Merging. This approach explicitly mitigates "Skill Conflict" by separating task-specific parameter regions during training and selectively merging only core components, ensuring both accurate prediction and safe planning. Consider integrating a joint reasoning stage for further performance gains.

Key insights

Compact unified models for robot navigation suffer "Skill Conflict" from shared parameters, resolved by DPT and Sparse Merging.

Principles

Method

Disjoint Parameter Training (DPT) fine-tunes task-specific models by distributing parameter learning regions with binary masks. Sparse Merging then integrates only the most salient task-vector components.

In practice

Topics

Best for: Computer Vision Engineer, Research Scientist, AI Scientist, Robotics Engineer, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CV updates on arXiv.org.