Neuro-Symbolic Drive: Rule-Grounded Faithful Reasoning for Driving VLAs
Summary
Neuro-Symbolic Drive introduces a novel neuro-symbolic driving framework to enhance Vision-Language-Action (VLA) models. Current driving VLAs, using Chain-of-Thought reasoning, often lack causally connected rationales for planned motion. This framework addresses this by supervising a driving VLA with rule-grounded reasoning traces extracted directly from classical rule-based planners. The core idea leverages these planners as executable reasoning engines that manage safety constraints and trajectory selection. By instrumenting planners in simulation, Neuro-Symbolic Drive captures executed trajectories and internal decision traces. These traces are serialized into structured rule-grounded reasoning and used to fine-tune Qwen3.5-4B as a driving VLA. This approach structurally couples reasoning to motion generation by design. On a simulator-generated benchmark, it reduced ADE@3s from 0.47 to 0.26 and miss rate from 8.30% to 6.40% with three-camera perception, and from 0.54 to 0.26 and 10.13% to 5.99% with eight-camera perception.
Key takeaway
For Machine Learning Engineers developing autonomous driving systems, integrating neuro-symbolic approaches like Neuro-Symbolic Drive can significantly enhance VLA model reasoning. By leveraging rule-based planners to generate structured, causally connected decision traces, you can achieve more faithful motion generation. Consider instrumenting your existing symbolic planners to create high-quality supervision data, potentially improving metrics like ADE@3s and reducing miss rates in your driving VLAs. This method ensures reasoning is structurally coupled to action, boosting reliability.
Key insights
Rule-grounded reasoning from symbolic planners structurally couples VLA motion generation with faithful decision traces.
Principles
- Rule-based planners function as executable reasoning engines.
- Structural coupling of reasoning and motion is key for VLAs.
- Supervise VLAs with explicit, rule-grounded decision traces.
Method
Instrument classical rule-based planners in simulation to capture executed trajectories and internal decision traces. Serialize these into structured rule-grounded reasoning to fine-tune a driving VLA like Qwen3.5-4B.
In practice
- Integrate symbolic planner outputs for VLA supervision.
- Utilize Qwen3.5-4B for driving VLA fine-tuning.
- Evaluate driving VLAs using ADE@3s and miss rate metrics.
Topics
- Neuro-Symbolic AI
- Autonomous Driving
- Vision-Language-Action Models
- Rule-Based Planners
- Qwen3.5-4B
- Driving Simulation
Code references
Best for: Computer Vision Engineer, Research Scientist, AI Scientist, Machine Learning Engineer, Robotics Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.