Pre-VLA: Preemptive Runtime Verification for Reliable Vision-Language-Action and World-Model Rollouts

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Computer Vision & Pattern Recognition · Depth: Expert, quick

Summary

Pre-VLA is a unified runtime verification architecture designed to enhance the reliability of large vision-language-action (VLA) models and generative world models (WM) by preemptively assessing action validity. It addresses the uncertainty in learning-based action generation that often leads to physical failures or misleading WM rollouts. Pre-VLA employs an efficient multimodal backbone with modality-aware pooling and a lightweight dual-branch head to predict safety confidence and advantage scores for action chunks. The system is trained using a multi-task objective combining Focal classification, advantage regression, and soft-threshold calibration to manage class imbalance. During deployment, a dual-mode preemptive resampling scheduler filters low-quality actions and adaptively resamples within a computation budget. Experiments on the LIBERO benchmark demonstrate that Pre-VLA improves the average closed-loop success rate from 30.79% to 37.62% over RynnVLA-002, reduces task execution steps, and achieves a 183.9 ms average forward verification time per action chunk.

Key takeaway

For Machine Learning Engineers deploying vision-language-action (VLA) or world models, Pre-VLA offers a robust approach to enhance system reliability. You should consider integrating preemptive action validity assessment to mitigate physical failures and reduce error accumulation in rollouts. This method improves closed-loop success rates, as demonstrated by a 37.62% success rate on LIBERO, and maintains efficient verification times at 183.9 ms per action chunk, optimizing computational budgets.

Key insights

Pre-VLA preemptively verifies VLA model actions to improve reliability and reduce errors in embodied intelligence and world-model rollouts.

Principles

Method

Pre-VLA uses a multimodal backbone and dual-branch head to predict safety and advantage scores. It trains with Focal classification, advantage regression, and soft-threshold calibration, then deploys a resampling scheduler to filter and adaptively resample actions.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, Robotics Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.