Netflix VOID, part 2: a Mac Studio expedition
Summary
An analysis of the Netflix VOID video inpainting model's performance on Apple Silicon, specifically an M4 Max with 128GB unified memory, demonstrates its viability for professional VFX pipelines. The standalone VOID implementation, after specific patches for device detection and output, achieved production-comparable quality in float32, processing 75-frame shots in approximately 18 minutes. This outperformed a community ComfyUI node, which had architectural shortcuts and slower processing. While VOID Pass 1 proved effective, Pass 2 was impractical on Mac due to OOM errors, hardcoded A100 timeouts, and no significant quality improvement without Netflix's proprietary Star upscaler. A surprising finding was that direct Log3G10 input yielded cleaner generations than Rec.709, suggesting better dynamic range preservation. However, VOID is limited to small to medium masks, failing on large masks (e.g., 60% of frame) due to architectural reliance on spatial context.
Key takeaway
For VFX artists or AI engineers evaluating video inpainting solutions on Apple Silicon, Netflix VOID Pass 1 offers production-comparable quality after specific patches. You should prioritize the standalone implementation over community ComfyUI nodes, which are less capable. Be aware that VOID is a precision tool best suited for small to medium masks and requires manual integration into your color pipeline. Consider experimenting with direct Log3G10 input for potentially superior results, challenging the conventional Rec.709 conversion advice.
Key insights
Netflix VOID Pass 1 achieves production-comparable quality on Apple Silicon with specific patches, but has architectural limitations.
Principles
- Community reimplementations may lack core features.
- Log footage can preserve dynamic range for AI models.
- Diffusion inpainting needs sufficient spatial context.
Method
The standalone Netflix VOID workflow on Apple Silicon requires patching device autodetect from CUDA, switching output to 16-bit PNG via OpenCV, and adding un-padding for the temporal VAE.
In practice
- Patch VOID for MPS float32 and 16-bit PNG output.
- Test Log3G10 input for better dynamic range.
- Use VOID for small to medium inpainting masks.
Topics
- Netflix VOID
- Video Inpainting
- Apple Silicon
- VFX Pipeline
- Color Management
- Log3G10
Best for: AI Engineer, Machine Learning Engineer, Computer Vision Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Machine Learning on Medium.