CRIS: Cross-Plane Self-Supervised Isotropic Restoration for Anisotropic Volumetric Imaging Across Modalities

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Medical Imaging · Depth: Expert, quick

Summary

CRIS, a cross-plane self-supervised framework, addresses the challenge of anisotropic volumetric imaging in clinical MRI and volume electron microscopy (vEM) by restoring isotropic resolution without requiring paired isotropic ground truth. Anisotropic acquisitions, common in these modalities, produce thick slices that degrade orthogonal reformats. CRIS frames 3D restoration as 2D stripe completion on orthogonal reformats of an isotropic grid, synthetically degrading and masking high-resolution in-plane slices for training, then fusing predictions via multi-view averaging during inference. Evaluated on two MRI cohorts and two microscopy benchmarks up to 8x anisotropy, CRIS achieved 32.921 +/- 0.436 dB PSNR and 0.9631 +/- 0.0027 SSIM on brain MRI, outperforming several existing methods. It also reduced FID/KID to 48.714/0.023 on abdominal MRI and demonstrated superior performance on vEM benchmarks, reaching 29.133 dB/0.834 3D PSNR/SSIM at 4x. The framework is modality-flexible and avoids configuration-specific retraining.

Key takeaway

For Machine Learning Engineers developing medical imaging or microscopy pipelines, CRIS offers a robust solution for isotropic restoration of anisotropic volumetric data. You can achieve superior image quality and segmentation consistency, as demonstrated by 32.921 dB PSNR on brain MRI, without needing paired isotropic ground truth or extensive retraining. Consider integrating CRIS to enhance downstream analysis and improve diagnostic accuracy across diverse modalities.

Key insights

CRIS enables isotropic volumetric image restoration using a self-supervised, cross-plane approach without paired ground truth.

Principles

Method

CRIS casts 3D restoration as 2D stripe completion on orthogonal reformats. It synthetically degrades and masks in-plane slices for training, then restores two orthogonal reformats and fuses predictions by multi-view averaging.

In practice

Topics

Code references

Best for: Computer Vision Engineer, AI Scientist, Machine Learning Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.