ORBIT-2 based Weather and Climate Downscaling and Downscaled Global Forecasts on AMD Instinct

· Source: AMD ROCm Blogs · Field: Science & Research — Environmental Science & Earth Systems, Artificial Intelligence & Machine Learning · Depth: Advanced, long

Summary

The article details ORBIT-2, an open-source global climate downscaling foundation model developed by Oak Ridge National Laboratory and AMD, demonstrating its inference capabilities on AMD Instinct GPUs. ORBIT-2 utilizes a novel Reslim architecture and the TILES algorithm to achieve high-resolution weather variable predictions, such as global precipitation, from lower-resolution inputs. It supports downscaling from 1.0° to 0.25° resolution, achieving R² scores of 0.98–0.99 against observational data. The model exhibits impressive computational benchmarks, scaling to 10 billion parameters across 65,536 GPUs with up to 4.1 exaFLOPS throughput. A proof-of-concept also shows ORBIT-2 chaining with GenCast forecasts to produce high-resolution global precipitation predictions.

Key takeaway

For Machine Learning Engineers developing high-resolution weather models, ORBIT-2 offers a validated, efficient downscaling solution on AMD Instinct GPUs. You should consider integrating ORBIT-2 to enhance existing lower-resolution global forecasts, leveraging its Reslim architecture and TILES algorithm for superior spatial detail and computational performance. This approach can significantly improve severe weather event prediction capabilities.

Key insights

ORBIT-2 downscales global weather data to high resolution efficiently on AMD GPUs using a novel transformer architecture.

Principles

Method

ORBIT-2 uses a Reslim (Residual Slim Visual Transformer) architecture with the TILES algorithm to process adaptively compressed low-resolution inputs and reconstruct high-resolution outputs, leveraging data, tensor, and fully sharded model parallelism.

In practice

Topics

Code references

Best for: AI Scientist, Machine Learning Engineer, Research Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by AMD ROCm Blogs.