Utilizing AMD Instinct GPU Accelerators for Weather and Precipitation Forecasting with NeuralGCM
Summary
AMD has detailed how to utilize AMD Instinct GPU Accelerators for weather and precipitation forecasting using NeuralGCM, an innovative hybrid model. NeuralGCM integrates General Circulation Models (GCMs) with Machine Learning (ML) to overcome limitations of both traditional GCMs, which suffer from computationally expensive parameterizations and structural errors, and pure ML models, which often produce overly smooth long-term forecasts and lack uncertainty estimates. The NeuralGCM framework, designed to be fully integrated and differentiable, uses a Learned Encoder and Decoder for data conversion, a JAX-based Dynamical Core to solve primitive equations, and a Learned Physics Module (a Multi Layer Perceptron) to replace traditional parameterizations. Inference on an AMD Instinct MI300X GPU for a 4-day forecast takes 110 seconds for the 0.7° model, 48 seconds for 1.4°, and 33 seconds for 2.8°, with predictions closely matching ERA5 ground truth data.
Key takeaway
For AI Engineers developing weather or climate models, NeuralGCM offers a robust hybrid approach that mitigates the weaknesses of pure GCMs and ML models. You should consider integrating differentiable ML components into physics-based simulations to achieve more stable and accurate long-term predictions, especially when deploying on AMD Instinct GPU Accelerators for optimized performance.
Key insights
NeuralGCM combines GCMs with ML for stable, accurate, and physically consistent weather and precipitation forecasts.
Principles
- Hybrid models integrate physics-based GCMs with ML for enhanced accuracy.
- Differentiable frameworks enable ML to learn within physical laws.
- ML can replace computationally expensive GCM parameterizations.
Method
NeuralGCM employs a Learned Encoder/Decoder for data, a JAX-based Dynamical Core for fluid dynamics, and a Learned Physics Module (MLP) for sub-grid processes, trained online for stability.
In practice
- Run NeuralGCM inference on AMD Instinct GPUs using Docker.
- Utilize pre-trained NeuralGCM checkpoints for various resolutions.
- Compare forecast outputs against ERA5 ground truth data.
Topics
- NeuralGCM
- Weather Forecasting
- AMD Instinct GPUs
- Hybrid AI Models
- General Circulation Models
Code references
Best for: Machine Learning Engineer, AI Engineer, MLOps Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by AMD ROCm Blogs.