State-of-the-art AI weather models have shown impressive medium-range forecast skill and computational efficiency, but suffer two key shortcomings: their forecasts have lower spatial and temporal resolution than the best physics-based models and they are exclusively initialized with and trained on analysis data. As a result, they cannot directly make use of observations, and any biases in the analysis are inherited by the forecast. WeatherNext 3 addresses these shortcomings and establishes a new state-of-the-art for probabilistic medium-range forecasting skill. First, WeatherNext 3 generates new forecasts every hour (rather than every 6 hours like traditional global models) by ingesting low-latency geostationary satellite data. Second, WeatherNext 3's temporal and spatial resolution are on par with physics-based global models, with hourly time steps and 0.1 degree resolution for single-level variables, including solar radiation and cloud cover. Third, WeatherNext 3 moves beyond traditional analysis variables by learning to predict satellite-derived precipitation estimates, as well as tropical cyclone and station observations. Modelling sparse station data allows WeatherNext 3 to make 2m temperature and dewpoint predictions at any location and time, conditioned on local geographical features, with substantially lower error than competing global models, even when evaluated against unseen stations. Together, WeatherNext 3's capabilities move operational AI-based weather forecasting beyond emulating the traditionally distinct stages of data assimilation, forecasting and post-processing, which helps to further push the frontier of performance and granularity for global weather prediction.
FLOPs2.0725198384000003e+23
Notes: Hardware-based estimate: "In total, both models required approximately 4.8 chip-years on TPUv4 and 8.9 chip-years on TPU7x chips." Assuming FP16 precision and 30% utilization - 1.3e22 FLOP (4.8y on TPUv4) + 2307000000000000 FLOP/s * 86400 seconds/day * 365 days/year * 8.9 years * 0.3 utilization = 1.9425198384e+23 FLOP (8.9y on TPUv7) = 2.0725198384000003e+23 FLOP
Training Code Accessibility"integrated across Search, Gemini, Maps, Google Maps Platform, and Cloud."
Notes: "Generating a single ensemble member forecast takes roughly 6.3 minutes of wall clock time using 4 TPUv5p chips."; can infer that it fits within 4x95GB (memory/TPUv5p) = 380GB of memory; <380B at FP8, <190B at FP16, <95B at FP32.