NCEP Model Performance
March 7, 2016
Posted by: RDA Team
Note: This page was originally sourced from our Blogger page: http://ncarrda.blogspot.com/2016/03/ncep-model-performance.htmlUsers of gridded analysis or forecast data sets may wonder how well do the analyses reflect the measurements that were assimilated into them. Furthermore, how do the forecasts compare to the reality?
Welcome to the world of verification statistics.
If you took all the radiosondes that were ingested into an analysis like GDAS/FNL, then you could compute the mean difference (bias) and the RMSE between the measurements and the analysis for the exact same time. The overall goal is to minimize the biases globally (but allow small biases at individual stations.)
This NCEP EMC site allows you to view some useful statistics for each analysis cycle (00Z, 06Z, 12Z, 18Z). For instance, if you compared the analyses and forecasts from the 18Z analysis/forecast cycle against all upper air measurements, then you see a slight warm bias in the troposphere and a slight cool bias in the stratosphere at Forecast Hour 0 (analysis time).
|18Z analysis cycle GFS temperature bias for forecast hours 0-168, compared to conventional upper air soundings. Operational GFS on the left and experimental GFS on the right.
Let's look at the Root Mean Squared Error (RMSE). Are you amazed that we can forecast the global temperature to within 2.5 degrees 5 days ahead? Or are you young enough to take that for granted?
|18Z analysis cycle GFS temperature RMSE for forecast hours 0-168, compared to conventional upper air soundings. RMSE of GFSX is smaller than GFS (right).
Tweaks like this are common as I explained in Analysis, forecast, reanalysis--what's the difference? If consistent processing is important for your work, always use a reanalysis.
Here's a vertical cross-section of the same verification data, at forecast hour 48. The web site does not offer a 0 hour graph, but the first plot shows that the 48 hour forecast errors are slightly larger than the analysis.
|Bias between upper air stations and the 48-hour GFS forecast.
I hope, in studying these statistics, you agree with me that NWP is a major triumph of human ingenuity and cooperation.
- NCEP EMC Mesoscale Verification Statistics (includes GFS)
- NCEP EMC GFS Verification Statistics (select among 00, 06, 12, 18Z forecast cycles)
- What's the difference between GFS and FNL?
- Analysis, forecast, reanalysis--what's the difference?
- What a difference 6 hours makes