Jibonananda Sanyal and Song Zhang and Jamie Dyer and Andrew Mercer and Philip Amburn and Robert J. Moorhead.
"Noodles: A Tool for Visualization of Numerical Weather Model Ensemble Uncertainty".
In IEEE Transactions on Visualization and Computer Graphics, vol. 16,no. 6, pp. 1421 - 1430 , 2010.

Links:

Abstract:

Numerical weather prediction ensembles are routinely used for operational weather forecasting. The members of these ensembles are individual simulations with either slightly perturbed initial conditions or different model parameterizations, or occasionally both. Multi-member ensemble output is usually large, multivariate, and challenging to interpret interactively. Forecast meteorologists are interested in understanding the uncertainties associated with numerical weather prediction; specifically variability between the ensemble members. Currently, visualization of ensemble members is mostly accomplished through spaghetti plots of a single midtroposphere pressure surface height contour. In order to explore new uncertainty visualization methods, the Weather Research and Forecasting (WRF) model was used to create a 48-hour, 18 member parameterization ensemble of the 13 March 1993 "Superstorm". A tool was designed to interactively explore the ensemble uncertainty of three important weather variables: water-vapor mixing ratio, perturbation potential temperature, and perturbation pressure. Uncertainty was quantified using individual ensemble member standard deviation, inter-quartile range, and the width of the 95% confidence interval. Bootstrapping was employed to overcome the dependence on normality in the uncertainty metrics. A coordinated view of ribbon and glyph-based uncertainty visualization, spaghetti plots, iso-pressure colormaps, and data transect plots was provided to two meteorologists for expert evaluation. They found it useful in assessing uncertainty in the data, especially in finding outliers in the ensemble run and therefore avoiding the WRF parameterizations that lead to these outliers. Additionally, the meteorologists could identify spatial regions where the uncertainty was significantly high, allowing for identification of poorly simulated storm environments and physical interpretation of these model issues.

Summary:

Keywords:

Uncertainty visualization, weather ensemble, geographic/geospatial visualization, glyph-based techniques, time- varying data, qualitative evaluation

Techniques:

Bibtex:

@Article{        sanyal:2010:NTEU,
  author = 	 {Jibonananda Sanyal and Song Zhang and Jamie Dyer and
                  Andrew Mercer and Philip Amburn and Robert
                  J. Moorhead},
  title = 	 {Noodles: A Tool for Visualization of Numerical
                  Weather Model Ensemble Uncertainty},
  journal = 	 {IEEE Transactions on Visualization and Computer
                  Graphics},
  year = 	 {2010},
  volume = 	 {16},
  number = 	 {6},
  pages = 	 {1421 - 1430 },
}

Images:

References:


[1] A. Arakawa and V. Lamb. Computational Design of the Basic Dynamical Processes of the UCLA General Circulation Model. Methods in compu- tational physics, pages 173-256, 1977.
[2] J.Bertin.Semiologyofgraphics.UniversityofWisconsinPress,1983.
[3] BIPM,IEC,IFCC,ISO,IUPAC,IUPAP,OIML.GuidetotheExpression of Uncertainty in Measurement. ISO, Geneva, 1st edition 1993.
[4] BIPM,IEC,IFCC,ISO,IUPAC,IUPAP,OIML.GuidetotheExpression of Uncertainty in Measurement, corrected and reprinted 1995.
[5] S. Blenkinsop, P. Fisher, L. Bastin, and J. Wood. Evaluating the perception of uncertainty in alternative visualization strategies. Cartographica: The International Journal for Geographic Information and Geovisualization, 37(1):1-14, 2000.
[6] D. Borland and R. Taylor II. Rainbow color map (still) considered harmful. IEEE Computer Graphics and Applications, pages 14-17, 2007.
[7] P. Bourke. CONREC: A contouring subroutine. Byte: The Small Systems Journal, 12(6):143-150, 1987.
[8] P.Caplan.The12-14March1993superstorm:PerformanceoftheNMC global medium-range model. Bulletin of the American Meteorological Society, 76(2):201-212, 1995.
[9] H. Couclelis. The certainty of uncertainty: GIS and the limits of geo- graphic knowledge. Transactions in GIS, 7(2):165-175, 2003.
[10] T.DavisandC.Keller.Modellingandvisualizingmultiplespatialuncer- tainties. Computers & Geosciences, 23(4):397-408, 1997.
[11] C. Dey. NCEP Office Note 388-GRIB (Edition 1). Avaliable: ftp://nic. fb4. noaa. gov/pub/nws/nmc/docs/gribed1/(August 24, 1998), 1998.
[12] P. Diggle, P. Heagerty, K. Liang, and S. Zeger. Analysis of longitudinal data. Oxford University Press, USA, 2002.
[13] B. Doty and J. Kinter. The Grid Analysis and Display System (GrADS): a desktop tool for earth science visualization. In American Geophysical Union 1993 Fall Meeting, pages 6-10, 1993.
[14] B. Efron and R. Tibshirani. An introduction to the bootstrap. Chapman & Hall, 1997.
[15] C. R. Ehlschlaeger, A. M. Shortridge, and M. F. Goodchild. Visualizing spatial data uncertainty using animation. Computers & Geosciences, 23(4):387 - 395, 1997. Exploratory Cartograpic Visualisation.
[16] N.Gershon.Visualizationofanimperfectworld.IEEE Computer Graphics and Applications, 18(4):43-45, 1998.
[17] Graham. A COCOA implementation of CONREC. http://www. apptree.net/ conrec.htm/, current March 2010.
[18] M. Harrower and C. Brewer. Colorbrewer. org: an online tool for selecting colour schemes for maps. The Cartographic Journal, 40(1):27-37,2003.
[19] T.Hengl.VisualisationofuncertaintyusingtheHSIcolourmodel:computations with colours. In Proceedings of the 7th International Conference on GeoComputation, pages 8-17, 2003.
[20] T. Hengl and N. Toomanian. Maps are not what they seem: representing uncertainty in soil-property maps. In Proc., 7th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, pages 805-813, 2006.
[21] G.HunterandM.Goodchild. Managing uncertainty in spatial databases: Putting theory into practice. URISA Journal, 5(2):55-62, 1993.
[22] Z. Huo, D. Zhang, and J. Gyakum. An application of potential vorticity inversion to improving the numerical prediction of the March 1993 superstorm. Monthly Weather Review, 126(2), 1998.
[23] B.Jiang,F.Ormeling,andW.Kainz. Visualization support for fuzzy spatial analysis. In Technical Papers: American Congress of Surveying and Mapping; American Society for Photogrammetry and Remote Sensing, page 291, 1995.
[24] P.Kocin,P.Schumacher,R.MoralesJr,andL.Uccellini.Overviewofthe 12-14 March 1993 superstorm. Bulletin of the American Meteorological Society, 76(2):165-182, 1995.
[25] V. Lakshmanan and J. S. Kain. A gaussian mixture model approach to forecast verification. Weather and Forecasting, 25(3):908-920, 2010.
[26] M. Leitner and B. Buttenfield. Guidelines for the display of attribute certainty. Cartography and Geographic Information Science, 27(1):3- 14, 2000.
[27] A. MacEachren. Visualizing uncertain information. Cartographic Perspective, 13(3):10-19, 1992.
[28] A.MacEachren.Howmapswork.GuilfordPressNewYork,1995.
[29] A. MacEachren, C. Brewer, and L. Pickle. Visualizing georeferenced data: representing reliability of health statistics. Environment and Planning A, 30:1547-1562, 1998.
[30] C.Marzban,S.Sandgathe,H.Lyons,and N.Lederer.Three spatial verification techniques: Cluster analysis, variogram, and optical flow. Weather and Forecasting, 24(6):1457-1471, 2009.
[31] G. Mauris, V. Lasserre, and L. Foulloy. A fuzzy approach for the expression of uncertainty in measurement. Measurement, 29(3):165-177,2001.
[32] A. Mercer, C. Shafer, C. Doswell III, L. Leslie, and M. Richman. Objective Classification of Tornadic and Nontornadic Severe Weather Outbreaks. Monthly Weather Review, 137:4355-4368, 2009.
[33] F. Mesinger, G. DiMego, E. Kalnay, K. Mitchell, P. Shafran, W. Ebisuzaki, D. Jovic `, J. Woollen, E. Rogers, E. Berbery, et al. North American regional reanalysis. Bulletin of the American Meteorological
[34] J. Michalakes, J. Dudhia, D. Gill, T. Henderson, J. Klemp, W. Skamarock, and W. Wang. The weather research and forecast model: Software archi- tecture and performance. In Proceedings of the 11th ECMWF Workshop on the Use of High Performance Computing In Meteorology, pages 156- 168, 2004.
[35] C. Olston and J. Mackinlay. Visualizing data with bounded uncertainty. In IEEE Symposium on Information Visualization, 2002. INFOVIS 2002, pages 37-40, 2002.
[36] A. Pang. Visualizing uncertainty in geo-spatial data. In Proceedings of the Workshop on the Intersections between Geospatial Information and Information Technology, 2001.
[37] A. Pang, C. Wittenbrink, and S. Lodha. Approaches to uncertainty visu-alization. The Visual Computer, 13(8):370-390, 1997.
[38] K. Potter, J. Kniss, R. Riesenfeld, and C. R. Johhson. Visualizing summary statistics and uncertainty. In EuroVis 2010, to appear., 2010. [39] K. Potter, A. Wilson, P.-T. Bremer, D. Williams, C. Doutriaux, V. Pascucci, and C. R. Johnson. Ensemble-vis: A framework for the statistical visualization of ensemble data. In ICDMW '09: Proceedings of the 2009 IEEE International Conference on Data Mining Workshops, pages 233- 240, Washington, DC, USA, 2009. IEEE Computer Society.
[40] R. Rew, E. Hartnett, and J. Caron. NetCDF-4: Software implementing an enhanced data model for the geosciences. In 22nd International Con- ference on Interactive Information Processing Systems for Meteorology, Oceanograph, and Hydrology, 2006.
[41] J. Sanyal, S. Zhang, G. Bhattacharya, P. Amburn, and R. Moorhead. A User Study to Compare Four Uncertainty Visualization Methods for 1D and 2D Datasets. IEEE Transactions on Visualization and Computer Graphics, pages 1209-1218, 2009.
[42] D.Schultz,W.Bracken,L.Bosart,G.Hakim,M.Bedrick,M.Dickinson, and K. Tyle. The 1993 superstorm cold surge: Frontal structure, gap flow, and tropical impact. Monthly Weather Review, 125(1):5-39, 1997.
[43] D. Schweizer and M. Goodchild. Data quality and choropleth maps: An experiment with the use of color. In GIS/LIS, volume 2, pages 686-699. American Society for Photogrammetry and Remote Sensing, 1992.
[44] W. Skamarock, J. Klemp, J. Dudhia, D. Gill, D. Barker, W. Wang, and J. Powers. A description of the Advanced Research WRF Version 2. NCAR technical note, 468:88, 2005.
[45] B. Taylor and C. Kuyatt. Guidelines for evaluating and expressing the uncertainty of NIST measurement results. NIST Tech. Note 1297, U.S. Government Printing Office, Washington, D.C, 1994.
[46] The MathWorks. Matlab. Inc., Natick, MA, R2009b.
[47] J. Thomson, E. Hetzler, A. MacEachren, M. Gahegan, and M. Pavel. A typology for visualizing uncertainty. In Proc. SPIE, volume 5669, pages 146-157, 2005.
[48] E.Tufte.EnvisioningInformation,1990.
[49] E. Tufte and G. Howard. The visual display of quantitative information. Graphics Press, Cheshire, CT, 1983.
[50] E. Tufte and E. Weise Moeller. Visual explanations: images and quantities, evidence and narrative. Graphics Press, Cheshire, CT, 1997.
[51] L.Uccellini,P.Kocin,R.Schneider,P.Stokols,andR.Dorr.Forecasting the 12-14 March 1993 superstorm. Bulletin of the American Meteorological Society, 76(2):183-200, 1995.
[52] University of Illinois WW2010 Project. Visible satellite images for the continental United States. http://ww2010.atmos.uiuc.edu/current March 2010.
[53] C.Ware. Information visualization: perception for design.MorganKaufmann, 2004.
[54] F. Warmerdam. Shapefile c library v1. 2. Web site: http://shapelib. map-tools. org/, current March 2006.
[55] S. Wechsler. Perceptions of digital elevation model uncertainty by DEM users. Mark Your Calendar!, 15(2):57, 2003.
[56] L. J. Wilson, W. R. Burrows, and A. Lanzinger. A strategy for verification of weather element forecasts from an ensemble prediction system. Monthly Weather Review, 127(6):956-970, 1999.
[57] C. Wittenbrink, A. Pang, and S. Lodha. Glyphs for visualizing uncerainty in vector fields. IEEE Transactions on Visualization and Computer Graphics, 2(3):266-279, 1996.
[58] T. Zuk and S. Carpendale. Theoretical analysis of uncertainty visualizations. In Proceedings of SPIE, volume 6060, pages 66-79, 2006.