Developing reliable methods for representing and managing information uncertainty remains a persistent and relevant challenge to GIScience. Information uncertainty is an intricate idea, and recent examinations of this concept have generated many perspectives on its representation and visualization, with perspectives emerging from a wide range of disciplines and application contexts. In this paper, we review and assess progress toward visual tools and methods to help analysts manage and understand information uncertainty. Specifically, we report on efforts to conceptualize uncertainty, decision making with uncertainty, frameworks for representing uncertainty, visual representation and user control of displays of information uncertainty, and evaluative efforts to assess the use and usability of visual displays of uncertainty. We conclude by identifying seven key research challenges in visualizing information uncertainty, particularly as it applies to decision making and analysis.
Uncertainty, geovisualization, representation, decision making, usability
@Article{ maceachren:2005:VGIU,
author = "Alan M. MacEachren and Anthony Robinson and Susan
Hopper and Steven Gardner and Robert Murray and Mark
Gahegan and Elisabeth Hetzler",
title = "Visualizing Geospatial Information Uncertainty: What
We Know and What We Need to Know",
journal = "Cartography and Geographic Information Science",
volume = "32",
number = "3",
pages = "139--160",
month = "July",
year = "2005",
}
Aerts, J. C. J. H., K. C. Clarke, and A. D. Keuper. 2003. Testing popular visualization techniques for representing model uncertainty. Cartography and Geographic Information Science 30(3): 249-61.
Agumya, A., and G. J. Hunter. 2002. Responding to the consequences of uncertainty in geographical data. International Journal of Geographical Information Science 16(5): 405-17.
Bastin, L., P. F. Fisher, and J. Wood. 2002. Visualizing uncertainty in multi-spectral remotely sensed imagery. Computers & Geosciences, 28: 337-50.
Beard, K., and W. Mackaness. 1993. Visual access to data quality in geographic information systems. Cartographica 30(2): 37-45.
Bedard, Y. 1987. Uncertainties in land information databases. In: Proceedings, Auto-Carto 8. Baltimore, ACSM. pp. 175-84.
Bertin, J. 1983. Semiology of graphics: Diagrams, networks, maps. (Translation from a French 1967 edition by W.
Berg, editor). Madison, WI: University of Wisconsin Press.
Blenkinsop, S., P. Fisher, L. Bastin, and J. Wood. 2000. Evaluating the perception of uncertainty in alternative visualization strategies. Cartographica 37(1): 1-13.
Buttenfield, B. P. 1991. Visualizing cartographic matadata. Working paper prepared for the NCGIA Specialist Meeting: Initiative 7, Visualization of the Data Quality, Orono, Maine.
Buttenfield, B. P. 1993. Representing data quality. Cartographica (special content, Mapping Data Quality) 30(2&3): 1-7.
Buttenfield, B. P., and M. K. Beard. 1994. Graphical and geographical components of data quality. In: D. Unwin and H. Hearnshaw (eds), Visualization in geographic Information Systems. London, U.K.: John Wiley & Sons. pp. 150-7.
Buttenfield, B. P., and R. Weibel. 1988. Visualizing the quality of cartographic data. Presented at Third International Geographic Information Systems Symposium (GIS/LIS 88), San Antonio, Texas.
Cedilnik, A., and P. Rheingans. 2000. Procedural annotation of uncertain information. In: Visualization 2000 Proceedings. IEEE, New York, New York. pp. 77-84, 542.
Chrisman, N. R. 1991. The error component in spatial data. In: D. J. Maguire, M. F. Goodchild, and D. W. Rhind (eds), Geographical information systems. London, U.K.: Longman. Vol. 1, Chapter 12, pp. 165-74.
Cliburn, D. C., J. J. Feddema, J. R. Miller, and T. A. Slocum. 2002. Design and evaluation of a decision support system in a water balance application. Computers & Graphics (UK) 26(6): 931-49.
Cohen, B. L., and T. S. Wallsten. 1992. The effect of constant outcome value on judgments and decision making given linguistic probabilities. Journal of Behavioral Decision Making 1(5): 53-72.
Couclelis, H. 2003. The certainty of uncertainty: GIS and the limits of geographic knowledge. Transactions in GIS 7(2): 165-75.
Crampton, J. 1992. A cognitive analysis of wayfinding expertise. Cartographica 29(3/4): 46-65.
Davis, J. 2002. Improving CIA Analytic Performance: Strategic Warning: Sherman Kent Center for Intelligence Analysis. [http://www.au.af.mil/au/awc/ awcgate/cia/strategic_warning_kent.htm].
Davis, T. J., and C. P. Keller. 1997. Modelling and visualizing multiple spatial uncertainties. Computers & Geosciences 23(4): 397-408.
Djurcilov, S., K. Kim, P. Lermusiaux, and A. Pang. 2002. Visualizing scalar volumetric data with uncertainty. Computers and Graphics 26: 239-48.
Drecki, I. 1997, Visualisation of uncertainty in spatial data. Unpublished MSc thesis, The University of Auckland, Auckland.
Drecki, I. 2002. Visualisation of uncertainty in geographical data. In: W. Shi, P. Fisher, and M. Goodchild (eds), Spatial data quality. London: Taylor & Francis. pp. 140-159, color plates: 141-143.
Dreschler, M. 2004. Model-based conservation decision aiding in the presence of goal conflicts and uncertainty. Biodiversity and Conservation 13: 141-64.
Ducey, M. J. 2001. Representing uncertainty in silvicultural decisions: An application of the Dempster-Shafer theory of evidence. Forest Ecology and Management 150: 199-211.
Dungan, J.L., D.L. Kao, and A. Pang. 2003. Modeling and visualizing uncertainty in continuous variables predicted using remotely sensed data. In: International Geoscience and Remote Sensing Symposium, 2003. pp. 3017-19.
Edwards, L. D., and E. S. Nelson. 2001. Visualizing data certainty: A case study using graduated circle maps. Cartographic Perspectives 38:19-36.
Ehlschlaeger, C. R., A.M. Shortridge, and M. F. Goodchild. 1997. Visualizing spatial data uncertainty using animation. Computers & Geosciences 23(4): 387-96.
Evans, A., R. Kingston, S. Carver, and I. Turton. 1999. Web-based GIS to enhance public democratic involvement. In: GeoComputation '99, July 24-28, 1999, Mary Washington College, Virginia, USA.
Evans, B. J. 1997. Dynamic display of spatial data- reliability: Does it benefit the user? Computers & Geosciences (special issue on Exploratory Cartographic Visualization) 23(4): 409-22.
Faiz, S., and P. Boursier. 1996. Geographic data quality: From assessment to exploitation. Cartographica 33(1): 33-40.
Fauerbach, E., R. Edsall, D. Barnes, and A. MacEachren. 1996. Visualization of uncertainty in meteorological forecast models. Proceedings of the International Symposium on Spatial Data Handling, Delft, The Netherlands, August 12-16, 1996. New York, New York: Taylor & Francis. pp. 465-76.
Fegeas, R. G., J. L. Cascio, and R. A. Lazar. 1992. An overview of FIPS 173: The spatial data transfer standard. Cartography and Geographic Information Systems 19(5): 278-93.
Fisher, P. 1993. Visualizing uncertainty in soil maps by animation. Cartographica 30(2+3): 20-27.
Fisher, P. 1994. Randomization and sound for the visualization of uncertain spatial information. I: D. Unwin and H. Hearnshaw (eds), Visualization in geographic information systems. London, U.K.: John Wiley & Sons. pp. 181-5.
Foody, G. M., and P. M. Atkinson (eds). 2002. Uncertainty in remote sensing and GIS. Hoboken, New Jersey: Jossey-Bass, an imprint of Wiley. 326 pp.
Gahegan, M., and M. Ehlers. 2000. A framework for the modelling of uncertainty between remote sensing and geographic information. ISPRS Journal of Photogrammetry and Remote Sensing 55(3):176-88.
Gershon, N. D. 1992. Visualization of fuzzy data using generalized animation. In: Proceedings, Visualization '92, October 19-23, Boston, Massachusetts, October 19-23, 1992. IEEE Computer Society Technical Committee on Computer Graphics. pp. 268-73.
Gershon, N. D. 1998. Visualization of an imperfect world. Computer Graphics and Applications (IEEE) 18(4): 43-5.
Goodchild, M., L. Chih-Chang, and Y. Leung. 1994. Visualizing fuzzy maps. In: H. Hearnshaw and D. Unwin (eds), Visualization in geographical information systems. London, U.K.: John Wiley & Sons. pp. 158-67.
Goodchild, M. F. & S. Gopal. 1989. Accuracy of Spatial Databases. London: Taylor & Francis.
Graves, E. 2000. Depicting strategic warning: A new model for the age of information operations. Joint Military Intelligence College.
Hengl, T. 2003. Visualisation of uncertainty using the HIS colour model: Computations with colours. In: Proceedings of the 7th International Conference on GeoComputation, Southampton, United Kingdom. CD-Rom, pp. 8-17.
Howard, D., and A. M. MacEachren. 1996. Interface design for geographic visualization: Tools for representing reliability. Cartography and Geographic Information Systems 23(2): 59-77.
Hunter, G. J., and M. F. Goodchild. 1993. Managing uncertainty in spatial databases: Putting theory into practice. In: Proceedings, URISA, Atlanta, July 25-29, 1993. pp. 1-14.
Hutchins, E. 1996. Cognition in the wild. Cambridge, Massachusetts: MIT Press. 408 pp.
Jiang, B., F. Ormeling, and W. Kainz. 1995. Visualization support for fuzzy spatial analysis. Auto Carto 12, Charlotte, North Carolina. pp. 291-300.
Johnson, C., and A. Sanderson. 2003. A next step: Visualizing errors and uncertainty. IEEE Computer Graphics and Applications 23(5): 6-10.
Juang, K.-W. 2004. Using sequential indicator simulation to assess the uncertainty of delineating heavy-metal contaminated soils. Environmental Pollution 127: 229-38.
Kobus, D., S. Proctor, and S. Holste. 2001. Effects of experience and uncertainty during dynamic decision making. International Journal of Industrial Ergonomics 28: 275-90.
Krizan, L. 1999. Intelligence essentials for everyone: Joint Military Intelligence College.
Krygier, J. 1994. Sound and geographic visualization. In: A. M. MacEachren and D. R. F. Taylor (eds), Visualization in modern cartography. Oxford, UK: Pergamon. pp. 149-66.
Leitner, M., and B. P. Buttenfield. 2000. Guidelines for the display of attribute certainty. Cartography and Geographic Information Science 27(1): 3-14.
Lodha, S. K., A. Pang, R. E. Sheehan, and C. M. Wittenbrink. 1996a. UFLOW: Visualizing uncertainty in fluid flow. Visualization '96, San Francisco, California. IEEE. pp. 249-54.
Lodha, S. K., C. M. Wilson, and R. E. Sheehan. 1996b. LISTEN: Sounding uncertainty visualization. Visualization '96, San Francisco, California. IEEE. pp. 189-95.
Lowell, K. 1997. Outside-in, inside-out: Two methods of generating spatial certainty maps. In: Proceedings, Second Annual Conference of GeoComputation, Dunedin, New Zealand, 26-29 August 1997. University of Otago, Dunedin, New Zealand.
Lowenthal, M. M. 2003. Intelligence, from secrets to policy, 2nd ed. Washington, D.C.: CQ Press. 274p.
Lucieer, A., and M.-J. Kraak. 2004. Interactive and visual fuzzy classification of remotely sensed imagery for exploration of uncertainty. International Journal of Geographical Information Science 18(5): 491-512.
MacEachren, A. M. 1992. Visualizing uncertain information. Cartographic Perspectives (13): 10-19.
MacEachren, A. M. 1994. SOME truth with maps: A primer on symbolization and design. Association of American Geographers, Washington, D. C.
MacEachren, A. M. 1995. How maps work: Representation, visualization and design. New York, New York: Guilford Press.
MacEachren, A. M., C. A. Brewer, and L. W. Pickle. 1998. Visualizing georeferenced data: Representing reliability of health statistics. Environment and Planning: A 30: 1547-61.
McGranaghan, M. 1993. A cartographic view of spatial data quality. Cartographica 30(2 & 3): 8-19.
Miller, R., H. Karimi, and M. Feuchtwanger. 1989. Uncertainty and its management in geographical information systems. In: Proceedings, CISM'89. Canadian Institute of Surveying and Mapping, Ottawa, Canada. pp. 252-9.
Moellering, H. 1994. Continuing research needs resulting from the SDTS. Cartography and Geographic Information Systems 21(3): 180-9.
Morrison, J. (ed.). 1988. NCDCDS (National Committee for Digital Cartographic Data Standards): The proposed standard for digital cartographic data. American Congress on Surveying and Mapping, Washington, D.C.
Morse, E., M. P. Steves, and J. Scholtz. 2005. Metrics and methodologies for evaluating technologies for intelligence analysts. In: Proceedings, International Conference on Intelligence Analysis, McLean Virginia, May 2-4, 2005.
Pang, A. 2001. Visualizing uncertainty in geo-spatial data. In: Proceedings of the Workshop on the Intersections between Geospatial Information and Information Technology. National Academies Committee of the Computer Science and Telecommunications Board, Washington, D.C.
Pang, A. T., C. M. Wittenbrink, and S. K. Lodha. 1997. Approaches to uncertainty visualization. Visual Computer 13: 370-90.
Plewe, B. 2002. The nature of uncertainty in historical geographic information. Transactions in GIS 6(4): 431-56.
Reece, W., and L. Matthews. 1993. Evidence and uncertainty in subjective prediction: Influences on optimistic judgment. Psychological Reports 2(72): 435-9.
Rheingans, P. 1992. Color, change, and control for quantitative data display. In: Proceedings, Visualization '92, October 19-23, Boston, Massachusetts. IEEE Computer Society Technical Committee on Computer Graphics. pp. 252-9.
Scaife, M., and Y. Rogers. 1996. External cognition: How do graphical representations work? International Journal of Human-Computer Studies 45: 185-213.
Schweizer, D. M., and M. F. Goodchild. 1992. Data quality and choropleth maps: An experiment with the use of color. In: Proceedings, GIS/LIS '92, San Jose, California. ACSM and ASPRS, Washington, D.C. pp. 686-99.
Shneiderman, B. 1998. Designing the user interface- Strategies for effective human-computer interaction, 3rd ed. Reading, U.K. : Addison-Wesley Longman, Inc.
Sinton, D. 1978. The inherent structure of information as a constraint to analysis. In: D. Dutton (ed.), Harvard papers on geographic information systems. Reading, U.K.: Addison Wesley.
Slocum, T., R. McMaster, F. Kessler, and H. H. Howard. 2004. Thematic cartography and visualization, 2nd ed. Upper Saddle River, New Jersey: Prentice Hall. 528 pp.
Slocum, T. A., D. C. Cliburn, J. J. Feddema, and J. R. Miller. 2003. Evaluating the usability of a tool for visualizing the uncertainty of the future global water balance. Cartography and Geographic Information Science 30(4): 299-317.
St. John, M., J. Callan, S. Proctor, and S. Holste. 2000. Tactical decision-making under uncertainty: Experiments I and II. San Diego, California: Space and Naval Warfare Systems Center. 22 pp.
Taylor., B. L., P. R. Wade, D. P. D. Master, and J. Barlow. 2000. Incorporating uncertainty into management models for marine mammals. Conservation Biology 14(5): 1243-52.
Thomson, J., B. Hetzler, A. MacEachren, M. Gahegan, and M. Pavel. 2005. Typology for visualizing uncertainty. In: Proceedings, Conference on Visualization and Data Analysis 2005 (part of the IS&T/SPIE Symposium on Electronic Imaging 2005), San Jose, California, 16-20 January 2005. 12 pp.
Todd, C. R., and M. A. Burgman. 1998. Assessment of threat and conservation priorities under realistic levels of uncertainty and reliability. Conservation Biology 12(5): 966-74.
Tversky, A., and D. Kahneman. 1974. Judgement under uncertainty: Heuristics and biases. Science 185: 1124-31.
Unwin, D. J. 1995. Geographical information systems and the problem of 'error and uncertainty'. Progress in Human Geography 19(4): 549-58.
USGS. 1997. Spatial Data Transfer Standard (SDTS): Logical specifications. U.S. Geological Survey, Virginia.
van der Wel, F. J. M., R.M. Hootsman, and F. Ormeling. 1994. Visualization of data quality. In: A. M. MacEachren and D. R. F. Taylor (eds), Visualization in modern cartography. London, U.K.: Pergamon. pp. 313-332.
van der Wel, F. J. M., L. C. Van der Gaag, and B. G. H. Gorte. 1998. Visual exploration of uncertainty in remote-sensing classification. Computers & Geosciences 24(4): 335-43.
Veregin, H. 1989. Error modeling for the map overlay operation. In: M. Goodchild and S. Gopal (eds), Accuracy of spatial databases. New York, New York: Taylor and Francis. pp. 3-18.
Veregin, H. 1995. Developing and testing of an error propagation model for GIS overlay operations. International Journal of Geographical Information Systems 9(6): 595-619.
Wittenbrink, C.M., E. Saxon, J.J. Furman, A. Pang, and S. Lodha. 1995. Glyphs for visualizing uncertainty in environmental vector fields. IEEE Translations on Visualization and Computer Graphics 2(3): 266-79.
Worboys, M. 1998. Computation with imprecise geospatial data. Computers, Environment and Urban Systems 22(2): 85-106.
Zhang, J., and M. F. Goodchild (eds). 2002. Uncertainty in geographical information. New York, New York: Taylor & Francis.