This paper highlights the importance of uncertainty visualization in information fusion, reviews general methods of representing uncertainty and presents perceptual and cognitive principles from Tufte, Chambers and Bertin as well as users experiments documented in the literature. Examples of uncertainty representations in information fusion are analyzed using these general theories. These principles can be used in future theoretical evaluations of existing or newly developed uncertainty visualization techniques before usability testing with actual users.
@InProceedings{ riveiro:2007:EUVT,
Author = {Maria Riveiro},
title = {Evaluation of uncertainty visualization techniques for information fusion},
booktitle = {10th International Conference on Information Fusion},
pages = {1--8},
year = {2007},
}
H. Couclelis, "The certainty of uncertainty: GIS and the limits of geographic knowledge," Transactions in GIS, vol. 7, no. 2, pp. 165- 175, 2003.
P. A. Longley, M. F. Goodchild, D. Maguire, and D. W. Rhind, Eds., Ge- ographical Information Systems: Principles, Techniques, Management, and Applications. New York: Wiley, 1999, ch. Models of uncertainty in spatial data (Fischer, P. F.), pp. 191-205.
H. Griethe and H. Schumann, "Visualizing uncertainty for improved decision making," in Proceedings of the 4th International Conference on Perspectives in Business Informatics Research (BIR 2005), University of Sk {\"o}vde, Sweden, 2005.
A. Cedilnik and P. Rheingans, "Procedural annotation of uncertain information," in 11th IEEE Visualization 2000 (VIS'00). Los Alamitos, CA, USA: IEEE Computer Society Press, 2000, pp. 77-83.
H. Griethe and H. Schumann, "The visualization of uncertain data: Methods and problems," in Proceedings SimVis'06, Magdeburg, Ger- many, 2006.
C. Olston and J. D. Mackinlay, "Visualizing data with bounded un- certainty," in INFOVIS '02: Proceedings of the IEEE Symposium on Information Visualization (InfoVis'02). Washington, DC, USA: IEEE Computer Society, 2002, p. 37.
A. M. Bisantz, R. Finger, Y. Seong, and J. Llinas, "Human performance and data fusion based decision aids," in Proceedings of the 2nd In- ternational Conference on Information Fusion. International Society of Information Fusion., Sunnyvale, CA USA, 1999.
R. Finger and A. Bisantz, "Utilizing graphical formats to convey uncertainty in a decision making task," Theoretical Issues in Ergonomics Science, vol. 3, no. 1, pp. 1-25, 1997.
T. Zuk and S. Carpendale, "Theoretical analysis of uncertainty visu- alizations," in Visualization and Data Analysis, Proc. of SPIE-IS&T Electronic Imaging, SPIE, R. F. Erbacher, J. C. Roberts, M. T. Gr {\"o}hn, and K. B {\"o}rne, Eds., vol. 6060, 2006.
A. Pang, C. Wittenbrink, and S. Lodha, "Approaches to uncertainty visualization," The Visual Computer, vol. 13, no. 8, pp. 370-390, November 1997.
C. R. Johnson and A. R. Sanderson, "A next step: Visualizing errors and uncertainty." IEEE Computer Graphics and Applications, vol. 23, no. 5, pp. 6-10, 2003.
C. J. Matheus, M. M. Kokar, and K. Baclawski, "A core ontology for situation awareness," In Proceedings of Sixth International Conference on Information Fusion, Caims Australia, pp. 545-552, 2003.
M. J. Hall, S. A. Hall, and T. Tate, "Removing the HCI bottleneck: How the human computer interaction (HCI) affects the performance of data fusion system," in 2000 MSS National Sysmposium on Sensor and Data Fusion, 2000, pp. 89-104.
E. P. Blasch and S. Plano, "JDL level 5 fusion model: user refinement issues and applications in group tracking," in Proc. SPIE Vol. 4729, p. 270-279, Signal Processing, Sensor Fusion, and Target Recognition XI, Ivan Kadar; Ed., I. Kadar, Ed., July 2002, pp. 270-279.
D. Hall and S. A. H. McMullen, Eds., Mathematical Techniques in Multisensor Data Fusion, 2nd ed. Norwood, MA: Artech House, Inc., 2004.
D. Hall and J. Llinas, Eds., Handbook of multisensor data fusion. Boca Raton: CRC Press, 2000.
E. Waltz and J. Llinas, Eds., Multisensor Data Fusion. Norwood, MA: Artech House, Inc., 1990.
B. Brehmer, "The dynamic OODA loop: amalgamating Boyd's OODA loop and the Cybernetic approach to command and control," in Proc. of 10th international command and control research and technology symposium, 2005.
T.-M. Rhyne, W. L. Hibbard, C. Johnson, C. Chen, and S. Eick, "Panel 1: Can we determine the top unresolved problems of visualization?" in IEEE Visualization, 2004, pp. 563-566.
C. Johnson, "Top scientific visualization research problems," IEEE Computer Graphics and Applications, vol. 24, no. 3, pp. 13-17, 2004.
N. Gershon, "Visualization of an imperfect world," IEEE Comput. Graph. Appl., vol. 18, no. 4, pp. 43-45, 1998.
J. Thomson, E. Hetzler, A. MacEachren, M. Gahegan, and M. Pavel, "A typology for visualizing uncertainty," in Visualization and Data Analysis 2005, R. F. Erbacher, J. C. Roberts, M. T. Grohn, and K. Borner, Eds., vol. 5669, no. 1. SPIE, 2005, pp. 146-157.
M. Harrower, "Representing uncertainty: Does it help people make better decisions?" in UCGIS Workshop: Geospatial Visualization and Knowl- edge Discovery Workshop, National Conference Center., Landsdowne, VA., 2003, (invited white paper).
M. Tory and T. M {\"o}ller, "Human factors in visualization research," IEEE Transactions on Visualization and Computer Graphics, vol. 10, no. 1, pp. 72-84, 2004.
A. M. MacEachren, A. Robinson, S. Hopper, S. Gardner, R. Murray, M. Gahegan, and E. Hetzler, "Visualizing geospatial information uncer- tainty: What we know and what we need to know," In Cartography and Geographic Information Science, vol. 32, no. 3, pp. 139-160, 2005.
G. M. Foody and P. Atkinson, Eds., Uncertainty in Remote Sensing and GIS. Sussex, England: Wiley, 2002.
B. Buttenfield and R. Weibel, "Visualizing the quality of cartographic data," in Third International Geographic Information Systems Sympo- sium, GIS/LIS 88, San Antonio, Texas, 1988.
A. Masalonis, S. Mulgund, L. Song, C. Wanke, and S. Zobell, "Using probabilistic demand predictions for traffic flow management decision support," in AIAA Guidance, Navigation, and Control Conference and Exhibit, Providence, Rhode Island, 2004.
C. M. Wittenbrink, A. T. Pang, and S. K. Lodha, "Glyphs for visualizing uncertainty in vector fields," IEEE Transactions on Visualization and Computer Graphics, vol. 2, no. 3, pp. 266-279, 1996.
K. J {\"a} {\"a}-Aro, "Lecture notes: Visualisation of uncertainty." 2006, KTH. Stockholm.
G. J. Hunter and M. F. Goodchild, "Managing uncertainty in spatial databases: Putting theory into practice," URISA J., vol. 5, no. 2, pp. 55-62, 1993.
F. J. M. van der Wel, L. C. van der Gaag, and B. G. H. Gorte, "Visual exploration of uncertainty in remote-sensing classification," Computers & Geosciences, vol. 24, no. 4, pp. 335-343, 1998.
P. Fisher, "On animation and sound for the visualization of uncertain spatial information," Visualization in Geographical Information Systems, pp. 181-185, 1994.
G. Grigoryan and P. Rheingans, "Point-based probabilistic surfaces to show surface uncertainty," IEEE Transactions on Visualization and Computer Graphics, vol. 10, no. 5, pp. 564-573, 2004.
T. Isenberg, "Visualisierung von modellierungsentscheidungen und un- sicherheiten in virtuellen rekonstruktionen." Department of Simula- tion and Graphics, Otto-von-Guericke University Magdeburg, Germany, Tech. Rep., 1999.
D. Kao, A. Luo, J. L. Dungan, and A. Pang, "Visualizing spatially vary- ing distribution data," Proceedings of the Sixth International Conference on Information Visualisation (IV'02), 2002.
E. R. Tufte, The Visual Display of Quantitative Information, 2nd ed. Cheshire, CT: Graphics Press, 2001.
E.R. Tufte, Visual explanations. Images and Quantities, Evidence and Narrative. Cheshire, Connecticut: Graphics Press, 1997.
E. R. Tufte., Envisioning Information. Cheshire, Connecticut: Graphics Press, 1994.
J. M. Chambers and W. S. Cleveland and B. Kleiner, and P. A. Tukey, Graphical Methods for Data Analysis. New York: Chapman and Hall, 1983.
Bertin, J., Semiology of Graphics. Madison, WI: University of Wisconsin Press, 1983, (trans. W. Berg).
Bertin, J. , Graphics and Graphics Information Processing. Berlin-New York: Walter de Gruyter, 1981, (trans. W. Berg and P. Scott).
C. Ware, Information Visualization: Perception for Design. San Francisco, CA.: Morgan Kaufmann, 2000.
M. Leitner and B. P. Buttenfield, "Guidelines for the display of attribute certainty," Cartography and Geographic Information Science, vol. 27, no. 1, pp. 3-14, 2000.
D. Schweizer and M. Goodchild, "Data quality and choropleth maps: An experiment with the use of color," in Proceedings, GIS/LIS, vol. 2, 1992, pp. 686-699.
B. A. Jiang B. and F. J. Ormeling, "Some perceptual aspects of colouring uncertainty," Advances in GIS Research II, pp. 477-490, 1996.
B. Evans, "Dynamic display of spatial data-reliability: does it benefit the map user?" Computenrs & Geosciences, vol. 23, no. 4, pp. 409- 422, 1997.
A. Andre and H. Cutler, "Displaying uncertainty in advanced navigation systems," in Human Factors and Ergonomics Society 42nd Annual Meeting, Chicago, IL, USA, 1998, pp. 31-35.
J. T. Freeman and M. S. Cohen, "A critical decision analysis of aspects of naval anti-air warfare," Cognitive Technologies, Inc., Tech. Rep. 98-2, 9 June 1998.
J. Roy, R. Breton, and S. Paradis, "Human-computer interface for the study of information fusion concepts in situation analysis and command decision support systems," in Proc. SPIE, Signal Processing, Sensor Fusion, and Target Recognition X, I. Kadar, Ed., vol. 4380, no. 1, 2001, pp. 361-372.
C. D. Wickens and J. G. Hollands, Engineering Psychology and Human Performance (3rd Edition). Prentice Hall, September 1999.