David Spiegelhalter and Mike Pearson and Ian Short.
Visualizing Uncertainty About the Future.
In Science, vol. 333, no. 6048, pp. 1393--1400, 2011.



We are all faced with uncertainty about the future, but we can get the measure of some uncertainties in terms of probabilities. Probabilities are notoriously difficult to communicate effectively to lay audiences, and in this review we examine current practice for communicating uncertainties visually, using examples drawn from sport, weather, climate, health, economics, and politics. Despite the burgeoning interest in infographics, there is limited experimental evidence on how different types of visualizations are processed and understood, although the effectiveness of some graphics clearly depends on the relative numeracy of an audience. Fortunately, it is increasingly easy to present data in the form of interactive visualizations and in multiple types of representation that can be adjusted to user needs and capabilities. Nonetheless, communicating deeper uncertainties resulting from incomplete or disputed knowledge-or from essential indeterminacy about the future-remains a challenge.


@Article{        spiegelhalter:2011:VUAB,
  author = 	 {David Spiegelhalter and Mike Pearson and Ian Short},
  title = 	 {Visualizing Uncertainty About the Future},
  journal = 	 {Science},
  year = 	 {2011},
  volume = 	 {333},
  number = 	 {6048},
  pages = 	 {1393--1400},



1. G. F. Gigerenzer, The Intelligence of the Unconscious (Viking, New York, 2007).
2. P. Slovic, E. Peters, M. L. Finucane, D. G. Macgregor, Health Psychol. 24 (suppl.), S35 (2005).
3. B. de Finetti, Theory of Probability (Wiley, London, 1974).
4. F. Nightingale, Notes on Matters Affecting the Health, Efficiency and Hospital Administration of the British Army, Founded Chiefly on the Experience of the Late War (Harrison, London, 1858).
5. Works of O. Neurath and M. Neurath, Isotype Institute (available at www.fulltable.com/iso/).
6. D. Kahneman, P. Slovic, A. Tversky, Judgment Under Uncertainty: Heuristics and Biases (Cambridge Univ. Press, Cambridge, 2006).
7. E. Peters, J. Hibbard, P. Slovic, N. Dieckmann, Health Aff. 26, 741 (2007).
8. A. Fagerlin, P. A. Ubel, D. M. Smith, B. J. Zikmund-Fisher, Am. J. Health Behav. 31 (suppl. 1), S47 (2007).
9. D. E. Nelson, B. W. Hesse, R. T. Croyle, Making Data Talk: Communicating Public Health Data to the Public, Policy Makers, and the Press (Oxford Univ. Press, New York, ed. 1, 2009).
10. C. Skubisz, T. Reimer, U. Hoffrage, in Communication Yearbook 33 (Routledge, London, 2009), pp. 177-211.
11. J. S. Ancker, Y. Senathirajah, R. Kukafka, J. B. Starren, J. Am. Med. Inform. Assoc. 13, 608 (2006).
12. I. M. Lipkus, J. G. Hollands, J. Natl. Cancer Inst. Monogr. 1999, 149 (1999).
13. I. M. Lipkus, Med. Decis. Making 27, 696 (2007).
14. A. Bostrom, L. Anselin, J. Farris, Ann. N.Y. Acad. Sci.1128, 29 (2008).
15. V. H. M. Visschers, R. M. Meertens, W. W. F. Passchier, N. N. K. de Vries, Risk Anal. 29, 267 (2009).
16. T. S. Wallsten, D. V. Budescu, A. Rapoport, R. Zwick,B. Forsyth, J. Exp. Psychol. Gen. 155, 348 (1986).
17. Intergovernmental Panel on Climate Change Working Group 1, IPCC Fourth Assessment Report: The Physical Science Basis (IPCC, 2007; www.ipcc.ch/ipccreports/ar4-wg1.htm).
18. M. Galesic, R. Garcia-Retamero, Arch. Intern. Med. 170, 462 (2010).
19. G. Gigerenzer, W. Gaissmaier, E. Kurz-Milcke, L. M. Schwartz, S. Woloshin, Psychol. Sci. Public Interest 8, 53 (2007).
20. B. J. McNeil, S. G. Pauker, H. C. Sox Jr., A. Tversky, N. Engl. J. Med. 306, 1259 (1982).
21. R. Morss, J. Demuth, J. Lazo, Weather Forecast. 23, 974 (2008).
22. E. Kurz-Milcke, G. Gigerenzer, L. Martignon, Ann. N.Y. Acad. Sci. 1128, 18 (2008).
23. V. F. Reyna, C. J. Brainerd,Learn. Individ. Differ.18, 89 (2008).
24. V. Denes-Raj, S. Epstein,J. Pers. Soc. Psychol.66, 819 (1994).
25. R. Garcia-Retamero, M. Galesic, G. Gigerenzer, Med. Decis. Making 30, 672 (2010).
26. W. P. Neace, S. Michaud, L. Bolling, K. Deer, L. Zecevic, Judgm. Decis. Mak. 3, 140 (2008).
27. S. L. Joslyn, R. M. Nichols, Meteorol. Appl. 16, 309 (2009).
28. E. Tufte, The Visual Display of Quantitative Information (Graphics Press, Cheshire, CT, 2001).
29. C. M. R. Smerecnik et al., Risk Anal. 30, 1387 (2010).
30. S. Woloshin, L. M. Schwartz, A. Ellner, BMJ 327, 695 (2003).
31. NASA Space Shuttle Safety and Mission Assurance Office, NASA Review of Shuttle Risks (available at http://hw.libsyn.com/p/3/0/a/30aafb8c2337eb80/NASAShuttleRiskReview-excerpt.pdf).
32. B. J. Zikmund-Fisher, A. Fagerlin, P. A. Ubel, Cancer 113, 3382 (2008).
33. M. Galesic, R. Garcia-Retamero, G. Gigerenzer, Health Psychol. 28, 210 (2009).
34. J. S. Ancker, E. U. Weber, R. Kukafka, Med. Decis. Making 31, 143 (2011).
35. Breast Screening-Performance of Mammography: Cancer Research UK (available at http://info.cancerresearchuk.org/cancerstats/types/breast/screening/mammography/).
36. J. G. Dolan, S. Iadarola, BMC Med. Inform. Decis. Mak. 8, 14 (2008).
37. C. Keller, M. Siegrist, V. Visschers,Risk Anal.29, 1255 (2009).
38. A. P. Sokolov et al., J. Clim. 22, 5175 (2009).
39. J. Sanyal, S. Zhang, G. Bhattacharya, P. Amburn, R. J. Moorhead, IEEE Trans. Vis. Comput. Graph. 15,1209 (2009).
40. K. Broad et al., Misinterpretations of the "Cone of Uncertainty" in Florida During the 2004 Hurricane Season (2010) (available at http://journals.ametsoc.org/doi/abs/10.1175/BAMS-88-5-651).
41. A. M. MacEachren et al., Cartogr. Geogr. Inform. Sci. 32, 139 (2005).
42. M. Leitner, B. P. Buttenfield, Cartogr. Geogr. Inform. Sci. 27, 3 (2000).
43. Bank of England, Bank of England Inflation Report 2007 (available at www.bankofengland.co.uk/publications/inflationreport/2007.htm).
44. W. S. Cleveland, R. McGill, Science 229, 828 (1985).
45. H. Ibrekk, M. G. Morgan, Risk Anal. 7, 519 (1987).
46. Many Eyes (available at www-958.ibm.com/software/data/cognos/manyeyes/).
47. B. Fry, Writing (available at http://benfry.com/writing/).
48. D. McCandless, Information is Beautiful (Collins,London, 2010).
49. H. Rosling, Gapminder: Unveiling the beauty of statistics for a fact based world view (available at www.gapminder.org/).
50. V. J. Strecher, T. Greenwood, C. Wang, D. Dumont, J. Natl. Cancer Inst. Monogr. 1999, 134 (1999).
51. J. S. Ancker, E. U. Weber, R. Kukafka, Med. Decis. Making 31, 130 (2011).
52. American Council on Science and Health, Riskometer and RiskRings (available at http://riskometer.org/).
53. A. Bostrom, R. E. Löfstedt, Risk Anal. 23, 241 (2003).
54. M. C. Politi, P. K. J. Han, N. F. Col, Med. Decis. Making 27, 681 (2007).
55. P. K. J. Han et al., Med. Decis. Making 31, 354 (2011).
56. L. Rogers, S. S. N. Siu, D. Luesley, A. Bryant, H. O. Dickinson, in Cochrane Database of Systematic Reviews, The Cochrane Collaboration, L. Rogers, Eds. (Wiley, Chichester, UK, 2009).
57. G. H. Guyatt et al.; GRADE Working Group,BMJ336, 924 (2008).
58. M. G. Morgan, B. Fischhoff, A. Bostrom, C. J. Atman, Risk Communication: A Mental Models Approach
(Cambridge Univ. Press, Cambridge, ed. 1, 2001).
59. D. Kahan, Nature 463, 296 (2010).
60. A. Stirling, Nature 468, 1029 (2010).
61. G. Morgan et al., Best Practice Approaches for Characterizing, Communicating, and Incorporating
Scientific Uncertainty in Decisionmaking (U.S. Climate Change Science Program, 2009; www.climatescience.gov/Library/sap/sap5-2/final-report/default.htm).
62. IPCC, Cross-Working Group Meeting on Consistent Treatment of Uncertainties, Guidance Note for Lead Authors of the IPCC Fifth Assessment Report on Consistent Treatment of Uncertainties (2010) (available at www.ipcc-wg2.gov/meetings/CGCs/UncertaintiesGN_IPCCbrochure_lo.pdf).
63. G. Williams, Women and Work (Nicholson & Watson, London, 1945).
64. Kick Off-Football Stats-Match Previews (available at www.kickoff.co.uk/).
65. Harvard School of Public Health Disease Risk Index (available at www.diseaseriskindex.harvard.edu/update/).
66. Adjuvant! Online (available at http://adjuvantonline.com/index.jsp).
67. Genetic Testing for Carrier Status, Disease Risk and Drug Response-23andMe (available at www.23andme.com/health/risks/).
68. MIT Global Change Program | Greenhouse Gamble (available at http://globalchange.mit.edu/resources/gamble/).
69. Met Office, Invent-Weather: Text view-Location:Peterborough (available at www.metoffice.gov.uk/public/pws/invent/weathertext/index.html?310120).
70. Definition of the NHC Track Forecast Cone (available at www.nhc.noaa.gov/aboutcone.shtml).
71. UK Climate Projections-What is UKCP09: Probability (available at http://ukclimateprojections.defra.gov.uk/content/view/1205/618/).