Susan Joslyn and Karla Pak and David Jones and John Pyles and Earl Hunt.
The Effect of Probabilistic Information on Threshold Forecasts.
In Weather and Forecasting, vol. 22, pp. 804--812, 2007.

Abstract:

The study reported here asks whether the use of probabilistic information indicating forecast uncertainty improves the quality of deterministic weather decisions. Participants made realistic wind speed forecasts based on historical information in a controlled laboratory setting. They also decided whether it was appropriate to post an advisory for winds greater than 20 kt (10.29 m s1) during the same time intervals and in the same geographic locations. On half of the forecasts each participant also read a color-coded chart showing the probability of winds greater than 20 kt. Participants had a general tendency to post too many advisories in the low probability situations (0%-10%) and too few advisories in very high probability situations (90%-100%). However, the probability product attenuated these biases. When participants used the probability product, they posted fewer advisories when the probability of high winds was low and they posted more advisories when the probability of high winds was high. The difference was due to the probability product alone because the within-subjects design and counterbalancing of forecast dates ruled out alternative explanations. The data suggest that the probability product improved threshold forecast decisions.

Bibtex:

@Article{        joslyn:2007:EPIT,
  author = 	 {Susan Joslyn and Karla Pak and David Jones and John Pyles and Earl Hunt},
  title = 	 {The Effect of Probabilistic Information on Threshold Forecasts},
  journal = 	 {Weather and Forecasting},
  year = 	 {2007},
  volume = 	 {22},
  pages = 	 {804--812},
  note = 	 {10.1175/WAF1020.1},
}

Images:

References:

Anderson, O., 1996: A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J.Climate, 9, 1518-1530.
Baars, J. A., C. Mass, and M. Albright, 2004: Performance of National Weather Service forecasts versus model output statistics. Preprints, 20th Conf. on Weather Analysis and Forecasting and 16th Conf. on Numerical Weather Prediction, Seattle,WA, Amer. Meteor. Soc., CD-ROM, 20.5.
Gonzalez, R., and G. Wu, 1999: On the form of the probability weighting function. Cogn. Psychol., 38, 129-166.
Green, D. M., and J. Z. Swets, 1966: Signal Detection Theory and Psychophysics. Wiley, 455 pp.
Grimit, E. P., and C. F. Mass, 2002: Initial results of a mesoscale short-range ensemble forecasting system over the Pacific Northwest. Wea. Forecasting, 17, 192-205.
--, and --, 2003: Toward short-range ensemble prediction of mesoscale forecast skill. Preprints, 10th Conf. on Mesoscale Processes, Portland, OR, Amer. Meteor. Soc., 22-27.
Kahneman, D., and A. Tversky, 1979: Prospect theory: An analysis of decision under risk. Econometrica, 47, 263-291.
Keith, R., 2003: Optimization of value of aerodrome forecasts.Wea. Forecasting, 18, 808-824.
Mason, I. B., 1982: A model for assessment of weather forecasts. Aust. Meteor. Mag., 30, 291-303.
--, 2003: Binary events. Forecast Verification: A Practitioner's Guide in Atmospheric Science, I. T. Jolliffe and D. B. Stephenson, Eds., Wiley, 37-76.
Murphy, A. H., and R. L. Winkler, 1974a: Credible interval temperature forecasting: Some experimental results. Mon. Wea. Rev., 102, 784-794.
--, and --, 1974b: Subjective probability forecasting experiments in meteorology: Some preliminary results. Bull. Amer.Meteor. Soc., 55, 1206-1216.
--, and --, 1977: Can weather forecasters formulate reliable probability forecasts of precipitation and temperature? Natl. Wea. Dig., 2 (2), 2-9.
National Research Council, 2006: Completing the Forecast: Characterizing and Communicating Uncertainty for Better Decisions Using Weather and Climate Forecasts. Committee on Estimating and Communicating Uncertainty in Weather and Climate Forecasts, The National Academies Press, 124 pp.
Palmer, T. N., 2002: The economic value of ensemble forecasts as a tool for risk assessment: From days to decades. Quart. J.Roy. Meteor. Soc., 128, 747-774.
Richardson, D. S., 2001: Measures of skill and value of ensemble prediction systems, their interrelationship and the effect of ensemble size. Quart. J. Roy. Meteor. Soc., 127, 2473-2489.
Roulston, M. S., and L. A. Smith, 2004: The boy who cried wolf revisited: The impact of false alarm intolerance on cost-loss scenarios. Wea. Forecasting, 19, 391-397.
--, G. E. Bolton, A. N. Kleit, and A. L. Sears-Collins, 2006: A laboratory study of the benefits of including uncertainty information in weather forecasts. Wea. Forecasting, 21, 116-122.
Weber, E. U., 1994: From subjective probabilities to decision weights: The effect of asymmetric loss function. Psychol. Bull., 115, 228-242.
Windschitl, P. D., and E. Weber, 1999: The interpretation of "likely" depends on the context, but "70%" is 70%-Right? The influence of associative processes on perceived certainty. J. Exp. Psychol. Learn. Mem. Cogn., 25, 1514-1533.