Erik W. Anderson and Kristin C. Potter and Laura E. Matzen and Jason F. Shepherd and Gilbert A. Preston and Clàudio T. Silva.
A User Study of Visualization Effectiveness Using EEG and Cognitive Load.
In Computer Graphics Forum, vol. 30, no. 3, pp. 791--800, 2011.


Abstract:

Effectively evaluating visualization techniques is a difficult task often assessed through feedback from user studies and expert evaluations. This work presents an alternative approach to visualization evaluation in which brain activity is passively recorded using electroencephalography (EEG). These measurements are used to compare different visualization techniques in terms of the burden they place on a viewer's cognitive resources. In this paper, EEG signals and response times are recorded while users interpret different representations of data distributions. This information is processed to provide insight into the cognitive load imposed on the viewer. This paper describes the design of the user study performed, the extraction of cognitive load measures from EEG data, and how those measures are used to quantitatively evaluate the effectiveness of visualizations.

Bibtex:

@Article{       anderson:2011:USVE,
  title =       {A User Study of Visualization Effectiveness Using
                 {EEG} and Cognitive Load},
  author =      {Erik W. Anderson and Kristin C. Potter and Laura
                 E. Matzen and Jason F. Shepherd and Gilbert
                 A. Preston and Cl{\'a}udio T. Silva},
  journal =     {Computer Graphics Forum},
  volume =      {30},
  number =      {3},
  year =        {2011},
  pages =       {791--800},
}

Images:

References:


Anderson E. W., Preston G. A., Silva C. T.: Towards development of a circuit based treatment for impaired working memory: A multidisciplinary approach. IEEE/EMBS Conference on Neural Engineering (2007), 302-305.
Baddeley A.: Working Memory. Oxford University Press, 1983.
Baddeley A.: Working memory: The interface between memory and cognition. J. of Cognitive Neuroscience 4, 3 (1992), 281-288.
Braver T. S., Cohen J. D., Nystrom L. E., Jonides J., Smith E. E., Noll D. C.: A parametric study of prefrontal cortex involvement in human working memory. NeuroImage 5, 1 (1997), 49-62.
Benjamini Y.: Opening the box of a boxplot. The American Statistician 42, 4 (1988), 257-262.
Berka C., Levendowski D. J., Cvetinovic M. M., Petrovic M. M., Davis G., Lumicao M. N., Zivkovic V. T., Popovic M. V., Olmstead R.: Real-time analysis of eeg indices of alertness, cognition and memory with a wireless eeg headset. Int'l J. of HCI 17 (2004), 151-170.
Berka C., Levendowski D. J., Ramsey C. K., Davis G., Lumicao M. N., Stanney K., Reeves L., Regli S. H., Tremoulet P. D., Stibler K.: Evaluation of an eegworkload model in the aegis simulation environment. Proceedings of SPIE (2005), 90-99.
Berry S., Zanto T. P., Rutman A. M., Clapp W. C., Gazzaley A.: Practice-related improvement in working memory is modulated by changes in processing external interference. J. of Neurophysiology 102 (2009), 1779-1789.
Cleveland W. S., McGill R.: Graphical perception: Theory, experimentation and the application to the development of graphical methods. J. of American Statistical Association 79 (1984), 531-554.
Cohen J. D., Perlstein W. M., Braver T. S., Nystrom L. E., Noll D. C., Jonides J., Smith E. E.: Temporal dynamics of brain activation during a working memory task. Nature 386 (1997), 604-608.
Chandler P., Sweller J.: Cognitive load theory and the format of instruction. Cognition and Instruction 8 (1991), 293-332.
Carpenter P. A., Shah P.: A model of the perceptual and conceptual processes in graph comprehension. J. of Experimental Psychology: Applied 4, 2 (1998), 75-100.
Constantinidis C., Wang X.-J.: A neural circuit basis for spatial working memory. The Neuroscientist 10, 6 (2004), 553-565.
Eckhorn R., Bauer R., Jordan W., Brosch M., Kruse W., Munk M., Reitboeck H.: Coherent oscillations: A mechanism of feature linking in the visual cortex? Biological Cybernetics 60, 2 (1988), 121-130.
Engle R. W.: Working memory capacity as executive attention. Current Directions in Psychological Science 11 (2002), 19-23.
Gevins A., Smith M. E.: Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. Cerebral Cortex 10, 9 (2000), 829-839.
Gevins A., Smith M. E., McEvoy L., Yu D.: High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cerebral Cortex 7 (1997), 374-385.
Hitt J. M., Kring J. P., Daskarolis E., Morris C., Mouloua M.: Assessing mental workload with subjective measures: An analytical review of the nasa-tlx index since its inception. Human Factors and Ergonimics Society Annual Meeting 43 (1999), 1404-1404.
Hintze J. L., Nelson R. D.: Violin plots: A box plot-density trace synergism. The American Statistician 52, 2 (1998), 181-184.
Kosara R., Healey C. G., Interrante V., Laidlaw D. H., Ware C.: Thoughts on user studies: Why, how and when. IEEE Computer Graphics and Applications 23, 4 (2003), 20-25.
Klimesch W.: Eeg alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Research Reviews 29 (1999), 169-195.
Kosara R., Miksch S., Hauser H.: Semantic depth of field. Proceedings of IEEE INFOVIS (2001), 97-104.
Klingner J., Tversky B., Hanrahan P.: Effects of visual and verbal presentation on cognitive load in vigilance, memory and arithmetic tasks. J. of Psyhophysiology 48, 3 (2011), 323-332.
Likert R.: A technique for the measurement of attitudes. Archives of Psychology 140 (1932), 1-55.
Laidlaw D. H., Kirby R. M., Jackson C. D., Davidson J. S., Miller T.S., Da Silva M., Warren W. H., Tarr M. J.: Comparing 2d vector field visualization methods: A user study. IEEE Transactions on Visualization and Computer Graphics 11, 2 (2005), 59-70.
Preston G. A., Anderson E. W., Silva C. T., Goldberg T., Wassermann E. M.: Effects of 10 hz rtms on the neural efficiency of working memory. J. of Cognitive Neuroscience 22, 3 (2010), 447-456.
Pirolli P., Card S. K., Van Der Wege M.M.: Visual information foraging in a focus + context visualization. In Proceedings of the SIGCHI conference on Human factors in computing systems ( New York , NY , USA , 2001), CHI '01, ACM, pp. 506-513.
Potter K., Kniss J., Riesenfeld R., Johnson C. R.: Visualizing summary statistics and uncertainty. Computer Graphics Forum 29, 3 (2010), 823-831.
Paas F., Renkl A., Sweller J.: Cognitive load theory and instructional design: Recent developments. Educational Psychologist 38, 1 (2003), 1-4.
Reitinger B., Bornik A., Beichel R., Schmalstieg D.: Liver surgery planning using virtual reality. IEEE Computer Graphics and Applications 26 (2006), 36-47.
Rowe J. B., Toni I., Josephs O., Frackowiak R. S. J., Passingham R. E.: The prefrontal cortex: Response selection or maintenance within working memory. Science 288, 5471 (2000), 1656-1660.
Seufert T., Jänen I., Brünken R.: The impact of intrinsic cognitive load on the effectiveness of graphical help for coherence information. Computers in Human Behavior 23 (2007), 1055-1071.
Salenius S., Portin K., Kajola M., Salmelin R., Hari R.: Cortical control of human mononeuron firing during isometric contraction. J. of Neurophysiology 77, 6 (1997), 3401-3405.
Shi Y., Ruiz N., Taib R., Choi E., Chen F.: Galvanic skin response (gsr) as an index of cognitive load. In CHI '07 extended abstracts (2007), ACM, pp. 2651-2656.
Sternberg S.: Memory scanning: Mental processes revealed by reaction-time experiments. American Scientist 57 (1969), 421-457.
Stockwell R. G.: A basis for efficient representation of the s-transform. Digital Signal Processing 17, 1 (2007), 371-393.
Sarter N. B., Woods D. D.: Pilot interaction with cockpit automation ii: An experimental study of pilots' model and awareness of the flight management system. Int'l J. of Aviation Psychology 4, 1 (1994), 1-28.
Sweller J.: The Cambridge handbook of multimedia learning. Cambridge University Press, 2005, ch. Implications of cognitive load theory for multimedia learning, pp. 19-30.
Sanyal J., Zhang S., Bhattacharya G., Amburn P., Moorhead R. J.: A user study to compare four uncertainty visualization methods for 1d and 2d datasets. IEEE Transactions on Visualization and Computer Graphics 15, 6 (2009), 1209-1218.
Tory M., Möller T.: Human factors in visualization research. IEEE Transactions on Visualization and Computer Graphics 10, 1 (2004), 72-84.
Tufte E. R.: The Visual Display of Quantitative Information. Graphics Press, 1983.
Tukey J. W.: Exploratory Data Analysis. Addison-Wesley, 1977.