Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-745bb68f8f-hvd4g Total loading time: 0 Render date: 2025-02-07T14:14:49.024Z Has data issue: false hasContentIssue false

3 - The management of visual attention in graphic displays

Published online by Cambridge University Press:  04 February 2011

By
Ronald A. Rensink
Edited by
Claudia Roda
Claudia Roda
Affiliation:
The American University of Paris, France
Get access

Summary

This chapter presents an overview of several recent developments in vision science and outlines some of their implications for the management of visual attention in graphic displays. These include ways of sending attention to the right item at the right time, techniques to improve attentional efficiency, and possibilities for offloading some of the processing typically done by attention onto nonattentional mechanisms. In addition it is argued that such techniques not only allow more effective use to be made of visual attention but also open up new possibilities for human–machine interaction.

Introduction

Graphic displays such as maps, diagram and visual interfaces have long been used to present information in a form intended to be easy to comprehend (e.g., Massironi 2002; Tufte 2001; Ware 2008). While it is clear that such a goal is important, it is not so clear that it has always been achieved. Are current displays for the most part effective – do they enable user performance to be rapid, easy and accurate? Are they optimally so? Or are better designs possible?

These concerns are discussed here in the context of how to manage visual attention in graphic displays (including visual displays). This chapter is not directly concerned with the design of displays that respond effectively to the user (e.g., Roda and Thomas 2006; Vertegaal 2003). Rather, it focuses on the complementary perspective: how to design a display so that the user responds effectively to it. Results here apply equally well to static, dynamic and interactive displays.

Type
Chapter
Information
Human Attention in Digital Environments , pp. 63 - 92
Publisher: Cambridge University Press
Print publication year: 2011

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Albrecht-Buehler, C., Watson, B., and Shamma, D. A. 2005. Visualizing live text streams using motion and temporal pooling, IEEE Computer Graphics and Applications 25: 52–9CrossRefGoogle ScholarPubMed
Allport, D. A. 1993. Attention and control: Have we been asking the wrong questions? A critical review of twenty-five years, in Meyer, D. E. and Kornblum, S. (eds.), Attention and Performance. Cambridge, MA: MIT Press: vol. XIV: 183–218Google Scholar
Alvarez, G. A., and Scholl, B. J. 2005. How does attention select and track spatially extended objects? New effects of attentional concentration and amplification, Journal of Experimental Psychology: General 134: 461–76CrossRefGoogle ScholarPubMed
Ariely, D. 2001. Seeing sets: Representation by statistical properties, Psychological Science 12: 157–62CrossRefGoogle ScholarPubMed
Ballard, D. H., Hayhoe, M. M., Pook, P. K., and Rao, R. P. 1997. Deictic codes for the embodiment of cognition, Behavioral and Brain Sciences 20: 723–67CrossRefGoogle ScholarPubMed
Bang, M. 2000. Picture This: How Pictures Work. New York: Seastar BooksGoogle Scholar
Barth, H., Kanwisher, N., and Spelke, E. S. 2003. The construction of large number representations in adults, Cognition 86: 201–21CrossRefGoogle ScholarPubMed
Bartram, L., and Stone, M. 2007. Whisper, don't scream: Characterizing subtle grids, in Proceedings IEEE Visualization 2007. Sacramento, CAGoogle Scholar
Bartram, L., Ware, C., and Calvert, T. 2001. Filtering and integrating visual information with motion, in Proceedings on Information Visualization. Los Alamitos, CA: IEEE: 66–79
Block, B. A. 2001. The Visual Story: Seeing the Structure of Film, TV and New Media. Boston: Focal PressGoogle Scholar
Blok, C. A. 2006. Interactive animation to visually explore time series of satellite imagery, in Bres, S. and Laurini, R. (eds.), Visual Information and Information Systems. Berlin: Springer: 71–82CrossRefGoogle Scholar
Bruce, N., and Tsotsos, J. K. 2006. Saliency based on information maximization, Advances in Neural Information Processing Systems 18: 155–62Google Scholar
Burton, A. M., Bindemann, M., Langton, S. R., Schweinberger, S. R., and Jenkins, R. 2009. Gaze perception requires focused attention: Evidence from an interference task, Journal of Experimental Psychology: Human Perception and Performance 35: 108–18Google ScholarPubMed
Card, S. K., Mackinlay, J. D., and Shneiderman, B. 1999. Information visualization, in Card, S. K., Mackinlay, J. D., and Shneiderman, B. (eds.), Readings in Information Visualization: Using Vision to Think. San Francisco: Morgan Kaufman: 1–34Google Scholar
Chong, S. C., and Treisman, A. 2003. Representation of statistical properties, Vision Research 43: 393–404CrossRefGoogle ScholarPubMed
Chun, M., and Jiang, Y. 1998. Contextual cueing: Implicit learning and memory of visual context guides spatial attention, Cognitive Psychology 36: 28–71CrossRefGoogle ScholarPubMed
Clark, A. J. 2003. Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence. Cambridge, MA: MIT PressGoogle Scholar
DeCarlo, D., and Santella, A. 2002. Stylization and abstraction of photographs, in Proceedings of SIGGRAPH 2002, San Antonio, TX: 769–76
Egeth, H. E., and Yantis, S. 1997. Visual attention: Control, representation, and time course, Annual Review of Psychology 48: 269–97CrossRefGoogle ScholarPubMed
Elazary, L., and Itti, L. 2008. Interesting objects are visually salient, Journal of Vision 8: 1–15CrossRefGoogle ScholarPubMed
Endsley, M. R. 1995. Toward a theory of situation awareness in dynamic systems, Human Factors 37: 85–104Google Scholar
Few, S. C. 2004 Show me the numbers: Designing tables and graphs to enlighten. Oakland, CA: Analytics PressGoogle Scholar
Grimes, J. 1996. On the failure to detect changes in scenes across saccades, in Akins, K. (ed.), Perception. New York: Oxford University Press: 89–110Google Scholar
Halper, N., Mellin, M., Herrmann, C. S., Linneweber, V., and Strothotte, T. 2003. Towards an understanding of the psychology of non-photorealistic rendering, Workshop on Computational Visualistics, Media Informatics and Virtual Communities (4–5 April, 2003), Wiesbaden: Deutscher Universitäts-Verlag: 67–78CrossRefGoogle Scholar
Hayhoe, M. M., Bensinger, D. G., and Ballard, D. H. 1998. Task constraints in visual working memory, Vision Research 38: 125–37CrossRefGoogle ScholarPubMed
Healey, C. G. 1996. Choosing effective colors for data visualization, in Proceedings of the 7th IEEE Conference on Visualization '96. San Francisco: 263–70Google Scholar
Healey, C. G., Booth, K. S., and Enns, J. T. 1996. High-speed visual estimation using preattentive processing, ACM Transactions on Computer–Human Interaction 3: 107–35CrossRefGoogle Scholar
Hochberg, J. E. 1978. Perception (2nd edn). Englewood Cliffs, NJ: Prentice–HallGoogle Scholar
Intriligator, J., and Cavanagh, P. 2001. The spatial resolution of visual attention, Cognitive Psychology 43: 171–216CrossRefGoogle ScholarPubMed
Itti, L. 2005. Models of bottom-up attention and saliency, in Itti, Rees and Tsotsos, : 576–82
Itti, L., Rees, G., and Tsotsos, J. K. (eds.) 2005. Neurobiology of Attention. San Diego: Elsevier
Kamba, T., Elson, S. A., Harpold, T., Stamper, T., and Sukaviriya, P. 1996. Using small screen space more efficiently, in Proceedings of ACM CHI 96, Vancouver: 383–90
Khan, A., Matejka, J., Fitzmaurice, G., and Kurtenbach, G. 2005. Spotlight: Directing users' attention on large displays, in Proceedings of ACM CHI 2005, Portland, OR: 791–98Google Scholar
Kosara, R., Miksch, S., and Hauser, H. 2002. Focus and context taken literally, IEEE Computer Graphics and its Applications 22: 22–9CrossRefGoogle Scholar
Kuhn, G., Amlani, A. A., and Rensink, R. A. 2008. Towards a science of magic, Trends in Cognitive Sciences 12: 349–54CrossRefGoogle ScholarPubMed
Laurel, B. 1993. Computers as Theatre. Reading, MA: Addison-WesleyGoogle Scholar
MacEachren, A. M. 1995. How Maps Work: Representation, Visualization, and Design. New York: Guilford Press: 51–149Google Scholar
Mack, A., and Rock, I. 1998. Inattentional Blindness. Cambridge, MA: MIT PressGoogle Scholar
Marcel, A. J. 1983. Conscious and unconscious perception: Experiments on visual masking and word recognition, Cognitive Psychology 15: 197–237CrossRefGoogle ScholarPubMed
Marr, D. 1982. Vision: A Computational Investigation into the Human Representation and Processing of Visual Information. San Francisco: FreemanGoogle Scholar
Massironi, M., 2002. The Psychology of Graphic Images: Seeing, Drawing, Communicating. Mahwah, NJ: Lawrence Erlbaum AssociatesGoogle Scholar
McCrickard, D. S., and Chewar, C. M. 2003. Attuning notification design to user goals and attention costs, Communications of the ACM 46: 67–72CrossRefGoogle Scholar
Milner, A. D., and Goodale, M. A. 1995. The Visual Brain in Action. Oxford: Oxford University PressGoogle Scholar
Moore, C. M., and Egeth, H. 1997. Perception without attention: Evidence of grouping under conditions of inattention, Journal of Experimental Psychology: Human Perception and Performance 23: 339–52Google ScholarPubMed
Mühlenen, A. von, and Lleras, A. 2007. No-onset looming motion guides spatial attention, Journal of Experimental Psychology: Human Perception and Performance 33: 1297–1310Google Scholar
Mullet, K., and Sano, D. 1995. Designing Visual Interfaces. Englewood Cliffs, NJ: Prentice HallGoogle Scholar
Nakayama, K., He, Z. J., and Shimojo, S. 1995. Visual surface representation: A critical link between lower-level and higher-level vision, in Kosslyn, S. M. and Osherson, D. N. (eds.), Visual Cognition (2nd edn). Cambridge, MA: MIT Press: 1–70Google Scholar
New, J., Cosmides, L., and Tooby, J. 2007. Category-specific attention for animals reflects ancestral priorities, not expertise, Proceedings of the National Academy of Sciences 104: 16598–603CrossRefGoogle Scholar
Norretranders, T. 1999. The User Illusion: Cutting Consciousness Down to Size. New York: Penguin BooksGoogle Scholar
Oliva, A. 2005. Gist of a scene, in Itti, Rees and Tsotsos, : 251–6
Palmer, S. E. 1999. Vision Science: Photons to Phenomenology. Cambridge, MA: MIT PressGoogle Scholar
Parasuraman, R. (ed.) 2000. The Attentive Brain. Cambridge, MA: MIT Press
Pashler, H. 1998. Attention. San Diego: Psychology PressGoogle Scholar
Po, B. A., Fisher, B. D., and Booth, K. S. 2003. Pointing and visual feedback for spatial interaction in large-screen display environments, in Proceedings of the 3rd International Symposium on Smart Graphics, Heidelberg: 22–38Google Scholar
Po, B. A., Fisher, B. D., and Booth, K. S. 2004. Mouse and touchscreen selection in the upper and lower visual fields, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vienna: 359–66
Pylyshyn, Z. W. 2003. Seeing and Visualizing: It's Not What You Think. Cambridge, MA: MIT PressGoogle Scholar
Pylyshyn, Z. W., and Storm, R. W. 1988. Tracking multiple independent targets: Evidence for a parallel tracking mechanism, Spatial Vision 3: 179–97CrossRefGoogle ScholarPubMed
Rensink, R. A. 2000. The dynamic representation of scenes, Visual Cognition 7: 17–42CrossRefGoogle Scholar
Rensink, R. A. 2001. Change blindness: Implications for the nature of attention, in Jenkin, M. and Harris, L. (eds.), Vision and Attention. New York: Springer: 169–88CrossRefGoogle Scholar
Rensink, R. A. 2002a. Change detection, Annual Review of Psychology 53: 245–77CrossRefGoogle ScholarPubMed
Rensink, R. A. 2002b. Internal vs. external information in visual perception, in Proceedings of the 2nd International Symposium on Smart Graphics, Hawthorne, NY: 63–70CrossRefGoogle Scholar
Rensink, R. A. 2003. Visual attention, in Nadel, L. (ed.), Encyclopedia of Cognitive Science. London: Nature Publishing Group: 509–15Google Scholar
Rensink, R. A. 2007. The modeling and control of visual perception, in Gray, W. D. (ed.), Integrated Models of Cognitive Systems. New York: Oxford University Press: 132–48CrossRefGoogle Scholar
Rensink, R. A., and Cavanagh, P. 2004. The influence of cast shadows on visual search, Perception 33: 1339–58CrossRefGoogle ScholarPubMed
Rensink, R. A., and Enns, J. T. 1998. Early completion of occluded objects, Vision Research 38: 2489–505CrossRefGoogle ScholarPubMed
Rensink, R. A., O'Regan, J. K., and Clark, J. J. 1997. To see or not to see: The need for attention to perceive changes in scenes, Psychological Science 8: 368–73CrossRefGoogle Scholar
Richards, W., and Kaufman, L. 1969. ‘Centre-of-gravity’ tendencies for fixations and flow patterns, Perception and Psychophysics 5: 81–4CrossRefGoogle Scholar
Ristic, J., Wright, A., and Kingstone, A. 2007. Attentional control and reflexive orienting to gaze and arrow cues, Psychonomic Bulletin and Review 14: 964–9CrossRefGoogle ScholarPubMed
Roda, C., and Thomas, J. (eds.) 2006. Attention aware systems, special issue of Computers in Human Behavior 22(4): Elsevier
Seif El-Nasr, M. 2005. Intelligent lighting for game environments, Journal of Game Development 1: 17–50Google Scholar
Sharpe, S. 1988. Conjurers' Psychological Secrets. Calgary: Hades Publications: 46–83Google Scholar
Shive, J., and Francis, G. 2008. Applying models of visual search to map display design, International Journal of Human–Computer Studies 66: 67–77CrossRefGoogle Scholar
Simons, D. J., and Chabris, C. 1999. Gorillas in our midst: Sustained inattentional blindness for dynamic events, Perception 28: 1059–74CrossRefGoogle ScholarPubMed
Solso, R. L. 1994. Cognition and the Visual Arts. Cambridge, MA: MIT PressGoogle Scholar
St John, M., Smallman, H. S., Manes, D. I., Feher, B. A., and Morrison, J. G. 2005. Heuristic automation for decluttering tactical displays, Human Factors 47: 509–25CrossRefGoogle ScholarPubMed
Su, S. L., Durand, F., and Agrawala, M. 2005. De-emphasis of distracting image regions using texture power maps, in Texture 2005: Proceedings of the 4th International Workshop on Texture Analysis and Synthesis, Beijing: 119–24
Tatler, B. W. 2002. What information survives saccades in the real world? in Hyönä, J., Munoz, D., Heide, W., and Radach, R. (eds.), The Brain's Eye: Neurobiological and Clinical Aspects of Oculomotor Research. Amsterdam: Elsevier: 149–63CrossRefGoogle Scholar
Theeuwes, J., and Godijn, R. 2002. Irrelevant singletons capture attention: Evidence from inhibition of return, Perception and Psychophysics 64: 764–70CrossRefGoogle ScholarPubMed
Thomas, J. J., and Cook, K. A. (eds.) 2005. Illuminating the Path: The Research and Development Agenda for Visual Analytics. Richland, WA: National Visualization and Analytics Center
Thorpe, S. J., Fize, D., and Marlot, C. 1996. Speed of processing in the human visual system, Nature 381: 520–2CrossRefGoogle ScholarPubMed
Tognazzini, B. 1993. Principles, techniques, and ethics of stage magic and their application to human interface design, in Proceedings of INTERCHI 96. New York: ACM: 355–62Google Scholar
Treisman, A. 1988. Features and objects: The fourteenth Bartlett memorial lecture, Quarterly Journal of Experimental Psychology 40A: 201–37CrossRefGoogle Scholar
Tufte, E. R. 1990. Envisioning Information. Cheshire, CT: Graphics PressGoogle Scholar
Tufte, E. R. 2001. The Visual Display of Quantitative Information (2nd edn). Cheshire, CT: Graphics PressGoogle Scholar
Vertegaal, R. (ed.) 2003. Attentive user interfaces, special issue of Communications of the ACM 46
Vishwanath, D., and Kowler, E. 2003. Localization of shapes: Eye movements and perception compared, Vision Research 43: 1637–53CrossRefGoogle ScholarPubMed
Ward, P. 1996. Picture Composition for Film and Television. Oxford: Butterworth-HeinemannGoogle Scholar
Ware, C. 2004. Information Visualization: Perception for Design (2nd edn). San Francisco: Morgan KaufmannGoogle Scholar
Ware, C. 2008. Visual Thinking for Design. San Francisco: Morgan KaufmannGoogle Scholar
Wickens, C. D., and McCarley, J. S. 2008. Applied Attention Theory. Boca Raton, FL: CRC PressGoogle Scholar
Wolfe, J. M. 1999. Inattentional amnesia, in Coltheart, V. (ed.), Fleeting Memories. Cambridge, MA: MIT Press: 71–94Google Scholar
Wolfe, J. M. 2000. Visual attention, in Valois, K. K. (ed.), Seeing (2nd edn). San Diego: Academic Press: 335–86CrossRefGoogle Scholar
Wolfe, J. M. 2005. How might the rules that govern visual search constrain the design of visual displays? Society for Information Display. Boston, MAGoogle Scholar
Wolfe, J. M., and DiMase, J. S. 2003. Do intersections serve as basic features in visual search? Perception 32: 645–56CrossRefGoogle ScholarPubMed

Save book to Kindle

To save this book to your Kindle, first ensure [email protected] is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×