Abstract
Introduction. Eye movements objectively reflect perceptual, cognitive and emotional processes during visual perception. Studies aimed at analyzing human oculomotor activity require the use of special equipment (an infrared video oculograph or eye tracker), as well as software for creating, conducting and analyzing experiments. Methods. A qualitative analysis of the results of eye-tracking studies makes it possible to visualize the order of attention (using gaze movement maps), as well as the proportion of attention (using heat maps) to stimulus elements. With the help of quantitative analysis, it is possible to statistically test hypotheses about the distribution of attention, as well as to assess the cognitive load both over the entire stimulus and by highlighting individual areas of interest (the so-called Areas of Interest mechanism, which allows calculating statistics in individual parts of the stimulus). Quantitative parameters are used to classify errors and as a predictive metric for target recognition. Quantitative parameters of fixations and saccades are used to assess professional experience, as well as to diagnose disorders of mental development and emotional disorders. Results and discussion. Software with advanced capabilities for qualitative and quantitative analysis allows for a comprehensive assessment of both the mental processes of a person and the visual features of the presented stimulus. An in-depth analysis of oculomotor activity metrics is primarily relevant for research in the field of cognitive psychology, but can also be useful in other scientific and applied areas: psychopathology, pedagogy, ergonomics, medicine, and neuromarketing. The mechanisms of processing «raw data» and algorithms for determining the types of eye movements, identifying saccades and fixations are shown using the IVT algorithm as an example. Examples of research in applied fields are given. The novelty of the article lies in the fact that eye tracking is considered as a tool for studying cognitive processes and analyzing a person's gaze on a spatio-temporal basis. It is an integration of qualitative and quantitative analysis using specialized software.
References
Zashchirinskaya, O. V., Skuratova, K. A., Shelepin, E. YU. (2019). Specifika glazodvigatel'noj aktivnosti detej pri chtenii tekstov raznyh vizual'nyh formatov. Sibirskij Psihologicheskij Zhurnal, 73, 141–158. https://doi.org/10.17223/17267080/73/9 (in Russ).
Ahlstrom, U., & Friedman-Berg, F. J. (2006). Using eye movement activity as a correlate of cognitive workload. International Journal of Industrial Ergonomics, 36(7), 623–636. https://doi.org/10.1016/j.ergon.2006.04.002
App, E., & Debus, G. (1998). Saccadic velocity and activation: Development of a diagnostic tool for assessing energy regulation. Ergonomics, 41(5), 689–697. https://doi.org/10.1080/001401398186856
Blakley, E. C., Gaspelin, N., & Gerhardstein, P. (2022). The development of oculomotor suppression of salient distractors in children. Journal of Experimental Child Psychology, 214. https://doi.org/10.1016/j.jecp.2021.105291
Bojko, A. (2006). Using eye tracking to compare web page designs: A case study. Journal of Usability Studies, 1(3), 112–120.
Clifton, C., Staub, A., & Rayner, K. (2007). Eye movements in reading words and sentences. In R. Van Gompel, M. Fischer, W. S. Murray, & R. L. Hill (Eds.), Eye movements: A window on mind and brain (pp. 341–372). Elsevier.
de Graef, P., Christiaens, D., & D'Ydewalle, G. (1990). Perceptual effects of scene context on object identification. Psychological Research, 52(4), 317-329.
Di Stasi, L. L., Antolí, A., & Cañas, J. J. (2011). Main sequence: An index for detecting mental workload variation in complex tasks. Applied Ergonomics, 42(6), 807–813. https://doi.org/10.1016/j.apergo.2011.01.003
Dong, W., Zheng, L., Liu, B., & Meng, L. (2018). Using eye tracking to explore differences in map-based spatial ability between geographers and non-geographers. ISPRS International Journal of Geo-Information, 7(9). https://doi.org/10.3390/ijgi7090337
Eckstein, M. K., Guerra-Carrillo, B., Singley, A. T. M., & Bunge, S. A. (2017). Beyond eye gaze: What else can eyetracking reveal about cognition and cognitive development? Developmental Cognitive Neuroscience, 25, 69–91. https://doi.org/10.1016/j.dcn.2016.11.001
Fox, S. E., & Faulkner-Jones, B. E. (2017). Eye-tracking in the study of visual expertise: Methodology and approaches in medicine. Frontline Learning Research, 5(3), 43–54. https://doi.org/10.14786/flr.v5i3.258
Goldberg, J. H., & Kotval, X. P. (1999). Computer interface evaluation using eye movements: Methods and constructs. International Journal of Industrial Ergonomics, 24(6), 631–645. https://doi.org/10.1016/S0169-8141(98)00068-7
Goldberg, J. H., Stimson, M. J., Lewenstein, M., Scott, N., & Wichansky, A. M. (2002). Eye tracking in web search tasks: Design implications. Paper presented at the Eye Tracking Research and Applications Symposium (ETRA) (pp. 51–58). https://doi.org/10.1145/507072.507082
Hannula, D. E., Althoff, R. R., Warren, D. E., Riggs, L., Cohen, N. J., & Ryan, J. D. (2010). Worth a glance: Using eye movements to investigate the cognitive neuroscience of memory. Frontiers in Human Neuroscience, 4. https://doi.org/10.3389/fnhum.2010.00166
Hashimoto, R. (2021). Do eye movement abnormalities in schizophrenia cause Praecox Gefühl? Psychiatry and Clinical Neurosciences, 75(3), 79–80. https://doi.org/10.1111/pcn.13197
Hébraud, C., Hoffman, E., Pene, N., Rognin, L., & Zeghal, K. (2004). Assessing the impact of a new air traffic control instruction on flight crew activity. Paper presented at the Collection of Technical Papers - AIAA Guidance, Navigation, and Control Conference, 3, 1590-1598.
Henderson, J. M., Malcolm, G. L., & Schandl, C. (2009). Searching in the dark: Cognitive relevance drives attention in real-world scenes. Psychonomic Bulletin & Review, 16, 850–856. https://doi.org/10.3758/PBR.16.5.850
Ingre, M., Åkerstedt, T., Peters, B., Anund, A., & Kecklund, G. (2006). Subjective sleepiness, simulated driving performance and blink duration: Examining individual differences. Journal of Sleep Research, 15(1), 47–53. https://doi.org/10.1111/j.1365-2869.2006.00504.x
Inhoff, A. W., & Radach, R. (1998). Definition and computation of oculomotor measures in the study of cognitive processes. In G. M. Underwood (Ed.), Eye guidance in reading and scene perception (pp. 29–53). Elsevier.
Jacob, R. J. K., & Karn, K. S. (2003). Commentary on Section 4. Eye tracking in human-computer interaction and usability research: Ready to deliver the promises. The Mind’s Eye, 573–605. https://doi.org/10.1016/B978-044451020-4/50031-1
Kaakinen, J. K. (2021). What can eye movements tell us about visual perception processes in classroom contexts? Commentary on a special issue. Educational Psychology Review, 33, 169–179. https://doi.org/10.1007/s10648-020-09573-7
Kim, M., Shin, W., Lee, T. H., Kim, T., Hwang, W. J., & Kwon, J. S. (2021). Eye movement as a biomarker of impaired organizational strategies during visual memory encoding in obsessive–compulsive disorder. Scientific Reports, 11. https://doi.org/10.1038/s41598-021-97885-1
Kliegl, R., Grabner, E., Rolfs, M., & Engbert, R. (2004). Length, frequency, and predictability effects of words on eye movements in reading. European Journal of Cognitive Psychology, 16(1–2), 262–284. https://doi.org/10.1080/09541440340000213
Komogortsev, O. V., Gobert, D. V., Jayarathna, S., Koh, D. H., & Gowda, S. M. (2010). Standardization of automated analyses of oculomotor fixation and saccadic behaviors. In IEEE Transactions on Biomedical Engineering, 57(11), 2635–2645. https://doi.org/10.1109/TBME.2010.2057429
Kundel, H. L., Nodine, C. F., Krupinski, E. A., & Mello-Thoms, C. (2008). Using gaze-tracking data and mixture distribution analysis to support a holistic model for the detection of cancers on mammograms. Academic Radiology, 15(7), 881–886. https://doi.org/10.1016/j.acra.2008.01.023
Liversedge, S. P., Gilchrist, I., & Everling, S. (Eds.). (2012). The Oxford Handbook of eye movements. Oxford Library of Psychology. https://doi.org/10.1093/oxfordhb/9780199539789.001.0001
Maron, D. N., Bowe, S. J., Spencer-Smith, M., Mellahn, O. J., Perrykkad, K., Bellgrove, M. A., & Johnson, B. P. (2021). Oculomotor deficits in attention deficit hyperactivity disorder (ADHD): A systematic review and comprehensive meta-analysis. Neuroscience and Biobehavioral Reviews, 131, 1198–1213. https://doi.org/10.1016/j.neubiorev.2021.10.012
Motoki, K., Saito, T., & Onuma, T. (2021). Eye-tracking research on sensory and consumer science: A review, pitfalls and future directions. Food Research International, 145. https://doi.org/10.1016/j.foodres.2021.110389
Munn, S. M., Stefano, L., & Pelz, J. B. (2008). Fixation-identification in dynamic scenes: Comparing an automated algorithm to manual coding. In Proceedings of the Symposium on applied perception in graphics and visualization (pp. 33–42). https://doi.org/10.1145/1394281.1394287
Oppenheim, A. (1997). Signals and systems (2nd ed.). Prentice-Hall.
Orquin, J. L., Bagger, M. P., Lahm, E. S., Grunert, K. G., & Scholderer, J. (2020). The visual ecology of product packaging and its effects on consumer attention. Journal of Business Research, 111, 187–195. https://doi.org/10.1016/j.jbusres.2019.01.043
Over, E. A. B., Hooge, I. T. C., Vlaskamp, B. N. S., & Erkelens, C. J. (2007). Coarse-to-fine eye movement strategy in visual search. Vision Research, 47(17), 2272–2280. https://doi.org/10.1016/j.visres.2007.05.002
Poole, A., & Ball, L. J. (2005). Eye tracking in human–computer interaction and usability research: Current status and future. In C. Ghaoui (Ed.), Encyclopedia of human–computer interaction (pp. 211–219). Idea Group, Inc.
Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychological Bulletin, 124(3), 372–422. https://doi.org/10.1037/0033-2909.124.3.372
Rayner, K. (2009). Eye movements and attention in reading scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62(8), 1457–1506.
Rayner, K., & Pollatsek, A. (1989). The psychology of reading. Prentice Hall.
Salvucci, D. D., & Goldberg, J. H. (2000). Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the Eye Tracking Research and Applications Symposium (pp. 71–78). https://doi.org/10.1145/355017.355028
Sanders, A. F. (1983). Towards a model of stress and human performance. Acta Psychologica, 53(1), 61–97. https://doi.org/10.1016/0001-6918(83)90016-1
Schreij, D., Owens, C., & Theeuwes, J. (2008). Abrupt onsets capture attention independent of top-down control settings. Perception and Psychophysics, 70, 208–218. https://doi.org/10.3758/PP.70.2.208
Sharafi, Z., Soh, Z., & Guéhéneuc, Y.-G. (2015). A systematic literature review on the usage of eye-tracking in software engineering. Information and Software Technology, 67, 79–107. https://doi.org/10.1016/j.infsof.2015.06.008
Skuratova, K. A., Shelepin, E. Yu., & Yarovaya, N. P. (2021). Optical search and visual expertise. Journal of Optical Technology, 88(12), 700–705. https://doi.org/10.1364/JOT.88.000700
Spivey, M. J., & Tanenhaus, M. K. (1998). Syntactic ambiguity resolution in discourse: Modeling the effects of referential context and lexical frequency. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24(6), 1521–1543. https://doi.org/10.1037/0278-7393.24.6.1521
Strohmaier, A. R., MacKay, K. J., Obersteiner, A., & Reiss, K. M. (2020). Eye-tracking methodology in mathematics education research: A systematic literature review. Educational Studies in Mathematics, 104, 147–200. https://doi.org/10.1007/s10649-020-09948-1
Vigneau, F., Caissie, A. F., & Bors, D. A. (2006). Eye-movement analysis demonstrates strategic influences on intelligence. Intelligence, 34(3), 261–272. https://doi.org/10.1016/j.intell.2005.11.003
Williams, L. H., & Drew, T. (2019). What do we know about volumetric medical image interpretation?: A review of the basic science and medical image perception literatures. Cognitive Research: Principles and Implications, 4, 21. https://doi.org/10.1186/s41235-019-0171-6
Wilson, M. R. (2012). Anxiety: Attention, the brain, the body and performance. In S. Murphy (Ed.), The Oxford handbook of sport and performance psychology (pp. 173–190). Oxford University Press.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2022 Skuratova, K.A., Shelepin, E. Yu., Shelepin, K. Yu.