Abstract
Introduction. We conducted an experiment in the paradigm of direct comparison of images of strong and weakly expressed emotional expressions with a detailed justification of the assessment made and registration of eye movements.
Methods. Photo images from the VEPEL database (video images of natural transient facial expressions: joy, sadness, fear, surprise, anger, disgust, calm face) were used as stimulus material. The subjects were students of Moscow universities (72 people, of which 10 men, 62 women; age from 18 to 39 years, average age = 22.0, standard deviation = 4.0. Exposure time is unlimited, until the justification is completed. Research objective: image comparison (rank scale of similarity between images from 1 to 9) with registration of eye movements.
Results. Based on individual assessments of similarity between images of emotional expressions, the reconstruction of the two-dimensional space was performed using the multidimensional scaling method. The reconstruction is described by Core Affect model by J. Russell. The presence of individual variability of similarity scores (the tendency to select a certain range of scores) is shown. The following individual indicators were singled out for further search of possible predictors: the average similarity score between images, the standard deviation of the similarity score between images, and the average individual duration of fixations. The presence of variability of estimates for different pairs of compared images is shown. The minimum variability of similarity estimates is achieved for the next pairs: fear–fear weak, joy – joy weak; anger – anger weak; disgust weak – anger; neutral – sadness weak. The maximum variability of similarity estimates is achieved for pairs of joy weak – fear weak; joy – fear weak; sadness – joy weak; joy weak – anger weak; neutral – joy weak. The analysis of the duration of visual fixations during the similarity assessment was carried out. It is shown that different similarity scores correspond to different distribution patterns of fixation durations in the evaluation process.
Discussion. Based on our results, we can conclude that there are several convergent evaluation justification processes based on an initial similarity score between images.
References
Барабанщиков, В. А., Жегалло, А. В., Королькова, О. А. (2016). Перцептивная категоризация выражений лица. Когито-Центр.
Бернштейн, Н. (1990). Физиология движений и активность. Наука.
Басюл, И. А., Самойленко, Е. С. (2019). Структура окуломоторной активности в процессе сравнения изображений лиц в разных контекстах. Ананьева, К. И., Барабанщиков, В. А.,. Демидова, А. А. (ред.). Лицо человека: познание, общение, деятельность. Коллективная монография. Институт психоанализа.
Бондаренко, Я. А., Меньшикова, Г. Я. (2020). Исследование роли аналитического и холистического процессов в распознавании лицевых экспрессий. Вестник московского университета. Серия 14. Психология, 2, 103–140. https://doi.org/10.11621/vsp.2020.02.06
Жегалло, А. В. (2021). Прямое сравнение изображений: границы применимости «дискретной» и «многомерной» моделей восприятия эмоциональных экспрессий. Экспериментальная психология, 14(2), 37–52. https://doi.org/10.17759/exppsy.2021140203
Жегалло, А. В. (2016). Использование ПО PXLab для подготовки экспериментов, включающих регистрацию движений глаз с помощью айтрекеров Sensomotoric Instruments. Российский журнал когнитивной науки, 3(3), 43–57.
Измайлов, Ч. А., Коршунова, С. Г., Шехтер, М. С., Потапова, А. Я. (2009). Зрительное различение сложных конфигураций: эмоциональная экспрессия человеческого лица. Теоретическая и экспериментальная психология, 2(1), 5–25.
Куракова, О. А. (2012). Создание новой базы фотоизображений естественных переходов между базовыми эмоциональными экспрессиями лица. Барабанщиков, В. А, Демидов, А. А. Дивеев, Д. А. (ред). Лицо человека как средство общения: Междисциплинарный подход. Когито-Центр.
Носуленко, В. Н., Самойленко, Е. С. (2019). Категоризация и сравнение в психологических исследованиях. Журавлев, А. Л., Сергиенко, Е. А., Виленская, Г. А. (ред). Разработка понятий в современной психологии. ИРАН.
Самойленко, Е. С. (2010). Проблемы сравнения в психологическом исследовании. ИПРАН.
Шендяпин, В. М., Скотникова, И. Г. (2015). Моделирование принятия решения и уверенности в сенсорных задачах. ИПРАН.
Beermann, U., Hosoya, G., Schindler, I., Scherer, K. R., Eid, M., Wagner, V., Menninghaus, W. (2021). Dimensions and Clusters of Aesthetic Emotions: A Semantic Profile Analysis. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.667173
Crivelli, C., Fridlund, A. J. (2019). Inside‑Out: From Basic Emotions Theory to the Behavioral Ecology View. Journal of Nonverbal Behavior, 43, 161–194. https://doi.org/10.1007/s10919-019-00294-2
De Leeuw, J., Mair, P. (2009) Multidimensional scaling using majorization: The R package smacof. Journal of Statistical Software, 31(3), 1–30.
Ekman, P. (1971). Universals and Cultural Differences in Facial Expressions of Emotion. University of Nebraska Press.
Ekman, P. (1999). Basic Emotions. Handbook of Cognition and Emotion. John Wiley & Sons. https://doi.org/10.1002/0470013494.ch3
Ekman, P., Cordaro, D. (2011) What is meant by calling emotions basic, Emotion Review, 3(4), 364–370.
Ekman, P. (2017). Facial expressions. The science of facial expression. Fernández-Dols J. M. & Russell J. A. (Eds.). Oxford University Press. https://doi.org/10.1093/acprof:oso/9780190613501.003.0003
Etcoff, N. L., Magee, J. J. (1992). Categorical perception of facial expressions. Cognition, 44(3), 227–240.
Harnad, S. (1987). Categorical perception: The groundwork of cognition. Cambridge University Press.
Liberman, A. M., Harris, K. S., Hoffman, H. S., Griffith, B. G. (1957). The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology, 54(5), 358–368.
Mehu, M., Scherer, K. R. (2015). Emotion categories and dimensions in the facial communication of affect: An integrated approach. Emotion, 15(6), 798–811. https://doi.org/10.1037/a0039416
R Core Team. (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing. https://www.R-project.org/
Russell, J., Barrett, L. (1999). Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. Journal of personality and social psychology, 76(5), 805–819. https://doi.org/10.1037//0022-3514.76.5.805
Russell, J. A. (2017). Mixed Emotions Viewed from the Psychological Constructionist Perspective. Emotion Review, 9(2), 111–117. https://doi.org/10.1177/1754073916639658
Sander, D., Grandjean, D., & Scherer, K. R. (2018). An Appraisal-Driven Componential Approach to the Emotional Brain. Emotion Review, 10(3), 219–231. https://doi.org/10.1177/1754073918765653
Scherer, K. R. (2001). Appraisal considered as a process of multilevel sequential checking. In K.R. Scherer, A. Schorr, & T. Johnstone (Eds.). Appraisal processes in emotion: Theory, methods, research. Oxford University Press.
Scherer, K. R. (2019). Towards a Prediction and Data Driven Computational Process Model of Emotion. IEEE Transactions on Affective Computing, 12(2), 279–292, https://doi.org/10.1109/TAFFC.2019.2905209
Zachar, P., Ellis, R. D. (eds) (2012). Categorical versus Dimensional Models of Affect. A seminar of the theories of Panksepp and Russell. John Benjamins B.V.
Yik, M., Russell, J. A., Steiger, J. H. (2011). A 12-Point Circumplex Structure of Core Affect. Emotion, 11(4), 705–731.
This work is licensed under a Creative Commons Attribution 4.0 International License.
Copyright (c) 2023 Alexander V. Zhegallo, Ivan A. Basyul