Volkova Ya.A., Vashunina I.V. Understanding Emotional Responses to Text: A Psycholinguistic Investigation of Visual Influences

DOI: https://doi.org/10.15688/jvolsu2.2024.5.14

Yana A. Volkova

Doctor of Sciences (Philology), Professor, Department of Foreign Languages in Theory and Practice, Peoples' Friendship University of Russia named after Patrice Lumumba

MiklukhoMaklaya St, 7, 117198 Moscow, Russia

This email address is being protected from spambots. You need JavaScript enabled to view it.

https://orcid.org/0000-0003-1456-5881

Irina V. Vashunina

Doctor of Sciences (Philology), Head of the Department of Romano-Germanic Languages, Russian Foreign Trade Academy

Vorobyovskoye Shosse, 6a, 119285 Moscow, Russia

Professor, Department of Foreign Languages in Theory and Practice, Peoples' Friendship University of Russia named after Patrice Lumumba

Miklukho-Maklaya St, 7, 117198 Moscow, Russia

This email address is being protected from spambots. You need JavaScript enabled to view it.

https://orcid.org/0000-0002-3482-8215


Abstract. The paper explores the influence of visual elements on the emotional perception of textual content. Based on the experimental results, the authors evaluated how illustrations affected emotional responses to polycode/ creolized texts. By using the semantic differential scales method, correlations between emotions and specific visual parameters were identified and analyzed. The results revealed how visual parameters of illustrations influence emotional responses to text in Russian, suggesting potential adjustments to emotional perception by manipulating these parameters: illustration style impacts recipient emotions; ambiguity and originality increase negative emotions, while realistic illustrations have varied effects. Additionally, the study investigated how variations in illustration style and content altered emotional interpretations of text, providing insights into the complex interplay between visual and verbal elements in communication. The findings suggest practical implications for educational material development, emphasizing the potential to adjust the emotional perception of textual content by manipulating visual characteristics. This research sheds light on the dynamics of emotional response to multimedia stimuli and offers valuable considerations for content creators seeking to optimize audience engagement and comprehension. It attempts to bridge the gap between visual perception, emotion processing, and linguistic communication, offering insights for both practical applications in NLP (Natural Language Processing) and theoretical advancements in cognitive sciences.

Key words: polycode texts, creolization, emotion, emotional perception, verbal message, semantic differential scales method, text-image interaction.

Citation. Volkova Ya.A., Vashunina I.V. Understanding Emotional Responses to Text: A Psycholinguistic Investigation of Visual Influences. Vestnik Volgogradskogo gosudarstvennogo universiteta. Seriya 2. Yazykoznanie [Science Journal of Volgograd State University. Linguistics], 2024, vol. 23, no. 5, pp. 174-185. DOI: https://doi.org/10.15688/jvolsu2.2024.5.14

Understanding Emotional Responses to Text: A Psycholinguistic Investigation of Visual Influences by Volkova Ya.A., Vashunina I.V. is licensed under CC BY 4.0

Attachments:
Download this file (3_Volkova_Vashunina.pmd.pdf) 3_Volkova_Vashunina.pmd.pdf
URL: https://l.jvolsu.com/index.php/en/component/attachments/download/3013
8 Downloads