Feel the image: The role of emotions in the image-seeking process

• Published in: Human-computer interaction 2019-05, Vol.34 (3), p.240-277
• Main Authors: Poretski, Lev, Lanir, Joel, Arazy, Ofer
• Format: Article
• Language: English
• Subjects: Complex systems; Emotions; Empirical analysis; Image management; Image retrieval; Qualitative analysis; Searching
• ISSN: 0737-0024; 1532-7051
• DOI: 10.1080/07370024.2017.1359604

Images are characterized by a complex system of attributes. One of the most elusive properties of an image is its emotiveness - the ability to trigger an emotional reaction in the viewer. Prior research has demonstrated that users react to image emotiveness, yet to date there is little theoretical understanding and scarce empirical evidence as to the role played by emotiveness in the image retrieval process. Our study aims to fill this gap and investigates how users perceive the emotional content of the image-seeking task; explicate this emotional content in search keywords; and react to image emotiveness in selecting relevant images. Using a multimethod approach that combines quantitative and qualitative analyses, we performed three experiments where participants searched for images, both within the predefined set of images and in an open Web environment. Our findings suggest that although seekers rarely explicate image emotiveness in search keywords, their decision to select relevant images is largely dependent on their perception of the emotional content of the task and images. We discuss implications for research on emotions in image retrieval, as well as practical implications for designers of search systems.