Title: Affective image classification
Language: English
Authors: Machajdik, Jana 
Qualification level: Diploma
Advisor: Hanbury, Allan 
Issue Date: 2009
Number of Pages: 110
Qualification level: Diploma
Bilder sprechen mehr als tausend Worte. Einer ihrer Aspekte ist, dass sie auf Menschen eine emotionale Wirkung haben. Da diese meist subjektiv wird sie selten indexiert und kann somit nicht von Suchmaschinen wiedergefunden werden. In einigen Bereichen ist aber die Wahl des gesuchten Bildes vom emotionalen Ausdrucks abhängig. Das Ziel dieser Arbeit ist es, Methoden zu untersuchen um Bilder anhand ihres emotionalen Ausdrucks zu klassifizieren. Dabei werden theoretische und empirische Konzepte aus der Psychologie, Kunst und Digitaler Bildverarbeitung verwendet.
Wir setzen theoretische Konzepte in mathematische Formeln um und berechnen spezifische Merkmale der Bilder. Diese werden dann von Machine Learning Algorithmen verarbeitet um eine Klassifizierung anhand von Emotionen zu erzielen.
Mit unseren Merkmalen erzielen wir bessere Resultate als vergleichbare Publikationen in diesem Bereich.

Images speak more than thousand words. One of their aspects is that they can aect people on an emotional level. Since the emotions that arise in the viewer of an image are highly subjective, they are rarely indexed. However there are situations when it would be helpful if images could be retrieved based on their emotional content.
Our goal is to use image-processing methods to investigate or develop methods to extract and combine low-level features that represent the emotional content of an image and build a framework that classifies images automatically.
Specifically, we exploit theoretical and empirical concepts from psychology and art theory to extract image features that are specific to the domain of artworks with emotional expression.
For our work we choose a dimensional approach to emotions that is known from the field of psychophysiology. According to this approach an emotion can be classified by coordinates in a two-dimensional emotion space where one axis represents valence (the type of emotion), ranging from pleasant to unpleasant, and the second axis is defined as arousal (the intensity of the emotion), ranging from calm to exciting/thrilling. Emotions mapped onto this space can be translated into words like angry, sad, exciting etc. and these can be used for automatic indexing of images.
Machine learning methods are used to learn classification based on these features.
For testing and training, we use three types of data sets, the International Aective Picture System (IAPS) (which is also used by Yanulevskaya et al.), a set of artistic photography downloaded from a photo sharing site (to investigate whether the conscious use of colors and textures displayed by the artists improves the classification) and a set of peer rated abstract paintings to investigate the influence of the features' performance and ratings on pictures without contextual content. Improved classification results are obtained on the IAPS set, compared to Yanulevskaya et al., who use general purpose image features.
Keywords: emotional; emotion; bild klassifikation; bild verarbeitung
affect; emotion; image classification; image processing
URI: https://resolver.obvsg.at/urn:nbn:at:at-ubtuw:1-35156
Library ID: AC07805949
Organisation: E183 - Institut für Rechnergestützte Automation 
Publication Type: Thesis
Appears in Collections:Thesis

Files in this item:

File Description SizeFormat
Machajdik Jana - 2009 - Affective image classification.pdf19.85 MBAdobe PDFThumbnail
Show full item record

Page view(s)

checked on Apr 26, 2021


checked on Apr 26, 2021

Google ScholarTM


Items in reposiTUm are protected by copyright, with all rights reserved, unless otherwise indicated.