(NSF Project) SoCS: Studying the Computability of Emotions by Harnessing Massive Online Social Data

Papers: [ACII 2017] [IEEE TAC 2019] [Psychiatry Research 2018] [IJCV 2019]
Development and Validation of the Image Stimuli for Emotion Elicitation (ISEE): A Novel Affective Pictorial System with Test-Retest Repeatability

Hanjoo Kim, Xin Lu, Michael Costa, Baris Kandemir, Reginald B. Adams, Jr., Jia Li, James Z. Wang and Michelle G. Newman
The Pennsylvania State University, USA

Abstract:

The aim of this study was to develop a novel set of pictorial stimuli for emotion elicitation. The Image Stimuli for Emotion Elicitation (ISEE), are the first set of stimuli for which there was an unbiased initial selection method and with images specifically selected for high retest correlation coefficients and high agreement across time. In order to protect against a researcher’s subjective bias in screening initial pictures, we crawled 10,696 images from the biggest image hosting website (Flickr.com) based on a computational selection method. In the initial screening study, participants rated stimuli twice for emotion elicitation across a 1-week interval and 1,620 images were selected based on the number of ratings of participants and retest reliability of each picture. Using this set of stimuli, a second phase of the study was conducted, again having participants rate images twice with a 1-week interval, in which we found a total of 158 unique images that elicited various levels of emotionality with both good reliability and good agreement over time. The newly developed pictorial stimuli set is expected to facilitate cumulative science on human emotions.

Keywords: emotion elicitation, pictorial stimuli, emotional dimensions, test-retest analysis, repeatability, reliability, agreement, Pearson correlation analysis, Bland-Altman analysis


Full Paper
(PDF)

Dataset:
ISEE Pictures List (Excel Spreadsheet)

Thumbnails (0.6MB)

ISEE Validated Images.zip (25MB): In order to avoid any potential copyright infringement and ensure these images are used only for research purposes, please obtain these images by contacting James Wang (jwang at ist.psu.edu).


Citation:
(IEEE Format)
Hanjoo Kim, Xin Lu, Michael Costa, Baris Kandemir, Reginald B. Adams, Jr., Jia Li, James Z. Wang and Michelle G. Newman, ``Development and Validation of Image Stimuli for Emotion Elicitation (ISEE): A Novel Affective Pictorial System with Test-Retest Repeatability,'' Psychiatry Research, vol. 261, pp. 414-420, Elsevier, 2018.

(APA Format)
Kim, H., Lu, X., Costa, M., Kandemir, B., Adams, R.B., Jr., Li, J., Wang, J.Z., & Newman, M.G. (2018). Development and Validation of Image Stimuli for Emotion Elicitation (ISEE): A Novel Affective Pictorial System with Test-Retest Repeatability. Psychiatry Research, 261:414-420.



© 2018 All rights reserved.