DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Continuous, real-time emotion annotation: A novel joystick-based analysis framework

Sharma, Karan and Castellini, Claudio and Stulp, Freek and van den Broek, Egon (2017) Continuous, real-time emotion annotation: A novel joystick-based analysis framework. IEEE Transactions on Affective Computing, PP (99), p. 1. IEEE - Institute of Electrical and Electronics Engineers. doi: 10.1109/TAFFC.2017.2772882. ISSN 1949-3045.

[img] PDF (Pre-print (accepted) version of the article.)

Official URL: http://ieeexplore.ieee.org/document/8105870/


Emotion labels are usually obtained via either manual annotation, which is tedious and time-consuming, or questionnaires, which neglect the time-varying nature of emotions and depend on human's unreliable introspection. To overcome these limitations, we developed a continuous, real-time, joystick-based emotion annotation framework. To assess the same, 30 subjects each watched 8 emotion-inducing videos. They were asked to indicate their instantaneous emotional state in a valence-arousal (V-A) space, using a joystick. Subsequently, five analyses were undertaken: (i) a System Usability Scale (SUS) questionnaire unveiled the framework's excellent usability; (ii) MANOVA analysis of the mean V-A ratings and (iii) trajectory similarity analyses of the annotations confirmed the successful elicitation of emotions; (iv) Change point analysis of the annotations, revealed a direct mapping between emotional events and annotations, thereby enabling automatic detection of emotionally salient points in the videos; and (v) Support Vector Machines (SVM) were trained on classification of 5 second chunks of annotations as well as their change-points. The classification results confirmed that ratings patterns were cohesive across the participants. These analyses confirm the value, validity, and usability of our annotation framework. They also showcase novel tools for gaining greater insights into the emotional experience of the participants.

Item URL in elib:https://elib.dlr.de/115348/
Document Type:Article
Title:Continuous, real-time emotion annotation: A novel joystick-based analysis framework
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Sharma, KaranUNSPECIFIEDhttps://orcid.org/0000-0002-3323-7034UNSPECIFIED
Castellini, ClaudioUNSPECIFIEDhttps://orcid.org/0000-0002-7346-2180UNSPECIFIED
Stulp, FreekUNSPECIFIEDhttps://orcid.org/0000-0001-9555-9517UNSPECIFIED
van den Broek, EgonUNSPECIFIEDhttps://orcid.org/0000-0002-2017-0141UNSPECIFIED
Date:13 November 2017
Journal or Publication Title:IEEE Transactions on Affective Computing
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In ISI Web of Science:Yes
Page Range:p. 1
Publisher:IEEE - Institute of Electrical and Electronics Engineers
Keywords:Affective Computing, Emotion in human-computer interaction, Tools and methods of annotation, Time-series analysis, Changepoint analysis, Pattern Recognition
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space System Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Space System Technology
DLR - Research theme (Project):R - Terrestrial Assistance Robotics (old)
Location: Oberpfaffenhofen
Institutes and Institutions:Institute of Robotics and Mechatronics (since 2013) > Cognitive Robotics
Deposited By: Sharma, Karan
Deposited On:29 Nov 2017 16:15
Last Modified:31 Jul 2019 20:12

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.