DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Continuous, Real-Time Emotion Annotation: A Novel Joystick-Based Analysis Framework

Sharma, Karan and Castellini, Claudio and Stulp, Freek and van den Broek, Egon (2020) Continuous, Real-Time Emotion Annotation: A Novel Joystick-Based Analysis Framework. IEEE Transactions on Affective Computing, 11 (1), pp. 78-84. IEEE - Institute of Electrical and Electronics Engineers. doi: 10.1109/TAFFC.2017.2772882. ISSN 1949-3045.

Full text not available from this repository.

Official URL: https://dx.doi.org/10.1109/TAFFC.2017.2772882


Emotion labels are usually obtained via either manual annotation, which is tedious and time-consuming, or questionnaires, which neglect the time-varying nature of emotions and depend on human's unreliable introspection. To overcome these limitations, we developed a continuous, real-time, joystick-based emotion annotation framework. To assess the same, 30 subjects each watched 8 emotion-inducing videos. They were asked to indicate their instantaneous emotional state in a valence-arousal (V-A) space, using a joystick. Subsequently, five analyses were undertaken: (i) a System Usability Scale (SUS) questionnaire unveiled the framework's excellent usability; (ii) MANOVA analysis of the mean V-A ratings and (iii) trajectory similarity analyses of the annotations confirmed the successful elicitation of emotions; (iv) Change point analysis of the annotations, revealed a direct mapping between emotional events and annotations, thereby enabling automatic detection of emotionally salient points in the videos; and (v) Support Vector Machines (SVM) were trained on classification of 5 second chunks of annotations as well as their change-points. The classification results confirmed that ratings patterns were cohesive across the participants. These analyses confirm the value, validity, and usability of our annotation framework. They also showcase novel tools for gaining greater insights into the emotional experience of the participants.

Item URL in elib:https://elib.dlr.de/193683/
Document Type:Article
Title:Continuous, Real-Time Emotion Annotation: A Novel Joystick-Based Analysis Framework
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Sharma, KaranUNSPECIFIEDhttps://orcid.org/0000-0002-3323-7034UNSPECIFIED
Castellini, ClaudioUNSPECIFIEDhttps://orcid.org/0000-0002-7346-2180UNSPECIFIED
Stulp, FreekUNSPECIFIEDhttps://orcid.org/0000-0001-9555-9517UNSPECIFIED
van den Broek, EgonUNSPECIFIEDhttps://orcid.org/0000-0002-2017-0141UNSPECIFIED
Date:March 2020
Journal or Publication Title:IEEE Transactions on Affective Computing
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In ISI Web of Science:Yes
Page Range:pp. 78-84
Publisher:IEEE - Institute of Electrical and Electronics Engineers
Keywords:emotion annotation
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Robotics
DLR - Research area:Raumfahrt
DLR - Program:R RO - Robotics
DLR - Research theme (Project):R - Medical Assistance Systems [RO]
Location: Oberpfaffenhofen
Institutes and Institutions:Institute of Robotics and Mechatronics (since 2013)
Deposited By: Strobl, Dr. Klaus H.
Deposited On:28 Jan 2023 12:07
Last Modified:28 Jan 2023 12:07

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.