DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Activity and Stress Estimation Based on OpenPose and Electrocardiogram for User-Focused Level-4-Vehicles

Walocha, Fabian and Drewitz, Uwe and Ihme, Klas (2022) Activity and Stress Estimation Based on OpenPose and Electrocardiogram for User-Focused Level-4-Vehicles. IEEE Transactions on Human-Machine Systems, 52 (4), pp. 538-546. IEEE - Institute of Electrical and Electronics Engineers. doi: 10.1109/THMS.2022.3155375. ISSN 2168-2291.

[img] PDF - Postprint version (accepted manuscript)

Official URL: https://ieeexplore.ieee.org/document/9734747


Increasing vehicle automation changes the role of humans in the car, which imposes new requirements on the design of in-vehicle software and hardware for flexible interior concepts. An option to meet these requirements is the development of user-focused automation based on combined user and context monitoring in real time. The system behavior may be dynamically adapted by adjusting the driving style or the interior lighting. Here, we present a hierarchical approach on the basis of semantically motivated low-level features for activity and stress recognition based on OpenPose and electrocardiogram data. A driving simulator study with 29 participants was conducted to determine the potential of the approach. Participants had to accomplish different tasks: manual driving (MD); mobile office work with varying task load levels (high task load: MO-HT, low task load: MO-LT); and relaxing (REL) during automated driving. The validation revealed that our model is able to correctly distinguish between different activities using only a set of primitive features (average precision: driving: 76% and mobile office work: 93%, relaxing: 86%). Furthermore, we evaluated a person-independent and a person-specific approach for stress detection and found that both strategies show similar trends in accordance with our predictions (person-independent: stress detected in MO-HT: 22%, MO-LT: 18%, MD: 18%, REL: 15%; person-specific: stress detected in MO-HT: 79%, MO-LT: 72%, MD: 65%, and REL: 50%). These results demonstrate the efficacy of using a lightweight semantic approach for activity recognition and stress detection as basis for user-focused vehicle automation.

Item URL in elib:https://elib.dlr.de/186063/
Document Type:Article
Title:Activity and Stress Estimation Based on OpenPose and Electrocardiogram for User-Focused Level-4-Vehicles
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Walocha, FabianUNSPECIFIEDhttps://orcid.org/0000-0002-0251-0157UNSPECIFIED
Drewitz, UweUNSPECIFIEDhttps://orcid.org/0000-0002-6542-9698UNSPECIFIED
Ihme, KlasUNSPECIFIEDhttps://orcid.org/0000-0002-7911-3512UNSPECIFIED
Date:15 March 2022
Journal or Publication Title:IEEE Transactions on Human-Machine Systems
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In ISI Web of Science:Yes
Page Range:pp. 538-546
Publisher:IEEE - Institute of Electrical and Electronics Engineers
Keywords:Stress recognition; activity recognition; user-focused automation
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Transport
HGF - Program Themes:Road Transport
DLR - Research area:Transport
DLR - Program:V ST Straßenverkehr
DLR - Research theme (Project):V - NGC KoFiF (old)
Location: Braunschweig
Institutes and Institutions:Institute of Transportation Systems > Information Flow Modelling in Mobility Systems, BS
Deposited By: Ihme, Klas
Deposited On:27 Jul 2022 10:12
Last Modified:01 Mar 2024 12:05

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.