Ernst, Johannes Maria and Laudien, Tim and Schmerwitz, Sven (2023) Implementation of a mixed-reality flight simulator: blending real and virtual with a video-see-through head-mounted display. In: Proceedings of SPIE - The International Society for Optical Engineering, 125380R. SPIE Press. SPIE Defense + Commercial Sensing 2023, 2023-05-01 - 2023-05-04, Orlando, FL, USA. doi: 10.1117/12.2664848. ISSN 0277-786X.
![]() |
PDF
109kB |
Abstract
Conventional flight simulators usually include a complex and expensive outside vision projection system. Especially scenarios where the helicopter pilots look far to the side or through the windows near the pedals require a large projection dome to provide an image of the outside world. Additionally, simulators used for research need to be highly customizable: For rapid prototyping of new flight deck designs, the cockpit mockup must be adaptable enough to change the appearance and arrangement of its elements. The recent technological advancements of head-mounted displays (HMDs) offer many new ways to create a simulator that fulfills the stated requirements at moderate cost. A non-see-through HMD can immerse the pilots into a computer-generated cockpit with "unrestricted" virtual out-the-window view. The downwards view is even better than with dome projections. Such a fully virtual approach, however, requires complex finger-tracking and haptic feedback solutions to enable the user to interact with the cockpit. By contrast, a video-see-through HMD allows us to selectively combine a highly customizable virtual world with a video-stream of the real surroundings. One can, for instance, show the pilot's hands and relevant parts of the physical flight deck mockup, enriched with virtual elements and virtual out-the-window view. In such a mixed setup, the pilots can naturally and directly interact with conventional input devices in an otherwise virtual environment. The paper presents our implementation of a mixed reality simulator with the Varjo XR-3 video-see-through HMD. We assess different variants, discuss implementation details like real-to-virtual-world-alignment, and explain the major challenges of such setups.
Item URL in elib: | https://elib.dlr.de/195622/ | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Document Type: | Conference or Workshop Item (Speech) | ||||||||||||||||
Title: | Implementation of a mixed-reality flight simulator: blending real and virtual with a video-see-through head-mounted display | ||||||||||||||||
Authors: |
| ||||||||||||||||
Date: | 2023 | ||||||||||||||||
Journal or Publication Title: | Proceedings of SPIE - The International Society for Optical Engineering | ||||||||||||||||
Refereed publication: | Yes | ||||||||||||||||
Open Access: | Yes | ||||||||||||||||
Gold Open Access: | No | ||||||||||||||||
In SCOPUS: | Yes | ||||||||||||||||
In ISI Web of Science: | Yes | ||||||||||||||||
DOI: | 10.1117/12.2664848 | ||||||||||||||||
Page Range: | 125380R | ||||||||||||||||
Editors: |
| ||||||||||||||||
Publisher: | SPIE Press | ||||||||||||||||
Series Name: | Proceedings of SPIE | ||||||||||||||||
ISSN: | 0277-786X | ||||||||||||||||
Status: | Published | ||||||||||||||||
Keywords: | head-mounted display, head-worn display, mixed reality, video-see-through HMD, flight simulator, augmented reality, virtual reality | ||||||||||||||||
Event Title: | SPIE Defense + Commercial Sensing 2023 | ||||||||||||||||
Event Location: | Orlando, FL, USA | ||||||||||||||||
Event Type: | international Conference | ||||||||||||||||
Event Start Date: | 1 May 2023 | ||||||||||||||||
Event End Date: | 4 May 2023 | ||||||||||||||||
Organizer: | SPIE | ||||||||||||||||
HGF - Research field: | Aeronautics, Space and Transport | ||||||||||||||||
HGF - Program: | Aeronautics | ||||||||||||||||
HGF - Program Themes: | Air Transportation and Impact | ||||||||||||||||
DLR - Research area: | Aeronautics | ||||||||||||||||
DLR - Program: | L AI - Air Transportation and Impact | ||||||||||||||||
DLR - Research theme (Project): | L - Integrated Flight Guidance | ||||||||||||||||
Location: | Braunschweig | ||||||||||||||||
Institutes and Institutions: | Institute of Flight Guidance > Pilot Assistance | ||||||||||||||||
Deposited By: | Ernst, Johannes Maria | ||||||||||||||||
Deposited On: | 17 Aug 2023 12:17 | ||||||||||||||||
Last Modified: | 24 Apr 2024 20:56 |
Repository Staff Only: item control page