The Problem of Virtual Reality in Microgravity Environments - Using the Oculus Quest on the ISS for Virtual Reality Training

Abstract

On-board training (OBT) is a valuable training tool for the crew members on-board the International Space Station (ISS). OBTs are designed to complement ground training and provide rapid assistance in unforeseen complex circumstances or refresh knowledge and skills before execution. Virtual reality (VR) lends itself to this as a suitable medium for training complex tasks effectively and enables delivery of so called ‘just-in-time’ training as it shortens training time on the ground, which is a decisive advantage in the field of space exploration. VR-OBT, a joint DLR ESA technology demonstrator, explores this potential of VR for on-board training, during ISS expedition 66 and 67. A standalone VR headset, such as the Oculus Quest used for this training application, relies on many sensors to accurately sense the environment and calculate the user’s position and orientation within it. Embedded sensors such as accelerometers and magnetometers in IMUs, which are needed for such tracking, do not work properly in microgravity because they are calibrated to 1 g and expect this value or do not have a stable magnetic field as a reference due to the speed of the ISS. This leads to problems and errors in displaying the intended training content, including unwanted drift, jitter, and flicker. This master’s thesis explains why some sensors in MEMS IMUs do not function properly in microgravity. It also examines the current use of VR training, particularly in spaceflight. The main focus of this thesis is the development and subsequent evaluation of an anti-drift solution and a VR training application for use on the ISS. It could be demonstrated that the developed anti-drift solution works in principle on parabolic flights and on the ISS, but that the training application as such cannot be used properly due to other unexpected problems, such as strong jitter. Further research is needed to determine the exact causes of this jitter.