Augmented Reality for Remote Collaboration in Aircraft Maintenance Tasks

Abstract

In this paper, we present a concept study to facilitate maintenance of an operating aircraft based on its lifelong collected data, called Digital Twin. It demonstrates a damage assessment scenario on a real aircraft component. We propose a graphical user interface that contains menu-guided instructions and inspection documentation to increase the efficiency of manual processes. Furthermore, experts located at different sites can join via a virtual session. By inspecting a 3D model of the aircraft component, they can see synchronized information from a Digital Twin database. With Augmented Reality glasses, the Microsoft HoloLens, a Digital Twin can be experienced personally. In the inspector's view, the 3D model of the Digital Twin is directly superimposed on the physical component. This Mixed Reality Vision can be used for inspection purposes. Any inspection related information can be directly attached to the component. For example, damage locations are marked by the inspector on the component's surface and are stored in the Digital Twin database. Our scenario demonstrates how new information can be derived from the combination of collected data and analyses from the Digital Twin database. This information is used to maintain the continued airworthiness of the aircraft. Feedback from domain related engineers confirm that our interface has an enormous potential for solving current maintenance problems in the aviation industry. Additionally, our study provides ideas for the integration of further analysis functions into the interface.