elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Numerical Analysis of Automated Anomaly Detection Algorithms for Satellite Telemetry

Schlag, Leonard and O'Meara, Corey and Wickler, Martin (2018) Numerical Analysis of Automated Anomaly Detection Algorithms for Satellite Telemetry. 15th Internationel Conference on Space Operations, 28. Mai - 01. Juni 2018, Marseille, Frankreich.

[img] PDF
5MB

Abstract

As technology evolves and the complexity of satellites and the amount of available telemetry increases, the manual inspection of thousands of parameters in detail per satellite becomes less and less manageable. While automated processes such as Out-Of-Limit (OOL) checks, which verify if a parameter exceeds an upper or lower threshold, exist, they come with the drawback of needing to be defined manually and often being very coarse to detect subtle changes in the telemetry. As this is a known problem, many space agencies are developing anomaly detection systems using machine learning methods. We found that the main difficulty in developing such an algorithm, as has been done for the Automated Telemetry Health Monitoring System (ATHMoS) at German Space Operations Center (GSOC), is minimizing the number of false positives while still detecting anomalies at a sufficiently high rate. Also, computational cost needs to be minimized since the detection algorithm needs to run at least once per day for all parameters. Considering these important constraints specific to automatic anomaly detection for satellite telemetry, we analyse several algorithms commonly used, namely the LOF and LoOP algorithms, as well as, in more detail, the novel algorithm developed at GSOC named Outlier Probability Via Intrinsic Dimension (OPVID) with regards to these constraints. To this extent, we will use both academic and custom benchmarks based on artificial data and historic satellite telemetry to highlight the difficulties as well as provide solutions for choosing the right algorithms and their parameters for the wanted results. In addition to the analysis of the different algorithms for these benchmarks with mostly predefined features used as the algorithm input, we also want to provide a compact analysis of different features unique to their use case for satellite telemetry as an input to the OPVID algorithm. The results can also be extrapolated for various other algorithms. In an operational use case, these features need to be generic enough to describe every available telemetry parameter and, at the same time, provide a context for the engineers as the automated system should complement the operations team. In the result, we will see that the selection of the features has a large effect on both the false positive and true positive rate and is one of the keys to designing an anomaly detection system for an operational use case.

Item URL in elib:https://elib.dlr.de/121269/
Document Type:Conference or Workshop Item (Speech)
Title:Numerical Analysis of Automated Anomaly Detection Algorithms for Satellite Telemetry
Authors:
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Schlag, LeonardLeonard.Schlag (at) dlr.deUNSPECIFIED
O'Meara, CoreyCorey.OMeara (at) dlr.deUNSPECIFIED
Wickler, MartinMartin.Wickler (at) dlr.deUNSPECIFIED
Date:May 2018
Refereed publication:No
Open Access:Yes
Gold Open Access:No
In SCOPUS:No
In ISI Web of Science:No
Status:Published
Keywords:Automated Telemetry Health Monitoring System (ATHMoS), anomaly detection System,
Event Title:15th Internationel Conference on Space Operations
Event Location:Marseille, Frankreich
Event Type:international Conference
Event Dates:28. Mai - 01. Juni 2018
Organizer:CNES
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Space Technology
DLR - Research area:Raumfahrt
DLR - Program:R SY - Technik für Raumfahrtsysteme
DLR - Research theme (Project):R - Raumflugbetrieb / Missionstechnologie
Location: Oberpfaffenhofen
Institutes and Institutions:Space Operations and Astronaut Training > Mission Operations
Deposited By: Schneider, Beatrice
Deposited On:07 Aug 2018 15:37
Last Modified:31 Jul 2019 20:19

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.