Haider, Arsalan and Haas, Lukas and Eryildirim, Abduelkadir and Zeh, Thomas and Thomas, Zeh and Shotaro, Koyama and Müllner, Nils Henning and Jakobi, Martin and Koch, Alexander W. (2024) A Methodology for Verifying and Validating the Functional Performance Evaluation of High-Fidelity RADAR Sensor Models at Raw Data and Detection Levels. In: 8th IEEE International Conference on Vision, Image and Signal Processing, ICVISP 2024. 2024 IEEE 8th International Conference on Vision, Image and Signal Processing (ICVISP), 2024-12-26 - 2024-12-28, Kunming, China. doi: 10.1109/ICVISP64524.2024.10959585. ISBN 979-833154146-0.
|
PDF
- Only accessible within DLR
5MB |
Abstract
This paper outlines a comprehensive methodology for verifying and validating the functional performance evaluation of high-fidelity radio detection and ranging (RADAR) sensor models at both the raw data level, specifically the range map (RM) and range-Doppler map (RDM), and the detection level. Three key performance parameters (KPPs) are defined at the raw data level: the target's received power, signal-to-noise ratio (SNR), and twoway beam pattern. Four KPPs are identified at the detection level: distance, relative radial velocity, azimuth angle, and elevation angle. This study also introduces three dynamic test scenarios directly applicable to the functional evaluation assessment of RADAR sensor models. Furthermore, a toolchain is presented to integrate real-world test scenarios into the virtual environment, allowing for frame-by-frame validation of the RADAR sensor models' functional evaluation. Quantitative analysis successfully assesses differences between simulations and real measurements, employing the mean absolute percentage error (MAPE) metric. This methodology has been successfully applied to a high-fidelity RADAR sensor model featuring a multiple input and multiple output (MIMO) 2D linear spacing virtual antenna and a complete signal processing toolchain that mimics real RADAR sensors. Results show a strong correlation between the simulation and real measurements, with MAPE values below 7 % for all defined KPPs at raw data and detection levels. Using this methodology, developers can assess whether virtual RADAR sensors are ready for environmental perception during scenario-based automated driving system (ADS) testing.
| Item URL in elib: | https://elib.dlr.de/213782/ | ||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Document Type: | Conference or Workshop Item (Speech) | ||||||||||||||||||||||||||||||||||||||||
| Title: | A Methodology for Verifying and Validating the Functional Performance Evaluation of High-Fidelity RADAR Sensor Models at Raw Data and Detection Levels | ||||||||||||||||||||||||||||||||||||||||
| Authors: |
| ||||||||||||||||||||||||||||||||||||||||
| Date: | 2024 | ||||||||||||||||||||||||||||||||||||||||
| Journal or Publication Title: | 8th IEEE International Conference on Vision, Image and Signal Processing, ICVISP 2024 | ||||||||||||||||||||||||||||||||||||||||
| Refereed publication: | Yes | ||||||||||||||||||||||||||||||||||||||||
| Open Access: | No | ||||||||||||||||||||||||||||||||||||||||
| Gold Open Access: | No | ||||||||||||||||||||||||||||||||||||||||
| In SCOPUS: | Yes | ||||||||||||||||||||||||||||||||||||||||
| In ISI Web of Science: | No | ||||||||||||||||||||||||||||||||||||||||
| DOI: | 10.1109/ICVISP64524.2024.10959585 | ||||||||||||||||||||||||||||||||||||||||
| ISBN: | 979-833154146-0 | ||||||||||||||||||||||||||||||||||||||||
| Status: | Published | ||||||||||||||||||||||||||||||||||||||||
| Keywords: | Performance evaluation;Correlation;Radar detection;Radar;Radar antennas;Data models;Radar signal processing;Distance measurement;Signal to noise ratio;Testing;automated driving systems;radio detection and ranging;verification;validation | ||||||||||||||||||||||||||||||||||||||||
| Event Title: | 2024 IEEE 8th International Conference on Vision, Image and Signal Processing (ICVISP) | ||||||||||||||||||||||||||||||||||||||||
| Event Location: | Kunming, China | ||||||||||||||||||||||||||||||||||||||||
| Event Type: | international Conference | ||||||||||||||||||||||||||||||||||||||||
| Event Start Date: | 26 December 2024 | ||||||||||||||||||||||||||||||||||||||||
| Event End Date: | 28 December 2024 | ||||||||||||||||||||||||||||||||||||||||
| HGF - Research field: | Aeronautics, Space and Transport | ||||||||||||||||||||||||||||||||||||||||
| HGF - Program: | Transport | ||||||||||||||||||||||||||||||||||||||||
| HGF - Program Themes: | Rail Transport | ||||||||||||||||||||||||||||||||||||||||
| DLR - Research area: | Transport | ||||||||||||||||||||||||||||||||||||||||
| DLR - Program: | V SC Schienenverkehr | ||||||||||||||||||||||||||||||||||||||||
| DLR - Research theme (Project): | V - INTRA - Infrastruktur und Transformation | ||||||||||||||||||||||||||||||||||||||||
| Location: | Braunschweig | ||||||||||||||||||||||||||||||||||||||||
| Institutes and Institutions: | Institute of Transportation Systems > Railway Technologies | ||||||||||||||||||||||||||||||||||||||||
| Deposited By: | Müllner, Nils Henning | ||||||||||||||||||||||||||||||||||||||||
| Deposited On: | 19 Dec 2025 07:49 | ||||||||||||||||||||||||||||||||||||||||
| Last Modified: | 08 Jan 2026 12:03 |
Repository Staff Only: item control page