elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Impressum | Datenschutz | Kontakt | English
Schriftgröße: [-] Text [+]

Laplace Approximation for Uncertainty Estimation of Deep Neural Networks

Humt, Matthias (2019) Laplace Approximation for Uncertainty Estimation of Deep Neural Networks. DLR-Interner Bericht. DLR-IB-RM-OP-2019-108. Masterarbeit. TUM.

[img] PDF
20MB

Kurzfassung

Deep learning is at the frontier of machine learning and automation, using deep neural networks as the main workhorse, which have revolutionized the way we extract information from large amounts of data in computer vision, natural language processing and other domains. Moving from purely academic to real world scenarios has renewed interest into the way those powerful algorithms draw their conclusions and how to quantify the quality of their predictions beyond mere accuracy. From a practitioner’s point of view, the most important information to obtain alongside the algorithm’s prediction is the uncertainty attached to it, which is the basis for an accurate assessment of confidence. Unfortunately, extracting this information from large models and datasets has proven to be difficult. A common approach so far has been to devise a method that makes as many approximations as necessary to render the problem tractable while still yielding at least somewhat useful uncertainty estimates. This work looks at the problem from a slightly different angle: By first choosing a tractable and comparatively simple method, the burden then lies on the model design to lend itself to the chosen approximation. To this end, the most popular deep neural network architectures are compared based on their compliance to uncertainty estimation by Laplace approximation, assessing empirically the methods potentials and deficiencies as well as its applicability to large models and datasets while working towards an understanding how architectural choices correlate with the quality of obtained uncertainty estimates

elib-URL des Eintrags:https://elib.dlr.de/131938/
Dokumentart:Berichtsreihe (DLR-Interner Bericht, Masterarbeit)
Titel:Laplace Approximation for Uncertainty Estimation of Deep Neural Networks
Autoren:
AutorenInstitution oder E-Mail-AdresseAutoren-ORCID-iDORCID Put Code
Humt, MatthiasDLRNICHT SPEZIFIZIERTNICHT SPEZIFIZIERT
Datum:15 Juli 2019
Referierte Publikation:Nein
Open Access:Ja
Status:veröffentlicht
Stichwörter:Neural Networks
Institution:TUM
Abteilung:Informatics
HGF - Forschungsbereich:Luftfahrt, Raumfahrt und Verkehr
HGF - Programm:Raumfahrt
HGF - Programmthema:Technik für Raumfahrtsysteme
DLR - Schwerpunkt:Raumfahrt
DLR - Forschungsgebiet:R SY - Technik für Raumfahrtsysteme
DLR - Teilgebiet (Projekt, Vorhaben):R - Vorhaben Intelligente Mobilität (alt)
Standort: Oberpfaffenhofen
Institute & Einrichtungen:Institut für Robotik und Mechatronik (ab 2013)
Hinterlegt von: Beinhofer, Gabriele
Hinterlegt am:13 Dez 2019 09:55
Letzte Änderung:22 Jun 2020 13:59

Nur für Mitarbeiter des Archivs: Kontrollseite des Eintrags

Blättern
Suchen
Hilfe & Kontakt
Informationen
electronic library verwendet EPrints 3.3.12
Gestaltung Webseite und Datenbank: Copyright © Deutsches Zentrum für Luft- und Raumfahrt (DLR). Alle Rechte vorbehalten.