DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Classification with an edge: Improving semantic image segmentation with boundary detection

Marmanis, Dimitrios and Schindler, Konrad and Wegner, Jan D. and Galliani, Silvano and Datcu, Mihai and Stilla, Uwe (2018) Classification with an edge: Improving semantic image segmentation with boundary detection. ISPRS Journal of Photogrammetry and Remote Sensing, 135, pp. 158-172. Elsevier. DOI: doi.org/10.1016/j.isprsjprs.2017.11.009 ISSN 0924-2716

Full text not available from this repository.

Official URL: https://www.sciencedirect.com/science/article/pii/S092427161630572X


We present an end-to-end trainable deep convolutional neural network (DCNN) for semantic segmentation with built-in awareness of semantically meaningful boundaries. Semantic segmentation is a fundamental remote sensing task, and most state-of-the-art methods rely on DCNNs as their workhorse. A major reason for their success is that deep networks learn to accumulate contextual information over very large receptive fields. However, this success comes at a cost, since the associated loss of effective spatial resolution washes out high-frequency details and leads to blurry object boundaries. Here, we propose to counter this effect by combining semantic segmentation with semantically informed edge detection, thus making class boundaries explicit in the model. First, we construct a comparatively simple, memory-efficient model by adding boundary detection to the segnet encoder-decoder architecture. Second, we also include boundary detection in fcn-type models and set up a high-end classifier ensemble. We show that boundary detection significantly improves semantic segmentation with CNNs in an end-to-end training scheme. Our best model achieves >90% overall accuracy on the ISPRS Vaihingen benchmark.

Item URL in elib:https://elib.dlr.de/119393/
Document Type:Article
Title:Classification with an edge: Improving semantic image segmentation with boundary detection
AuthorsInstitution or Email of AuthorsAuthors ORCID iD
Marmanis, DimitriosDimitrios.Marmanis (at) dlr.deUNSPECIFIED
Schindler, Konradkonrad.schindler (at) geod.baug.ethz.chUNSPECIFIED
Wegner, Jan D.jan.wegner (at) geod.baug.ethz.chUNSPECIFIED
Galliani, Silvanosilvano.galliani (at) geod.baug.ethz.chUNSPECIFIED
Datcu, Mihaimihai.datcu (at) dlr.deUNSPECIFIED
Stilla, Uwestilla (at) tum.deUNSPECIFIED
Date:January 2018
Journal or Publication Title:ISPRS Journal of Photogrammetry and Remote Sensing
Refereed publication:Yes
Open Access:No
Gold Open Access:No
In ISI Web of Science:Yes
DOI :doi.org/10.1016/j.isprsjprs.2017.11.009
Page Range:pp. 158-172
Keywords:semantic image Segmentation, boundary detection
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Earth Observation
DLR - Research area:Raumfahrt
DLR - Program:R EO - Erdbeobachtung
DLR - Research theme (Project):R - Vorhaben hochauflösende Fernerkundungsverfahren
Location: Oberpfaffenhofen
Institutes and Institutions:Remote Sensing Technology Institute > Photogrammetry and Image Analysis
Deposited By: Zielske, Mandy
Deposited On:22 Mar 2018 20:20
Last Modified:06 Sep 2019 15:28

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.