DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Self-Supervised Multisensor Change Detection

Saha, Sudipan and Ebel, Patrick and Zhu, Xiao Xiang (2022) Self-Supervised Multisensor Change Detection. IEEE Transactions on Geoscience and Remote Sensing, 60, p. 4405710. IEEE - Institute of Electrical and Electronics Engineers. doi: 10.1109/TGRS.2021.3109957. ISSN 0196-2892.

[img] PDF - Published version

Official URL: https://ieeexplore.ieee.org/document/9538396


Most change detection (CD) methods assume that prechange and postchange images are acquired by the same sensor. However, in many real-life scenarios, e.g., natural disasters, it is more practical to use the latest available images before and after the occurrence of incidence, which may be acquired using different sensors. In particular, we are interested in the combination of the images acquired by optical and synthetic aperture radar (SAR) sensors. SAR images appear vastly different from the optical images even when capturing the same scene. Adding to this, CD methods are often constrained to use only target image-pair, no labeled data, and no additional unlabeled data. Such constraints limit the scope of traditional supervised machine learning and unsupervised generative approaches for multisensor CD. The recent rapid development of self-supervised learning methods has shown that some of them can even work with only few images. Motivated by this, in this work, we propose a method for multisensor CD using only the unlabeled target bitemporal images that are used for training a network in a self-supervised fashion by using deep clustering and contrastive learning. The proposed method is evaluated on four multimodal bitemporal scenes showing change, and the benefits of our self-supervised approach are demonstrated. Code is available at https://gitlab.lrz.de/ai4eo/cd/-/tree/main/sarOpticalMultisensorTgrs2021.

Item URL in elib:https://elib.dlr.de/145752/
Document Type:Article
Title:Self-Supervised Multisensor Change Detection
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Zhu, Xiao XiangUNSPECIFIEDhttps://orcid.org/0000-0001-5530-3613
Journal or Publication Title:IEEE Transactions on Geoscience and Remote Sensing
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In ISI Web of Science:Yes
Page Range:p. 4405710
Publisher:IEEE - Institute of Electrical and Electronics Engineers
Keywords:Optical sensors, Optical imaging, Training, Earth, Synthetic aperture radar, Deep learning, Spatial resolution
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Earth Observation
DLR - Research area:Raumfahrt
DLR - Program:R EO - Earth Observation
DLR - Research theme (Project):R - Artificial Intelligence
Location: Oberpfaffenhofen
Institutes and Institutions:Remote Sensing Technology Institute > EO Data Science
Deposited By: Rösel, Anja
Deposited On:18 Nov 2021 13:15
Last Modified:13 Jan 2023 11:03

Repository Staff Only: item control page

Help & Contact
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.