elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Attention-Driven Cross-Modal Remote Sensing Image Retrieval

Chaudhuri, Ushashi and Banerjee, Biplab and Bhattacharya, Avik and Datcu, Mihai (2021) Attention-Driven Cross-Modal Remote Sensing Image Retrieval. In: International Geoscience and Remote Sensing Symposium (IGARSS), pp. 4783-4786. Institute of Electrical and Electronics Engineers. 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, 11-16 July 2021, Brussels, Belgium. doi: 10.1109/IGARSS47720.2021.9554838. ISBN 978-1-6654-0369-6. ISSN 2153-7003.

[img] PDF
860kB

Official URL: https://ieeexplore.ieee.org/document/9554838

Abstract

In this work, we address a cross-modal retrieval problem in remote sensing (RS) data. A cross-modal retrieval problem is more challenging than the conventional uni-modal data retrieval frameworks as it requires learning of two completely different data representations to map onto a shared feature space. For this purpose, we chose a photo-sketch RS database. We exploit the data modality comprising more spatial information (sketch) to extract the other modality features (photo) with cross-attention networks. This sketch-attended photo features are more robust and yield better retrieval results. We validate our proposal by performing experiments on the benchmarked Earth on Canvas dataset. We show a boost in the overall performance in comparison to the existing literature. Besides, we also display the Grad-CAM visualizations of the trained model's weights to highlight the framework's efficacy.

Item URL in elib:https://elib.dlr.de/144964/
Document Type:Conference or Workshop Item (Speech)
Title:Attention-Driven Cross-Modal Remote Sensing Image Retrieval
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iD
Chaudhuri, UshashiIndian Institute of Technology BombayUNSPECIFIED
Banerjee, BiplabIndian Institute of Technology BombayUNSPECIFIED
Bhattacharya, AvikIndian Institute of Technology BombayUNSPECIFIED
Datcu, MihaiMihai.Datcu (at) dlr.deUNSPECIFIED
Date:July 2021
Journal or Publication Title:International Geoscience and Remote Sensing Symposium (IGARSS)
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In SCOPUS:Yes
In ISI Web of Science:No
DOI :10.1109/IGARSS47720.2021.9554838
Page Range:pp. 4783-4786
Publisher:Institute of Electrical and Electronics Engineers
ISSN:2153-7003
ISBN:978-1-6654-0369-6
Status:Published
Keywords:Cross-modal retrieval, Remote Sensing, Sketch-based image retrieval, Attention network, Deep learning
Event Title:2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS
Event Location:Brussels, Belgium
Event Type:international Conference
Event Dates:11-16 July 2021
Organizer:Institute of Electrical and Electronics Engineers
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Earth Observation
DLR - Research area:Raumfahrt
DLR - Program:R EO - Earth Observation
DLR - Research theme (Project):R - Artificial Intelligence
Location: Oberpfaffenhofen
Institutes and Institutions:Remote Sensing Technology Institute > EO Data Science
Deposited By: Otgonbaatar, Soronzonbold
Deposited On:18 Nov 2021 12:30
Last Modified:01 Jul 2022 03:00

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Copyright © 2008-2017 German Aerospace Center (DLR). All rights reserved.