elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data

Hong, Danfeng and Chanussot, Jocelyn and Yokoya, Naoto and Kang, Jian and Zhu, Xiao Xiang (2020) Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data. IEEE Geoscience and Remote Sensing Letters, 17 (8), pp. 1470-1474. IEEE - Institute of Electrical and Electronics Engineers. doi: 10.1109/LGRS.2019.2944599. ISSN 1545-598X.

[img] PDF - Postprint version (accepted manuscript)
2MB

Official URL: https://ieeexplore.ieee.org/document/8976086

Abstract

Due to the ever-growing diversity of the data source, multi-modality feature learning has attracted more and more attention. However, most of these methods are designed by jointly learning feature representation from multi-modalities that exist in both training and test sets, yet they are less investigated in absence of certain modality in the test phase. To this end, in this letter, we propose to learn a shared feature space across multi-modalities in the training process. By this way, the out-of-sample from any of multi-modalities can be directly projected onto the learned space for a more effective cross-modality representation. More significantly, the shared space is regarded as a latent subspace in our proposed method, which connects the original multi-modal samples with label information to further improve the feature discrimination. Experiments are conducted on the multispectral-Lidar and hyperspectral dataset provided by the 2018 IEEE GRSS Data Fusion Contest to demonstrate the effectiveness and superiority of the proposed method in comparison with several popular baselines.

Item URL in elib:https://elib.dlr.de/129266/
Document Type:Article
Title:Learning Shared Cross-modality Representation Using Multispectral-LiDAR and Hyperspectral Data
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Hong, DanfengUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Chanussot, JocelynUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Yokoya, NaotoRIKENUNSPECIFIEDUNSPECIFIED
Kang, JiantumUNSPECIFIEDUNSPECIFIED
Zhu, Xiao XiangUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Date:2020
Journal or Publication Title:IEEE Geoscience and Remote Sensing Letters
Refereed publication:Yes
Open Access:Yes
Gold Open Access:No
In SCOPUS:Yes
In ISI Web of Science:Yes
Volume:17
DOI:10.1109/LGRS.2019.2944599
Page Range:pp. 1470-1474
Publisher:IEEE - Institute of Electrical and Electronics Engineers
ISSN:1545-598X
Status:Published
Keywords:Cross-modality, feature learning, hyperspectral, multi-modality, multispectral-Lidar, shared subspace learning.
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Space
HGF - Program Themes:Earth Observation
DLR - Research area:Raumfahrt
DLR - Program:R EO - Earth Observation
DLR - Research theme (Project):R - Vorhaben hochauflösende Fernerkundungsverfahren (old)
Location: Oberpfaffenhofen
Institutes and Institutions:Remote Sensing Technology Institute > EO Data Science
Deposited By: Hong, Danfeng
Deposited On:27 Sep 2019 11:27
Last Modified:24 Oct 2023 12:44

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.