Exploratory Visual Analysis of Multispectral EO Images Based on DNN

Abstract

Exploratory visual analysis is often required to assist human operator to understand and interpret Earth Observation (EO) images. Optimal image representation offers cognitive support in discovering relevant facts about the scene with respect to a particular application. This is of crucial importance for training data sets selection in all Machine Learning tasks, particularly in the design of active learning tools for multispectral (MS) EO data. This paper proposes a deep neural network (DNN) based method to compress, learn and reveal the most significant information included in the spectral bands of EO data in support of relevant visualization for image content analysis. The advanced method uses a DNN to discover the most suggestive pseudo-color representation able to highlight the entire MS image content better than the particular 3 bands selection (R, G, B). We propose the use of information theory and the concept of mutual information to rank the spectral bands based on the amount of information contained, by applying the minimum-redundancy-maximum-relevance (mRMR) criterion on a the image so that we obtain the ranked bands. A DNN stacked autoencoder based paradigm is developed in order to extract and compress in three bands the overall information from the MS EO data. The developed method is demonstrated and validated for Sentinel 2 dataset.