Knowledge-driven image mining system for Big Earth Observation data fusion: GIS maps inclusion in active learning stage

Abstract

In this paper, we present an accelerated knowledge-driven content-based information mining system for Big Earth Observation data fusion. The tool combines, at pixel level, the unsupervised clustering results of different number of features. The features, extracted from different EO raster image types and from existing GIS vector maps, are combined, in form of a BoW, with a user given semantic concepts in order to calculate the posterior probability that allows the final search. The inclusion of GIS data during the active learning, based on Bayesian networks, accelerate the definition processes of semantic labels and retrieve the related images with only a few user interactions. The inclusion of GIS data in conjunction with the recently introduced search algorithm have as a result a system which greatly optimizes the computational costs and over performs existing similar systems in various orders of magnitude.