What are the differences between your image understanding and that of a computer's?

Abstract

High resolution Earth Observation images contain detailed information, making it possible to recognize objects within them. However, issues such as the sensory gap and the semantic gap cause difficulties for object recognition and labelling. The sensory gap has been defined as the difference between a real life scene and its sensory interpretation; while the semantic gap is considered as the difference between the user’s and the computer’s semantic understanding of objects in an image. This interactive tutorial will begin by introducing image mining systems, their goals, and the problems they suffer from. The focus will be on the sensory and semantic gaps and their causes, which will be highlighted with a visual demonstration. This will be followed by a quick experiment involving the audience. The results will be processed in real time, and analyzed jointly with the audience. Concluding this interactive tutorial will be a section concentrating on why these gaps are important to consider for practical applications, such as annotation tools, and image learning and mining systems.