elib
DLR-Header
DLR-Logo -> http://www.dlr.de
DLR Portal Home | Imprint | Privacy Policy | Contact | Deutsch
Fontsize: [-] Text [+]

Declarative Reasoning about Space and Motion in Visual Imagery - Theoretical Foundations and Applications

Suchan, Jakob (2022) Declarative Reasoning about Space and Motion in Visual Imagery - Theoretical Foundations and Applications. Dissertation, Universität Bremen. doi: 10.26092/elib/1652.

[img] PDF - Only accessible within DLR
37MB

Official URL: https://media.suub.uni-bremen.de/handle/elib/6047

Abstract

Perceptual sensemaking of dynamic visual imagery, e.g., involving semantic grounding, explanation, and learning, is central to a range of tasks where artificial intelligent systems have to make decisions and interact with humans. Towards this, commonsense characterisations of space and motion encompassing spatio-temporal relations, motion patterns, and events provide an abstraction layer to perform semantic reasoning about (embodied) spatio-temporal interactions observed from visuospatial imagery. This thesis develops: (1). a general theory about space and motion for representing and reasoning about interactions founded in declaratively grounded models pertaining to space, time, space-time, motion, and events, and (2). a computational cognitive vision framework for perceptual sensemaking with visuospatial imagery, systematically developed to be compliant with declarative programming methods such as Constraint Logic Programming (CLP), Answer-Set Programming (ASP), and Inductive Logic Programming (ILP). The thesis provides general tools and methods for declarative reasoning with visuospatial imagery, encompassing question-answering, abduction, and integration of reasoning and learning; contributed publications in this thesis focus on: 1. Grounded Semantic Interpretation and Question-Answering rooted to expressive declarative models of (embodied) visuospatial semantics to characterise (human) interactions with respect to their relational spatio-temporal structure; 2. Visuospatial Abduction, for hypothesising object interactions explaining perceived visuospatial dynamics, tightly integrating low-level (neural) visual processing and high-level (relational) abductive reasoning; and 3. Declarative Explainability and Inductive Generalisation based on declarative formalisations of visuospatial image characteristics grounded in (symbolic and subsymbolic) image elements and (neural) image features thereby providing a relational abstraction layer suitable for relational (inductive) learning. These developed representation and reasoning capabilities are demonstrated and evaluated in the context of real-world applications (with requirements such as real-time processing, robustness against noise, etc.), where the processing and semantic interpretation of (potentially large volumes of) highly dynamic visuospatial imagery is central. Example applications included in this thesis encompass cognitive robotics, autonomous vehicles, and assistive technologies for human behaviour research.

Item URL in elib:https://elib.dlr.de/188919/
Document Type:Thesis (Dissertation)
Title:Declarative Reasoning about Space and Motion in Visual Imagery - Theoretical Foundations and Applications
Authors:
AuthorsInstitution or Email of AuthorsAuthor's ORCID iDORCID Put Code
Suchan, JakobUNSPECIFIEDhttps://orcid.org/0000-0002-1356-3297UNSPECIFIED
Date:22 June 2022
Refereed publication:No
Open Access:No
DOI:10.26092/elib/1652
Status:Published
Keywords:Declarative space and motion; Cognitive vision; Visuospatial sensemaking; Vision and semantics; Commonsense reasoning; Knowledge representation and reasoning; Human-centred AI;
Institution:Universität Bremen
Department:FB3 - Mathematik/Informatik
HGF - Research field:Aeronautics, Space and Transport
HGF - Program:Transport
HGF - Program Themes:other
DLR - Research area:Transport
DLR - Program:V - no assignment
DLR - Research theme (Project):V - no assignment
Location: Oldenburg
Institutes and Institutions:Institute of Systems Engineering for Future Mobility > Systems Theory and Design
Deposited By: Suchan, Jakob
Deposited On:09 Jan 2023 09:10
Last Modified:09 Jan 2023 09:10

Repository Staff Only: item control page

Browse
Search
Help & Contact
Information
electronic library is running on EPrints 3.3.12
Website and database design: Copyright © German Aerospace Center (DLR). All rights reserved.