Considering the intended behaviour in evaluating the rule compliance of MASS - Extended Abstract

Abstract

There is a rising interest in the development and use of Maritime Autonomous Surface Ships (MASS). To reduce risks in MASS operation and interaction amongst each other and with human operated vessels, safety needs to be evaluated before deployment. Vessels of all degrees of automation need to be able to comply with maritime traffic rules, such as COLREG rules, to avoid accidents and be predictable for the human operators of the vessels the MASS interacts with. A method to evaluate a MASS for rule compliance is the approach of scenario-based testing. Here, the MASS performs a set of scenarios, which are deemed relevant to demonstrate rule compliance, and each performance is then evaluated against the corresponding requirement derived from the rule. In this work we discuss means of interpretation for the evaluation of simulated MASS's behaviour in regard to MTSC (Maritime Traffic Sequence Charts) specifications. In particular we describe how to include knowledge about the MASS's intended behaviour (we here refer to it as the MASS's intention) and how to interpret the results of our monitoring tool in terms of the intention. We demonstrate how considering the MASS's intention is helpful for deriving a meaningful interpretation for the results of an evaluation of rule compliance. Including the knowledge about intention allows us to not only evaluate if any specification has been satisfied but to determine if the MASS's intended behaviour has been performed correctly. We show with a set of examples regarding COLREGs for TSS, how including intention enables our monitoring tool to provide an assessment about whether the rule concerning the intended behaviour was followed correctly by the MASS.