Carrillo Perez, Borja Jesus und Bueno Rodriguez, Angel und Barnes, Sarah und Stephan, Maurice (2023) Improving YOLOv8 with Scattering Transform and Attention for Maritime Awareness. In: Proceedings of 13th International Symposium on Image and Signal Processing and Analysis (ISPA 2023). IEEEXplore. IEEE 2023 International Symposium on Image and Signal Processing and Analysis (ISPA), 2023-09-17 - 2023-09-18, Rome, Italy. doi: 10.1109/ISPA58351.2023.10279352.
Dies ist die aktuellste Version dieses Eintrags.
PDF
5MB |
Offizielle URL: https://ieeexplore.ieee.org/document/10279352
Kurzfassung
Ship recognition and georeferencing using monitoring cameras are crucial to many applications in maritime situational awareness. Although deep learning algorithms are available for ship recognition tasks, there is a need for innovative approaches that attain higher precision rates irrespective of ship sizes, types, or physical hardware limitations. Furthermore, their deployment in maritime environments requires embedded systems capable of image processing, with balanced accuracy, reduced latency and low energy consumption. To achieve that, we build upon the foundations of the standard YOLOv8 and present a novel architecture that improves the segmentation and georeferencing of ships in the context of maritime awareness using a real-world dataset (ShipSG). Our architecture synergizes global and local features in the image for improved ship segmentation and georeferencing. The 2D scattering-transform enhances the YOLOv8 backbone by extracting global structural features from the image. The addition of convolutional block attention module (CBAM) in the head allows focusing on relevant spatial and channel-wise regions. We achieve mAP of 75.46%, comparable to larger YOLOv8 models at a much faster inference speed, 59.3 milliseconds per image, when deployed on the NVIDIA Jetson Xavier AGX as target embedded system. We applied the modified network to georeference the segmented ship masks, with a georeferencing distance error of 18 meters, which implies comparable georeferencing performance to non-embedded approaches.
elib-URL des Eintrags: | https://elib.dlr.de/198489/ | ||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Dokumentart: | Konferenzbeitrag (Vortrag) | ||||||||||||||||||||
Titel: | Improving YOLOv8 with Scattering Transform and Attention for Maritime Awareness | ||||||||||||||||||||
Autoren: |
| ||||||||||||||||||||
Datum: | September 2023 | ||||||||||||||||||||
Erschienen in: | Proceedings of 13th International Symposium on Image and Signal Processing and Analysis (ISPA 2023) | ||||||||||||||||||||
Referierte Publikation: | Ja | ||||||||||||||||||||
Open Access: | Ja | ||||||||||||||||||||
Gold Open Access: | Nein | ||||||||||||||||||||
In SCOPUS: | Nein | ||||||||||||||||||||
In ISI Web of Science: | Nein | ||||||||||||||||||||
DOI: | 10.1109/ISPA58351.2023.10279352 | ||||||||||||||||||||
Verlag: | IEEEXplore | ||||||||||||||||||||
Status: | veröffentlicht | ||||||||||||||||||||
Stichwörter: | Real-time instance segmentation, YOLOv8, scattering transform, attention, georeferencing, maritime awareness | ||||||||||||||||||||
Veranstaltungstitel: | IEEE 2023 International Symposium on Image and Signal Processing and Analysis (ISPA) | ||||||||||||||||||||
Veranstaltungsort: | Rome, Italy | ||||||||||||||||||||
Veranstaltungsart: | internationale Konferenz | ||||||||||||||||||||
Veranstaltungsbeginn: | 17 September 2023 | ||||||||||||||||||||
Veranstaltungsende: | 18 September 2023 | ||||||||||||||||||||
HGF - Forschungsbereich: | keine Zuordnung | ||||||||||||||||||||
HGF - Programm: | keine Zuordnung | ||||||||||||||||||||
HGF - Programmthema: | keine Zuordnung | ||||||||||||||||||||
DLR - Schwerpunkt: | keine Zuordnung | ||||||||||||||||||||
DLR - Forschungsgebiet: | keine Zuordnung | ||||||||||||||||||||
DLR - Teilgebiet (Projekt, Vorhaben): | keine Zuordnung | ||||||||||||||||||||
Standort: | Bremerhaven | ||||||||||||||||||||
Institute & Einrichtungen: | Institut für den Schutz maritimer Infrastrukturen | ||||||||||||||||||||
Hinterlegt von: | Carrillo Perez, Borja Jesus | ||||||||||||||||||||
Hinterlegt am: | 10 Nov 2023 13:58 | ||||||||||||||||||||
Letzte Änderung: | 24 Apr 2024 20:58 |
Verfügbare Versionen dieses Eintrags
- Improving YOLOv8 with Scattering Transform and Attention for Maritime Awareness. (deposited 10 Nov 2023 13:58) [Gegenwärtig angezeigt]
Nur für Mitarbeiter des Archivs: Kontrollseite des Eintrags