Multi-modal supervision interface concept for marine systems

Dula Nad, Nikola Miskovic, Edin Omerdic

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

With increased orientation towards fleet operations, new technologies to improve autonomy and connectivity are needed. Most vehicles already come with mission planning and execution capabilities, and all state data is available remotely. With more autonomy, operators take on the supervision role for multiple vehicles. However, managing multiple vehicles in real-time requires supervisory interfaces that will reduce sensory overload. This presents a concept of an immersive user interface for supervision of marine systems. The augmented virtuality system provides a remote telepresence for operators with real-time interaction capabilities. The system focuses on providing situation awareness while maintaining operator capabilities. Data are streamed into the Unity3D interface through dedicated plugins, allowing two-way communication with LabView. Data is distilled into visual clues, while sound and speech recognition are employed to lessen the visual strain and improve interaction.

Original languageEnglish
Title of host publicationOCEANS 2019 - Marseille, OCEANS Marseille 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728114507
DOIs
Publication statusPublished - Jun 2019
Event2019 OCEANS - Marseille, OCEANS Marseille 2019 - Marseille, France
Duration: 17 Jun 201920 Jun 2019

Publication series

NameOCEANS 2019 - Marseille, OCEANS Marseille 2019
Volume2019-June

Conference

Conference2019 OCEANS - Marseille, OCEANS Marseille 2019
Country/TerritoryFrance
CityMarseille
Period17/06/1920/06/19

Keywords

  • Augmented reality
  • Marine systems
  • Underwater vehicles
  • Virtual reality

Fingerprint

Dive into the research topics of 'Multi-modal supervision interface concept for marine systems'. Together they form a unique fingerprint.

Cite this