ROC & human factors

ROC & Human Factors

Work Package 3

ROC & Human Factors

Control Centre, Photo: Kystverket
Photo: Norwegian Coastal Administration

Our objective is to develop safe and efficient human-machine interfaces and interaction for remote operation centres (ROCs).

MASS will for the foreseeable future be dependent on a land-based remote operation - centre (ROC). The role of the ROC will be to monitor the status of the ship, and to intervene if the automation fails. The location, removed from the context of the vessel, will be a great challenge in order to give adequate situation awareness to the ROC operators. The interaction among MASS-ROC and conventional ships will depend heavily on sensor and AIS information, as well as cooperation with the vessel traffic service (VTS). 

The main research tasks are:

  • Task 3.1, which will research a reliable decision-support system for the ROC based on sensor fusion of available real-time environmental data and simulation models of the ship (“digital twin”)
  • Task 3.2, which will research a usable Human-centre designed based HMI for the ROC. With situation awareness and workload in mind, develop the interface humans and automation onboard and in the ROC, and means of communicate intentions to conventional ships. 
  • Task 3.3, which will focus on research, procedures, manning and competence needs for ROC Research the needed competence for the new “mariners” in the ROC and also work procedures and division of labour between operators and automation.
  • Task 3.4, which will focus on iteratively, to verify usability and validate performance in the ROC in simulators and at sea. The prototypes developed will be tested with end users at the NTNU simulator centre in Ålesund and on the research vessel Gunnerus.

Projects

Projects

PhD projects

PhD projects

  • Interaction Design, Felix-Marcel Peterman
  • AI decision transparency in autonomous maritime operations, Andreas Madsen (completed)
  • Explainable AI for Autonomous Ships, Eirik Fagerhaug
  • Decision Support Systems for Autonomous Vessels, Luka Grgicevic

 

Postdoc research

  • Remote control for crane, Taufik Akbar Sitompul (completed)

Recent publications

Recent publications

Journal articles:

Ole Andreas Alsos, Mina Saghafian, Erik Veitch, Felix-Marcel Petermann, Taufik Sitompul, Jooyoung Park, Eleftherios Papachristou, Egil Eide, Morten Breivik and Øyvind Smogeli (2024). "Lessons learned from the trial operation of an autonomous urban passenger ferry", Transportation Research Interdisciplinary Perspectives

Andreas Brandsæter and Andreas Nygård Madsen (2024). "A simulator-based approach for testing and assessing human supervised autonomous ship navigation", Journal of Marine Science and Technology

Luka Grgičević (2024). "Multi-Agent Maritime Traffic Simulator", MIC Journal: Modeling, Identification and Control

Philip Hodne, Oskar K. Skåden, Ole Andreas Alsos, Andreas Nygård Madsen and Thomas Porathe (2024). "Conversational user interfaces for maritime autonomous surface ships", Ocean Engineering

Andreas Nygård Madsen and Tae Eun Kim (2024). "A state-of-the-art review of AI decision transparency for autonomous shipping", Journal of International Maritime Safety, Environmental Affairs, and Shipping

Felix-Marcel Petermann, Ole Andreas Alsos, Egil Eide, Morten Breivik, and Erik Veitch (2024). "Touchpoints and systems for unmanned autonomous urban ferry operation", Journal of Physics: Conference Series

Mina Saghafian, Dorthea M.K. Vatn, Stine T. Moltubakk, Lene E. Bertheussen, Felix-Marcel Petermann, Stig O. Johnsen and Ole A. Alsos (2024). "Understanding automation transparency and uts adaptive design implications in safety-critical systems", Safety Science

Erik Veitch, Ole Andreas Alsos, Mina Saghafian, Felix-Marcel Petermann, Taufik Sitompul and Jooyoung Park (2024). "Dataset on passenger acceptance during autonomous ferry public trials: Questionnaires and interviews", Data in Brief

 

Conference papers/ seminars:

Luka Grgičević (2024). "Decision Support for Collision Avoidance in Maritime Multi-Vessel Encounter, MTEC/ICMASS

Luka Grgičević, Erlend M. Coates, Robin Bye, Thor I. Fossen and Ottar Osen (2024). "Towards Decision Support in Vessel Guidance Using Multi-Agent Modelling", European Control Conference (ECC)

Andreas Madsen (2024). "Human Centred Design in autonomous collision avoidance", SFI AutoShip Days 2024

Felix-Marcel Petermann (2024). "Collaborative Hazard Control: Designing a Digital Fire Control Center fo Enhanced Safety on Ships", GRAPHICS INTERFACE 2024. Association for Computer Machinery (ACM)

Felix-Marcel Petermann (2024). "Concept of a situation awareness enhancing tool for maritime environments", Hermann Hauser I.E.C.T. Summer School.

Felix-Marcel Petermann (2024). "Interaction Between Unmanned Systems and Humans: An Example of a Smart Passenger Access Gate for Autonomous Urban Passenger Ferries", 2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)

Felix-Marcel Petermann and Ole Andreas Alsos (2024). "Touchpoints and systems for unmanned autonomous urban ferry operation", MTEC/ICMASS

Taufik Akbar Sitompul (2024). "Evaluating Graphical user Interfaces for Improving Depth Perception with Remote Crane Operators", 48th IEEE International Conference on Computers, Software, and Applications (COMPSAC)

Taufik Akbar Sitompul (2024). "Handling Constant and Changing Latency with Graphical User Interfaces: A Study with Remote Crane Operators", The 2024 IEEE Conference on Telepresence

Taufik Akbar Sitompul (2024). "Using Graphical User Interfaces to Address Challenges in Remote Crane Operation", SFI AutoShip Days 2024

Taufik Akbar Sitompul, Jooyoung Park and Ole Andreas Alsos (2024). "Analyzing Online Videos to Create a List of User Interface Elements: A Case for OpenCrane Design System", Design for Equality and Justice. INTERACT 2023. Lecture Notes in Computer Science