Real-time sea-surface maps and maritime object detection

Real-time sea-surface maps and maritime object detection

Real-Time Ortho-Mosaicking for Awareness and Navigation (ROMAN)

ROMAN is a set of software components for creating real-time sea surface maps and detecting maritime objects.

Images of the ocean can be captured by sensors on uncrewed aircraft systems (UASs), which also record data about position, orientation, and field of view. But it is not easy to match the images and data to exact locations and create accurate maps. Unlike ground terrain, the ocean surface lacks reliable landmarks. GPS data is not always available.

An uncrewed aircraft system captures data about the ocean surface and transmits it to a nearby ship
ROMAN applies the latest advances in computer vision and autonomy to detect objects and create real-time sea surface maps.

“The open ocean makes up seventy percent of the planet. Keeping up-to-date maps over the open ocean and for aircraft to navigate without the aid of vulnerable external guidance information like GPS presents unique challenges. ROMAN provides up-to-the-minute maps and navigational information in contested environments.”

Dr. Todd Jennings,
Scientist and Principal Investigator of the ROMAN effort

ROMAN ingests video from the electro-optical and infrared sensors onboard a UAS. Then, video frames are stitched together to create and continuously update an ortho-mosaic. An ortho-mosaic is a detailed, accurate, photorealistic map, formed by combining multiple images and geometrically correcting them. Even when GPS data is unavailable, ROMAN’s algorithms will match the UAS sensor data to a base map and provide accurate positioning information. ROMAN will also detect, identify, and track relevant maritime objects, such as submarines and floating mines. A full-featured user interface, integrated with existing Navy communications infrastructure, will support route planning and execution. A particularly innovative aspect of ROMAN is the ability to produce the ortho-mosaic without lengthy post-processing of images or access to cloud computing.

ROMAN will improve situational awareness for maritime operations, including threat detection, anti-submarine warfare, counter-surveillance, and search-and-rescue in GPS-denied areas. Other potential applications include marine life surveys, environmental monitoring, and disaster management. ROMAN technologies will also be incorporated into VisionKit®, Charles River’s library of computer vision components.

During a naval operation, an Explanation Interface displays an AI’s reasoning to a human teammate.
The ocean surface is constantly changing and nearly featureless.

Contact us to learn more about ROMAN and our other robotics and autonomy capabilities.

This material is based upon work supported by the Naval Air Warfare Center under Contract No. N68335-21-C-0390. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of NAVAIR. Distribution Statement A – Approved for public release; distribution is unlimited.

Our passion for science and engineering drives us to find impactful, actionable solutions.