Tocaro Blue has launched ApolloCore™, a machine learning-based software solution designed to transform standard marine Point-Tilt-Zoom (PTZ) cameras into perception systems for autonomous and defense vessels.
The software addresses the inherent challenges of using commercial-off-the-shelf PTZ cameras, which were originally designed for direct human operation rather than unmanned applications. By integrating with a vessel’s Inertial Measurement Unit (IMU), ApolloCore leverages attitude data to actively stabilize camera systems, maintaining precise pointing and consistent visual tracking even in rough sea states. This stabilization is critical for long-range observation and tracking on maritime platforms, particularly on medium and small Unmanned Surface Vessels (USVs).
Beyond stabilization, the system applies a native marine object detection model that benefits from over 3.5 million images. This enables the software to detect and classify multiple objects simultaneously, including over a dozen COLREGS-compliant object classes, comprising eight vessel classes, two navigation marker classes, and additional classes such as persons and debris, while also maintaining persistent tracks and estimating target range in real time. The software also supports the use of third-party detection models trained on customer-specific datasets.
A key feature of the platform is its native compatibility with ProteusCore™ Radar Processing Software. When deployed in tandem, the two systems provide measurement-level radar–camera sensor fusion. This approach combines the wide-area detection and motion tracking of radar with the visual identification and classification capabilities of cameras, creating a complementary perception stack that improves situational awareness and object detection and classification.
John Minor, CEO of Tocaro Blue, commented, “Autonomous vessels don’t just need sensors. They need perception. With ApolloCore and ProteusCore, we’re building the software layer that enables vessels to interpret the world around them with the clarity and context of a human operator—and ultimately exceed it.”
The software is deployed as an executable application that runs directly on a vessel’s existing GPU-enabled hardware. It integrates through developer APIs designed for autonomy stacks, navigation systems, and Intelligence, Surveillance, and Reconnaissance (ISR) applications. This flexibility allows defense integrators and USV builders to utilize ApolloCore as a standalone camera perception system or as part of a sensor fusion deployment depending on specific mission requirements.
By providing the software intelligence required for vessels to understand, interpret, and act on their environment, Tocaro Blue aims to establish itself as a leading provider of maritime perception solutions. This latest release expands the company’s portfolio of AI-powered software intended to support the next generation of autonomous and crewed maritime platforms.
