← Back to all participants
RideScan Integration Hackathon

Builder Case Study

Detecting Localization Drift with a Neuro-Symbolic Safety Controller

Background: I am a postgraduate student just graduated with Distinction in MSc in Robotics with Artificial Intelligence, with an undergraduate background in Electrical Engineering.

Platform: I utilized a wheeled_mobile robot type. I focused on building advanced safety AI capabilities on top of this existing platform, rather than building it from scratch.

The problem you set out to solve

The primary objective was to address localization drift in autonomous warehouse robots, a critical safety issue caused by factors like wheel slip, encoder errors, or flawed SLAM corrections. If a robot incorrectly calculates its position, it risks colliding with racks, striking personnel, or dropping payloads. I sought to implement a system capable of detecting these drifts in real-time to trigger safety stops and prevent accidents before they happen.

Your integration with RideScan

To integrate my platform with RideScan, I performed the following steps:

  • Calibration: I uploaded 15 calibration files over the raw API to ensure the system was accurately configured for the environment.
  • Telemetry Pipeline: I fed live robot pose telemetry directly into the RideScan process endpoint.
  • Technical Implementation (NeSy-IV): I developed the NeSy-IV controller, which monitors the incoming risk scores from the API.
  • Safety Logic: Upon detecting an anomaly in the pose telemetry, the system automatically pauses the robot arm, performs a re-localization process, and resumes the task only once the robot is safely oriented.

What the RideScan data showed

The RideScan API provided clear, actionable insights into robot performance through real-time risk scores:

  • Normal Operation: During standard runs, the model returned a low risk score of 0.01, confirming stable localization.
  • Anomaly Detection: When a pose-jump or drift occurred, the score spiked to 94.83, clearly signaling an anomaly.
  • Outcome: This demonstrated that RideScan can reliably distinguish between healthy operations and potential failure points, effectively transforming post-crash analysis into a pre-crash prevention system.

Limitations and honest findings

My primary challenge was an initial mismatch between my local data and the required RideScan calibration file formats. Resolving this data structure conflict required significant effort to map my existing datasets into the standard RideScan format, which initially consumed several hours of development time. However, this was an isolated integration hurdle; once the data formatting was aligned, the remainder of the implementation process was straightforward and highly efficient.

Results and what is next

  • Proof of Concept: Phase 3 successfully demonstrated that combining neuro-symbolic controllers with RideScan's telemetry creates a robust, autonomous safety shield that converts reactive monitoring into pre-crash prevention.
  • Scalability: This architecture is designed for the high-stakes warehouse environment, where the ability to pause and re-localize during a drift event prevents costly downtime, damaged hardware, and physical hazards.
  • Professional Vision: My goal is to extend this neuro-symbolic framework to support more complex, multi-robot coordination scenarios, further reducing the reliance on manual oversight in autonomous fleets.
  • Future Collaboration: I am actively seeking to bring my expertise in AI-driven robotic control and simulation-based testing to long-term industrial projects, and I am particularly interested in how we can further integrate high-level symbolic logic with the RideScan API to drive the next generation of safe, reliable autonomous warehouse operations.