Accurate three-dimensional target localization remains a critical challenge in underwater robotics, especially when relying on Forward-Looking Sonar (FLS) for sensing. While FLS provides reliable range and azimuth information, its inherent ambiguity in elevation angle often hampers precise localization. In this initial study, we explore the use of a Particle Filter-based tracking framework coupled with a Deep Reinforcement Learning (DRL) agent that actively guides an Autonomous Underwater Vehicle (AUV) to informative vantage points. Our Particle Filter approach represents targets via probabilistic anchors, sampling from sonar bounding box data to handle the elevation uncertainty. Instead of passively accepting observations, the DRL agent generates control commands that strategically reposition the AUV to reduce sensor ambiguity. We validate our method in a custom simulation environment implementing kinematics and sensor field-of-view and a realistic noise model for bounding box detections. The preliminary results indicate that a DRL-based approach represents a feasible solution for real-time 3D target localization in underwater environments.

Active 3D Object Localization of FLS-Detected Targets via Deep Reinforcement Learning / Cecchi, Lorenzo; Topini, Alberto; Bucci, Alessandro; Ridolfi, Alessandro. - ELETTRONICO. - (2025), pp. 1-10. ( OCEANS 2025 Brest, OCEANS 2025 Brest, France 2025) [10.1109/oceans58557.2025.11104638].

Active 3D Object Localization of FLS-Detected Targets via Deep Reinforcement Learning

Cecchi, Lorenzo
;
Topini, Alberto;Bucci, Alessandro;Ridolfi, Alessandro
2025

Abstract

Accurate three-dimensional target localization remains a critical challenge in underwater robotics, especially when relying on Forward-Looking Sonar (FLS) for sensing. While FLS provides reliable range and azimuth information, its inherent ambiguity in elevation angle often hampers precise localization. In this initial study, we explore the use of a Particle Filter-based tracking framework coupled with a Deep Reinforcement Learning (DRL) agent that actively guides an Autonomous Underwater Vehicle (AUV) to informative vantage points. Our Particle Filter approach represents targets via probabilistic anchors, sampling from sonar bounding box data to handle the elevation uncertainty. Instead of passively accepting observations, the DRL agent generates control commands that strategically reposition the AUV to reduce sensor ambiguity. We validate our method in a custom simulation environment implementing kinematics and sensor field-of-view and a realistic noise model for bounding box detections. The preliminary results indicate that a DRL-based approach represents a feasible solution for real-time 3D target localization in underwater environments.
2025
Oceans Conference Record (IEEE)
OCEANS 2025 Brest, OCEANS 2025
Brest, France
2025
Goal 9: Industry, Innovation, and Infrastructure
Cecchi, Lorenzo; Topini, Alberto; Bucci, Alessandro; Ridolfi, Alessandro
File in questo prodotto:
File Dimensione Formato  
Active_3D_Object_Localization_of_FLS-Detected_Targets_via_Deep_Reinforcement_Learning.pdf

Accesso chiuso

Descrizione: Articolo principale
Tipologia: Pdf editoriale (Version of record)
Licenza: Tutti i diritti riservati
Dimensione 8.28 MB
Formato Adobe PDF
8.28 MB Adobe PDF   Richiedi una copia

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1439422
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
social impact