A PointPillars-based 3D point cloud object detector of USVs for small target detection in dynamic aquatic environments
Volume
77
Issue number
2
Article number
77202
Received
26 February 2025
Received in revised form
19 July 2025
Accepted
10 August 2025
Available online
14 October 2026
Authors
Xue Fan1, Shaolong Yang1,2,3*, Xianbo Xiang1,2,3, Shuo Sun1, Shimhanda Daniel Hashali1,2,3
1 School of Naval Architecture and Ocean Engineering, Huazhong University of Science and Technology, 430074, Wuhan, China
2 International Science and Technology Cooperation Offshore Center for Ship and Marine Intelligent Equipment and Technology, Hubei, Wuhan 430074, China
3 Wuhan Belt & Road Joint Lab of Ship and Marine Intelligent Equipment and Technology, Wuhan 430074, China
Corresponding author email
Abstract
LiDAR, a crucial sensor for Unmanned Surface Vehicles (USVs), allows for precise 3D modelling but encounters challenges in real-time target detection due to sparse point clouds. Current 3D point cloud detectors struggle to effectively capture fine-grained details and dynamic water surface features, while high-performance models often rely on custom operators, making deployment more complicated. Additionally, current water surface datasets lack the resolution necessary for small target detection. To tackle these issues, this study enhances the PointPillars model with the Voxel-Guided Label Assignment (VGLA) strategy, improving feature extraction through adaptive label assignment. A high-resolution point cloud dataset focused on small aquatic objects has also been developed based on 128-beam LiDAR. The proposed PointPillars-VGLA achieves 3D AP scores of 89.50%, 83.70%, and 75.20%, as well as BEV AP scores of 95.20%, 91.00%, and 86.70% across three target categories. Ablation experiments confirm the effectiveness of the VGLA module, with accuracy gains of up to 2.27% over CenterPoint. Deployed on the Jetson AGX Orin with TensorRT, the model achieves real-time inference at 30 FPS, enabling efficient detection and tracking in dynamic aquatic environments.
Keywords
Unmanned Surface Vehicles, LiDAR, 3D Point Cloud detector, PointPillars