Intelligent Localization of Targets in Confined Space via Camera-LiDAR Fusion

Ruina DANG; Zhengquan PIAO; Fuyong FENG; Qingjie LIU; Zhenhao WANG; Jianfang YIN

doi:10.12382/bgxb.2025.0299

您当前的位置：

首页 >

文章列表页 >

Intelligent Localization of Targets in Confined Space via Camera-LiDAR Fusion

更新时间：2026-02-10

- Intelligent Localization of Targets in Confined Space via Camera-LiDAR Fusion
- Acta Armamentarii Vol. 46, Issue S2, Pages: 250299(2025)
- 作者机构：
  
  1. 中兵智能创新研究院有限公司, 北京 100072
  2. 群体协同与自主国家级重点实验室, 北京 100072
  3. 中国电子科技南湖研究院, 浙江嘉兴 314000
- 作者简介：
- 基金信息：
- DOI：10.12382/bgxb.2025.0299
  CLC：
- Received：21 April 2025，
  
  Online First：03 February 2026，
  
  Published：2025
- 稿件说明：
移动端阅览
Ruina DANG, Zhengquan PIAO, Fuyong FENG, et al. Intelligent Localization of Targets in Confined Space via Camera-LiDAR Fusion[J]. Acta Armamentarii, 2025, 46(S2): 250299.
DOI：

Ruina DANG, Zhengquan PIAO, Fuyong FENG, et al. Intelligent Localization of Targets in Confined Space via Camera-LiDAR Fusion[J]. Acta Armamentarii, 2025, 46(S2): 250299. DOI： 10.12382/bgxb.2025.0299.

摘要

提出一种基于相机与激光雷达融合的密闭空间目标智能定位方法。通过相机对地下目标进行实时检测。结合LiDAR三维点云地图

在生成的点云地图坐标系内计算当前图像中检测到的每个目标的位置。采用目标融合和重复去除等方法抑制由于被多次检测等因素产生的重复目标

并将目标检测与识别结果标注在三维点云地图中

进而获得能够直观、高效地呈现密闭空间目标的探测与定位结果。真实密闭空间下的试验结果表明

所提方法能够实时精准地检测场景中的关键目标

并通过融合激光雷达点云数据

分别在三维地图和二维投影图上直观显示目标识别和定位信息。

Abstract

This paper proposes an intelligent localization method for targets in confined spaces based on camera and LiDAR fusion. The underground targets are detected in real time using a camera

and then the detected targets in each image are localized within the coordinate system of the generated point cloud map based on LiDAR’s 3D point cloud map. Finally

the techniques such as target fusion and redundancy removal are used to suppress the duplicate targets that arise due to repeated detections and other factors. The target detection and recognition results are annotated onto the point cloud map

yielding a search and localization output that provides an intuitive and efficient representation of the targets in confined space. Experimental results in real confined space show that the proposed method can accurately detect the key targets in the scene in real time

and visually display the target recognition and location information on 3D map and 2D projection map by fusing LiDAR point cloud data.

关键词

Keywords

references

侯斐斐 , 彭应昊 , 董健 , 等 . 基于双重YOLOv8-pose模型的探地雷达双曲线关键点检测与目标定位 [J ] . 电子与信息学报 , 2024 , 46 ( 11 ): 4305 - 4316 .

HOU F F , PENG Y H , DONG J , et al. Ground penetrating radar hyperbolic keypoint detection and object localization based on dual YOLOv8-pose model [J ] . Journal of Electronics & Information Technology , 2024 , 46 ( 11 ): 4305 - 4316 . (in Chinese)

SCHROTH C A , ECKRICH C , KAKOUCHE I , et al. Emergency response person localization and vital sign estimation using a semi-autonomous robot mounted SFCW radar [J ] . IEEE Transactions on Biomedical Engineering , 2024 , 71 ( 6 ): 1756 - 1769 .

赵亮 , 李论 . 基于毫米波雷达点云数据的室内人员信息检测 [J ] . 大连理工大学学报 , 2024 , 64 ( 4 ): 418 - 425 .

ZHAO L , LI L . Indooro ccupancy information detection based on millimeter wave radar point cloud data [J ] . Journal of Dalian University of Technology , 2024 , 64 ( 4 ): 418 - 425 . (in Chinese)

何陆灏 , 周永章 , 张灿 . 基于深度学习的目标分割在岩石智能识别上的应用 [J ] . 矿物岩石地球化学通报 , 2025 , 44 ( 3 ): 525 - 542 .

HE L H , ZHOU Y Z , ZHANG C . Application of deep learning-based object segmentation in intelligent rock recognition [J ] . Bulletin of Mineralogy,Petrology and Geochemistry , 2025 , 44 ( 3 ): 525 - 542 . (in Chinese)

ALOTAIBI E , NASSIF N . Artificial intelligence in environmental monitoring:in-depth analysis [J ] . Discover Artificial Intelligence , 2024 , 4 ( 1 ): 84 .

PANKRATOVA N , PANKRATOV V , MUSIIENKO D . Analysis and modelling of the underground tunnel planning in uncertainty conditions [M ] // ZGUROVSKY M , PANKRATOVA N . System Analysis and Artificial Intelligence.Cham, Switzerland:Springer , 2023 : 63 - 81 .

DANG T , MASCARICH F , KHATTAK S , et al. Autonomous search for underground mine rescue using aerial robots [C ] //Proceedings of the 2020 IEEE Aerospace Conference.Big Sky,MT, US:IEEE , 2020 : 1 - 8 .

KAZEROUNI IA , FITZGERALD L , DOOLY G , et al. A survey of state-of-the-art on visual SLAM [J ] . Expert Systems with Applications , 2022 , 205 : 117734 .

HOU H N , ZHANG X T , WANG X F , et al. Location of underground multi-layer media based on BP neural network and near-field electromagnetic signal [J ] . IEEE Sensors Journal , 2024 , 25 ( 1 ): 725 - 736 .

HU H B , FANG H Y , WANG N N , et al. Defects identification and location of underground space for ground penetrating radar based on deep learning [J ] Tunnelling and Underground Space Technology , 2023 , 140 : 105278 .

金浙 , 蒋朝阳 . 无人车蛙跳协同的激光SLAM退化校正 [J ] . 兵工学报 , 2025 , 46 ( 3 ): 240161 .

JIN Z , JIANG C Y . Degeneration correction of LiDAR SLAM for unmanned vehicle leap-frog cooperation [J ] . Acta Armamentarii , 2025 , 46 ( 3 ): 240161 . (in Chinese)

ALHMIEDAT T MAREI A M , ALBELWI S , et al. A systematic approach for exploring underground environment using LiDAR-based system [J ] . CMES-Computer Modeling in Engineering & Sciences , 2023 , 136 ( 3 ): 2321 - 2344 .

ZHANG R , HAO G B , ZHANG K , et al. Unmanned aerial vehicle navigation in underground structure inspection:a review [J ] . Geological Journal , 2023 , 58 ( 6 ): 2454 - 2472 .

FARAI O , METJE N , ANTHONY C , et al. Analysis of acoustic signal propagation for reliable digital communication along exposed and buried water pipes [J ] . Applied Sciences , 2023 , 13 ( 7 ): 4611 .

张红伟 , 王海燕 , 闫永胜 , 等 . 加权有向关联网络构建与表征的水中目标远距离检测 [J ] . 兵工学报 , 2024 , 45 ( 8 ): 2584 - 2593 .

ZHANG H W , WANG H Y , YAN Y S , et al. Construction and characterization of weighted directed association network for remote detection of underwater targets [J ] . Acta Armamentarii , 2024 , 45 ( 8 ): 2584 - 2593 . (in Chinese)

WANG J , YANG P , LIU Y S , et al. Research on improved yolov5 for low-light environment object detection [J ] . Electronics , 2023 , 12 ( 14 ): 3089 .

WANG M J , HU D , CHEN J J , et al. Underground infrastructure detection and localization using deep learning enabled radargram inversion and vision based mapping [J ] . Automation in Construction , 2023 , 154 : 105004 .

HE B , JI X X , LI G , et al. Key technologies and applications of uavs in underground space:a review [J ] . IEEE Transactions on Cognitive Communications and Networking , 2024 , 10 ( 3 ): 1026 - 1049 .

JOCHER G , NISHIMURA K , MINEEVA T , et al. Yolov5,Code repository https:/lgithub.com/ultralytics/yolov5.2024 https:/lgithub.com/ultralytics/yolov5.2024 https:/lgithub.com/ultralytics/yolov5.2024.

SMITH G L , SCHMIDT S F , MCGEE L A . Application of statistical filter theory to the optimal estimation of position and velocity on board a circumlunar vehicle [M ] . Washington,DC. , US:NASA ,1962.

REDMOND S J , HENEGHAN C . A method for initialising the K-means clustering algorithm using kd-trees [J ] . Pattern Recognition Letters , 2007 , 28 ( 8 ): 965 - 973 .

Views

下载量

CNKI被引量

Alert me when the article has been cited

提交

Tools

Publicity Resources

Lightweight Transmedia High-speed Small Target Detection Method Based on Coordinate Attention Mechanism

Detection and Tracking of Water Columns at Marine Impact Points Based on Dynamic Features

Real-time Detection and Localization Algorithm for Military Vehicles in Drone Aerial Photography

Research on Armored Vehicle Detection Algorithm Based on Visible and Infrared Image Fusion

Degrad Target Detection Algorithm

Related Author

Xiaofang KONG

Yi DONG

Minjie WAN

Yan XIA

Gang WAN

Hong’e LUO

Huihui XU

Fan GUI

Related Institution

Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing University of Science and Technology

School of Electronic and Optical Engineering, Nanjing University of Science and Technology

National Key Laboratory of Transient Physics, Nanjing University of Science and Technology

Naval University of Engineering

Hangzhou Zhiyuan Research Institute Co., Ltd.

Postal code：100089
Tel：010-68963060/68962718 Fax：010-68963025 Email：bgxb@cos.org.cn
Technical support is provided by Beijing Founder electronics co., LTD 京ICP备05059581号-4 京公网安备11010802024360号
It is recommended to read the content of this site in Chrome&IE9+. Please switch to extreme mode in browser 360.
Cookies We use cookies to help provide and enhance our service and tailor content. By continuing, you agree to the use of cookies.
Total Visits：49245 Visits Today：42

⁰