1. 中兵智能创新研究院有限公司, 北京 100072
2. 群体协同与自主国家级重点实验室, 北京 100072
3. 中国电子科技南湖研究院, 浙江 嘉兴 314000
* 邮箱: bitinfor@126.com
收稿:2025-04-21,
网络首发:2026-02-03,
纸质出版:2025
移动端阅览
党睿娜, 瓢正泉, 冯付勇, 等. 相机与激光雷达融合的密闭空间目标智能定位[J]. 兵工学报, 2025,46(S2):250299.
Ruina DANG, Zhengquan PIAO, Fuyong FENG, et al. Intelligent Localization of Targets in Confined Space via Camera-LiDAR Fusion[J]. Acta Armamentarii, 2025, 46(S2): 250299.
党睿娜, 瓢正泉, 冯付勇, 等. 相机与激光雷达融合的密闭空间目标智能定位[J]. 兵工学报, 2025,46(S2):250299. DOI: 10.12382/bgxb.2025.0299.
Ruina DANG, Zhengquan PIAO, Fuyong FENG, et al. Intelligent Localization of Targets in Confined Space via Camera-LiDAR Fusion[J]. Acta Armamentarii, 2025, 46(S2): 250299. DOI: 10.12382/bgxb.2025.0299.
提出一种基于相机与激光雷达融合的密闭空间目标智能定位方法。通过相机对地下目标进行实时检测。结合LiDAR三维点云地图
在生成的点云地图坐标系内计算当前图像中检测到的每个目标的位置。采用目标融合和重复去除等方法抑制由于被多次检测等因素产生的重复目标
并将目标检测与识别结果标注在三维点云地图中
进而获得能够直观、高效地呈现密闭空间目标的探测与定位结果。真实密闭空间下的试验结果表明
所提方法能够实时精准地检测场景中的关键目标
并通过融合激光雷达点云数据
分别在三维地图和二维投影图上直观显示目标识别和定位信息。
This paper proposes an intelligent localization method for targets in confined spaces based on camera and LiDAR fusion. The underground targets are detected in real time using a camera
and then the detected targets in each image are localized within the coordinate system of the generated point cloud map based on LiDAR’s 3D point cloud map. Finally
the techniques such as target fusion and redundancy removal are used to suppress the duplicate targets that arise due to repeated detections and other factors. The target detection and recognition results are annotated onto the point cloud map
yielding a search and localization output that provides an intuitive and efficient representation of the targets in confined space. Experimental results in real confined space show that the proposed method can accurately detect the key targets in the scene in real time
and visually display the target recognition and location information on 3D map and 2D projection map by fusing LiDAR point cloud data.
侯斐斐 , 彭应昊 , 董健 , 等 . 基于双重YOLOv8-pose模型的探地雷达双曲线关键点检测与目标定位 [J ] . 电子与信息学报 , 2024 , 46 ( 11 ): 4305 - 4316 .
HOU F F , PENG Y H , DONG J , et al. Ground penetrating radar hyperbolic keypoint detection and object localization based on dual YOLOv8-pose model [J ] . Journal of Electronics & Information Technology , 2024 , 46 ( 11 ): 4305 - 4316 . (in Chinese)
SCHROTH C A , ECKRICH C , KAKOUCHE I , et al. Emergency response person localization and vital sign estimation using a semi-autonomous robot mounted SFCW radar [J ] . IEEE Transactions on Biomedical Engineering , 2024 , 71 ( 6 ): 1756 - 1769 .
赵亮 , 李论 . 基于毫米波雷达点云数据的室内人员信息检测 [J ] . 大连理工大学学报 , 2024 , 64 ( 4 ): 418 - 425 .
ZHAO L , LI L . Indooro ccupancy information detection based on millimeter wave radar point cloud data [J ] . Journal of Dalian University of Technology , 2024 , 64 ( 4 ): 418 - 425 . (in Chinese)
何陆灏 , 周永章 , 张灿 . 基于深度学习的目标分割在岩石智能识别上的应用 [J ] . 矿物岩石地球化学通报 , 2025 , 44 ( 3 ): 525 - 542 .
HE L H , ZHOU Y Z , ZHANG C . Application of deep learning-based object segmentation in intelligent rock recognition [J ] . Bulletin of Mineralogy,Petrology and Geochemistry , 2025 , 44 ( 3 ): 525 - 542 . (in Chinese)
ALOTAIBI E , NASSIF N . Artificial intelligence in environmental monitoring:in-depth analysis [J ] . Discover Artificial Intelligence , 2024 , 4 ( 1 ): 84 .
PANKRATOVA N , PANKRATOV V , MUSIIENKO D . Analysis and modelling of the underground tunnel planning in uncertainty conditions [M ] // ZGUROVSKY M , PANKRATOVA N . System Analysis and Artificial Intelligence.Cham, Switzerland:Springer , 2023 : 63 - 81 .
DANG T , MASCARICH F , KHATTAK S , et al. Autonomous search for underground mine rescue using aerial robots [C ] //Proceedings of the 2020 IEEE Aerospace Conference.Big Sky,MT, US:IEEE , 2020 : 1 - 8 .
KAZEROUNI IA , FITZGERALD L , DOOLY G , et al. A survey of state-of-the-art on visual SLAM [J ] . Expert Systems with Applications , 2022 , 205 : 117734 .
HOU H N , ZHANG X T , WANG X F , et al. Location of underground multi-layer media based on BP neural network and near-field electromagnetic signal [J ] . IEEE Sensors Journal , 2024 , 25 ( 1 ): 725 - 736 .
HU H B , FANG H Y , WANG N N , et al. Defects identification and location of underground space for ground penetrating radar based on deep learning [J ] Tunnelling and Underground Space Technology , 2023 , 140 : 105278 .
金浙 , 蒋朝阳 . 无人车蛙跳协同的激光SLAM退化校正 [J ] . 兵工学报 , 2025 , 46 ( 3 ): 240161 .
JIN Z , JIANG C Y . Degeneration correction of LiDAR SLAM for unmanned vehicle leap-frog cooperation [J ] . Acta Armamentarii , 2025 , 46 ( 3 ): 240161 . (in Chinese)
ALHMIEDAT T MAREI A M , ALBELWI S , et al. A systematic approach for exploring underground environment using LiDAR-based system [J ] . CMES-Computer Modeling in Engineering & Sciences , 2023 , 136 ( 3 ): 2321 - 2344 .
ZHANG R , HAO G B , ZHANG K , et al. Unmanned aerial vehicle navigation in underground structure inspection:a review [J ] . Geological Journal , 2023 , 58 ( 6 ): 2454 - 2472 .
FARAI O , METJE N , ANTHONY C , et al. Analysis of acoustic signal propagation for reliable digital communication along exposed and buried water pipes [J ] . Applied Sciences , 2023 , 13 ( 7 ): 4611 .
张红伟 , 王海燕 , 闫永胜 , 等 . 加权有向关联网络构建与表征的水中目标远距离检测 [J ] . 兵工学报 , 2024 , 45 ( 8 ): 2584 - 2593 .
ZHANG H W , WANG H Y , YAN Y S , et al. Construction and characterization of weighted directed association network for remote detection of underwater targets [J ] . Acta Armamentarii , 2024 , 45 ( 8 ): 2584 - 2593 . (in Chinese)
WANG J , YANG P , LIU Y S , et al. Research on improved yolov5 for low-light environment object detection [J ] . Electronics , 2023 , 12 ( 14 ): 3089 .
WANG M J , HU D , CHEN J J , et al. Underground infrastructure detection and localization using deep learning enabled radargram inversion and vision based mapping [J ] . Automation in Construction , 2023 , 154 : 105004 .
HE B , JI X X , LI G , et al. Key technologies and applications of uavs in underground space:a review [J ] . IEEE Transactions on Cognitive Communications and Networking , 2024 , 10 ( 3 ): 1026 - 1049 .
JOCHER G , NISHIMURA K , MINEEVA T , et al. Yolov5,Code repository https:/lgithub.com/ultralytics/yolov5.2024 https:/lgithub.com/ultralytics/yolov5.2024 https:/lgithub.com/ultralytics/yolov5.2024.
SMITH G L , SCHMIDT S F , MCGEE L A . Application of statistical filter theory to the optimal estimation of position and velocity on board a circumlunar vehicle [M ] . Washington,DC. , US:NASA ,1962.
REDMOND S J , HENEGHAN C . A method for initialising the K-means clustering algorithm using kd-trees [J ] . Pattern Recognition Letters , 2007 , 28 ( 8 ): 965 - 973 .
0
浏览量
0
下载量
0
CNKI被引量
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024360号