欢迎访问《兵工学报》官方网站,今天是

兵工学报

• •    下一篇

军用车辆广域实时成像算法及系统研究

吴靖,林建华,黄炅,杨铮,黄峰*   

  1. 福州大学 机械工程及自动化学院
  • 收稿日期:2024-09-29 修回日期:2025-07-17
  • 基金资助:
    国家自然科学基金青年项目(62305062)

Research on Wide-area Real-time Imaging Algorithms and Systems for Military Vehicles

WU Jing, LIN Jianhua, HUANG Jiong, YANG Zheng, HUANG Feng*   

  1. School of Mechanical Engineering and Automation, Fuzhou University
  • Received:2024-09-29 Revised:2025-07-17

摘要: 为解决坦克、装甲车等军用车辆在使用多相机探测系统进行环境感知时,多相机图像重叠区域小、视差大及实际应用场景中特征信息复杂多变导致广域成像困难的问题,提出一种基于ChArUco平板标定的广域实时成像方法,并设计一款军用车辆广域视觉增强系统,用于驾驶员在视野受限的密闭车厢内对车外环境进行实时成像。该算法利用ChArUco平板在受遮挡情况下仍可准确标定的特点,实现对小重叠多相机系统的精确标定,通过标定参数进行投影变换,避免图像特征信息的干扰,有效应对复杂特征场景,同时通过光流关系融合消除重叠区域的视差,并利用投影查找表和并行加速优化方法,实现广域实时成像。该算法部署于移动计算平台,形成完整的广域视觉增强系统。实验结果显示,该系统及算法能够适应多种场景的广域实时成像需求,提升军用车辆在复杂环境中的视觉感知能力。

关键词: 军用车辆, 图像拼接, 多相机标定, ChArUco, 优化加速, 系统设计

Abstract: To solve the problem that military vehicles such as tanks and armored vehicles have difficulties in wide - area imaging when using a multi - camera detection system for environmental perception due to the small overlapping area of multi - camera images, large parallax, and complex and changeable feature information in practical application scenarios, a wide - area real - time imaging method based on ChArUco board calibration is proposed, and a wide - area visual enhancement system for military vehicles is designed for drivers to perform real - time imaging of the external environment in a closed compartment with limited vision. This algorithm utilizes the characteristic that the ChArUco board can still be accurately calibrated under occlusion conditions to achieve accurate calibration of a small - overlapping multi - camera system. Projection transformation is carried out through calibration parameters to avoid the interference of image feature information and effectively deal with complex feature scenarios. At the same time, the parallax in the overlapping area is eliminated by optical flow relationship fusion, and a wide - area real - time imaging is achieved by using the projection look - up table and parallel acceleration optimization methods. This algorithm is deployed on a mobile computing platform to form a complete wide - area visual enhancement system. The experimental results show that this system and algorithm can meet the wide - area real - time imaging requirements of various scenarios and improve the visual perception ability of military vehicles in complex environments.

Key words: military vehicles, image stitching, multi-camera calibration, ChArUco, optimization acceleration, system design

中图分类号: