军用车辆广域实时成像算法及系统研究

吴靖; 林建华; 黄炅; 杨铮; 黄峰

doi:10.12382/bgxb.2024.0903

您当前的位置：

首页 >

文章列表页 >

军用车辆广域实时成像算法及系统研究

更新时间：2025-10-21

- 军用车辆广域实时成像算法及系统研究
- Research on Wide-area Real-time Imaging Algorithm and System for Military Vehicles
- 兵工学报 2025年46卷第9期页码：240903
- 作者机构：
  
  福州大学机械工程及自动化学院, 福建福州 350108
- 作者简介：
  
  * huangf@fzu.edu.cn
- 基金信息：
  
  国家自然科学基金青年科学基金项目(62305062)
- DOI：10.12382/bgxb.2024.0903
  中图分类号：
- 收稿：2024-09-29，
  
  网络出版：2025-09-24，
  
  纸质出版：2025-09-30
- 稿件说明：
移动端阅览
吴靖, 林建华, 黄炅, 等. 军用车辆广域实时成像算法及系统研究[J]. 兵工学报, 2025,46(9):240903.

Jing WU, Jianhua LIN, Jiong HUANG, et al. Research on Wide-area Real-time Imaging Algorithm and System for Military Vehicles[J]. Acta Armamentarii, 2025, 46(9): 240903.
吴靖, 林建华, 黄炅, 等. 军用车辆广域实时成像算法及系统研究[J]. 兵工学报, 2025,46(9):240903. DOI： 10.12382/bgxb.2024.0903.

Jing WU, Jianhua LIN, Jiong HUANG, et al. Research on Wide-area Real-time Imaging Algorithm and System for Military Vehicles[J]. Acta Armamentarii, 2025, 46(9): 240903. DOI： 10.12382/bgxb.2024.0903.

摘要

为解决坦克、装甲车等军用车辆在使用多相机探测系统进行环境感知时

多相机图像重叠区域小、视差大及实际应用场景中特征信息复杂多变导致广域成像困难的问题

提出一种基于棋盘格科尔多瓦大学增强现实(Chessboard Augmented Reality University of Cordoba

ChArUco)平板标定的广域实时成像算法

并设计一款军用车辆广域视觉增强系统

用于驾驶员在视野受限的密闭车厢内对车外环境进行实时成像。该算法利用ChArUco平板在受遮挡情况下仍可准确标定的特点

实现对小重叠多相机系统的精确标定

通过标定参数进行投影变换

避免图像特征信息的干扰

有效应对复杂特征场景

同时通过光流关系融合消除重叠区域的视差

并利用投影查找表和并行加速优化方法

实现广域实时成像。该算法部署于移动计算平台

形成完整的广域视觉增强系统。实验结果显示

该系统及算法能够适应多种场景的广域实时成像需求

提升军用车辆在复杂环境中的视觉感知能力。

Abstract

The wide-area imaging becomes difficult due to the small overlapping area of multi-camera images

large parallax

and complex and changeable feature information in practical application scenarios when a multi-camera detection system is used to provide environmental perception for military vehicles such as tanks and armored vehicles.A wide-area real-time imaging algorithm based on ChArUco board calibration is proposed

and a wide-area visual enhancement system for military vehicles is designed for drivers to perform real-time imaging of the external environment in a closed compartment with limited vision.This algorithm takes advantage of the characteristic that the ChArUco board can still be accurately calibrated under occlusion conditions to achieve the accurate calibration of a small-overlapping multi-camera system.Projection transformation is carried out through calibration parameters to avoid the interference of image feature information and effectively deal with complex feature scenarios.At the same time

the parallax in the overlapping area is eliminated by the fusion of optical flow relationships

and a wide-area real-time imaging is achieved by using the projection look-up table and parallel acceleration optimization method.This algorithm is deployed on a mobile computing platform to form a complete wide-area visual enhancement system.The experimental results show that this system and algorithm can meet the wide-area real-time imaging requirements of various scenarios and improve the visual perception ability of military vehicles in complex environments.

关键词

Keywords

references

PEI Z H , ZHAO W Y , HU L , et al. Factors affecting the situational awareness of armored vehicle occupants [J ] . Sensors , 2024 , 24 ( 11 ): 3688 .

曹昭睿 , 郝永平 , 刘万成 , 等 . 紧凑折反式仿生复眼及图像快速拼接识别算法 [J ] . 兵工学报 , 2022 , 43 ( 8 ): 1845 - 1857 .

CAO Z R , HAO Y P , LIU W C , et al. Compact catadioptric bionic compound eye and fast image mosaic recognition algorithm [J ] . Acta Armamentarii , 2022 , 43 ( 8 ): 1845 - 1857 . (in Chinese) DOI: 10.12382/bgxb.2021.0393 http://doi.org/10.12382/bgxb.2021.0393 To resolve the problems of high mass and high volume of image data generated by the multi-channel camera array in a bionic compound eye, a large FOV bionic compound eye imaging system and an image fast mosaic recognition algorithm based on multi-channel single detector is proposed. By using optical path refraction and normalization, multi view sub eye image plane coplanar and single photodetector partition imaging are realized. Based on the imaging characteristics of catadioptric eyes, an image mosaic algorithm based on the structural similarity at the feature map level is proposed. Fast reconstruction and target recognition of global images with a large field of view (FOV) in a compact space are realized by using a convolution neural network for target recognition. The proposed compound eye system has an effective optical FOV of 138°×75°, an optical dimension is 29.78 mm×19.74 mm×6.86 mm, and a global image mosaic speed is 0.011 s. The compact catadioptric compound eye has the advantages of small volume, large FOV, and low computational cost. It can provide wide area vision and fast image mosaic recognition capabilities for small unmanned equipment and low speed projectiles with limited load and computational power.

CHEN J , YE X , GAO S L , et al. Planar wide-angle-imaging camera enabled by metalens array [J ] . Optica , 2022 , 9 ( 4 ): 431 - 437 .

PAN R F , ZHANG Y , XU L , et al. Stitching videos from unstructured camera arrays with rectangular boundaries [J ] . IEEE Access , 2024 , 12 : 21777 - 21786 .

QIAO K , WANG S K , JIAO G C , et al. Research on noise testing and reduction of low illumination imaging module [C ] //Proceedings of the Fifth Symposium on Novel Optoelectronic Detection Technology and Application.Xi’an, China:SPIE , 2019 , 11023 : 528 - 532 .

FU M Y , LIANG H , ZHU C H , et al. Image stitching techniques applied to plane or 3-D models:a review [J ] . IEEE Sensors Journal , 2023 , 23 ( 8 ): 8060 - 8079 .

裴红星 , 刘金达 , 葛佳隆 , 等 . 图像拼接技术综述 [J ] . 郑州大学学报(理学版) , 2019 , 51 ( 4 ): 1 - 10 ,29.

PEI H X , LIU J D , GE J L , et al. Review of image stitching techniques [J ] . Journal of Zhengzhou University(Natural Science Edition) , 2019 , 51 ( 4 ): 1 - 10 ,29. (in Chinese)

任海蕾 . 基于多相机标定的全景合成方法研究 [D ] . 西安 : 西安电子科技大学 , 2019 .

REN H L . Research on panorama synthesis method based on multi-camera calibration [D ] . Xi’an : Xidian University , 2019 . (in Chinese)

郑文玲 , 钱宏文 , 杨文豪 , 等 . 基于多相机标定的全景实时拼接算法研究 [J ] . 电子设计工程 , 2021 , 29 ( 17 ): 165 - 169 .

ZHENG W L , QIAN H W , YANG W H , et al. Research on real-time panoramic mosaic algorithm based on multi-camera calibration [J ] . Electronic Design Engineering , 2021 , 29 ( 17 ): 165 - 169 . (in Chinese)

CHEN H F , ZHUANG J L , LIU B Y , et al. Camera calibration method based on circular array calibration board [J ] . Systems Science & Control Engineering , 2023 , 11 ( 1 ): 2233562 .

黄文文 , 彭小红 , 李丽圆 , 等 . 相机标定方法及进展研究综述 [J ] . 激光与光电子学进展 , 2023 , 60 ( 16 ): 9 - 19 .

HUANG W W , PENG X H , LI L Y , et al. Review of camera calibration methods and their progress [J ] . Laser & Optoelectronics Progress , 2023 , 60 ( 16 ): 9 - 19 . (in Chinese)

段志瑜 , 罗哉 , 江文松 , 等 . 基于改进ArUco标签的位姿估计方法 [J ] . 计量学报 , 2024 , 45 ( 3 ): 364 - 371 .

DUAN Z Y , LUO Z , JANG W S , et al. Pose estimation method based on improved ArUco tags [J ] . Acta Metrologica Sinica , 2024 , 45 ( 3 ): 364 - 371 . (in Chinese)

LIN W W , LIANG P D , LUO G T , et al. Research of online hand-eye calibration method based on ChArUco board [J ] . Sensors , 2022 , 22 ( 10 ): 3805 .

ZHANG Z Y . Flexible camera calibration by viewing a plane from unknown orientations [C ] //Proceedings of the Seventh IEEE International Conference on Computer Vision.Kerkyra, Greece:IEEE , 1999 : 666 - 673 .

FISCHLER M A , BOLLES R C . Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography [J ] . Communications of the ACM , 1981 , 24 ( 6 ): 381 - 395 .

de JESUS RUBIO J . Stability analysis of the modified levenberg-marquardt algorithm for the artificial neural network training [J ] . IEEE Transactions on Neural Networks and Learning Systems , 2020 , 32 ( 8 ): 3510 - 3524 .

夏丹 , 周睿 . 视差图像配准技术研究综述 [J ] . 计算机工程与应用 , 2021 , 57 ( 2 ): 18 - 27 . DOI: 10.3778/j.issn.1002-8331.2007-0040 http://doi.org/10.3778/j.issn.1002-8331.2007-0040 传统图像配准技术受限于严苛的初始输入已难以满足人们的需求，近年来，视差图像的配准逐渐成为图像拼接技术中的研究热点。基于视差形成原理介绍了视差图像配准的难点与一般流程。主要研究了基于特征的视差图像配准技术，对近年来视差图像配准的研究成果进行了归纳梳理，并从基于多平面对齐的图像配准、基于网格变形的图像配准以及缝合线驱动的图像配准三个方面进行阐述。通过对各种典型的视差图像配准算法的算法思想、特点以及局限性进行描述和比较，提供该领域研究现状的系统综述，并对视差图像配准技术的研究趋势进行了展望。

XIA D , ZHOU R . Survey of parallax image registration technology [J ] . Computer Engineering and Applications , 2021 , 57 ( 2 ): 18 - 27 . (in Chinese) DOI: 10.3778/j.issn.1002-8331.2007-0040 http://doi.org/10.3778/j.issn.1002-8331.2007-0040 <p>Limited by the initial input images, traditional image registration technology cannot meet people’s needs. Nowadays parallax image registration has gradually become a research focus in image mosaic technology. The difficulty and general flow of parallax image registration are introduced based on the principle of parallax formation. And the feature-based parallax image registration technology is mainly introduced. The research results of parallax image registration in recent years are summarized and expanded from the image registration based on multi-plane alignment, the image registration based on mesh deformation and the seam-driven image registration. Through summarizing and comparing the algorithm ideas, characteristics and limitations of various typical parallax image registration algorithms, a systematic overview of the research status in this field is provided. Furthermore, the future research directions of parallax image registration are also prospected.</p>

FARNEBACK G . Two-frame motion estimation based on polynomial expansion [C ] //Proceedings of the Image Analysis:13th Scandinavian Conference.Berlin,Heidelberg, Germany:Springer , 2003 : 363 - 370 .

BROWN M , LOWE D G . Automatic panoramic image stitching using invariant features [J ] . International Journal of Computer Vision , 2007 , 74 ( 1 ): 59 - 73 .

ZARAGOZA J , CHIN T J , BROWN M S , et al. As-projective-as-possible image stitching with moving DLT [C ] //Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition.Portland,OR, US:IEEE , 2013 : 2339 - 2346 .

刘杰 , 游品鸿 , 田明 , 等 . 基于局部投影的视差图像拼接平滑优化 [J ] . 电子学报 , 2022 , 50 ( 6 ): 1451 - 1456 . DOI: 10.12263/DZXB.20200664 http://doi.org/10.12263/DZXB.20200664 针对视差图像拼接之后存在对齐不准和扭曲的问题，提出一种基于局部投影的视差图像拼接的平滑优化方法.将输入图像进行特征点检测，通过局部保留结构进行图像匹配并计算投影矩阵，利用重合边界投影模型与投影矩阵进行归一化距离判定，距离小于阈值则保留，大于阈值则舍弃并继续矩阵计算.在图像非重合部分，利用图像的变形函数得到最小弯曲能量函数，使非重合区域向全局变换上过渡.实验结果表明：所提算法提高了图像匹配精度，对图像的扭曲具有优化作用，增强了图像的整体性并获得了更好的视觉体验.

LIU J , YOU P H , TIAN M , et al. Smooth optimization of parallax images mosaic based on local projection [J ] . Acta Electronica Sinica , 2022 , 50 ( 6 ): 1451 - 1456 . (in Chinese) DOI: 10.12263/DZXB.20200664 http://doi.org/10.12263/DZXB.20200664 Aiming at the problems of misalignment and distortion after parallax image stitching, a smooth optimization method for parallax image stitching based on local projection is proposed. The input image is performed feature point detection, matched by locality preserving structure, and calculated the projection matrix. The normalized distance is determined by the projection model of the coincident area and the projection matrix. If it is less than the threshold, it will be retained, otherwise it will be discarded and continue matrix calculation. In the non-coincident part of the image, the minimum bending energy function is obtained by calculating the deformation function of the image, so that the non-coincident region transits to the global transformation. The experimental results show that the proposed algorithm can not only improve the matching accuracy of the image, but also optimize the distortion of the image, enhance the integrity of the image and obtain a better visual experience.

浏览量

下载量

CNKI被引量

文章被引用时，请邮件提醒。

提交

工具集

关联资源

新技术形势下四足、双足机器人技术的变革

军用车辆底部防护研究与发展综述

制导系统设计参数多准则优化决策方法研究

复杂产品内部结构装配正确性X射线自动检测系统的研究

Recent studies on potential accident-tolerant fuel-cladding systems in light water reactors