PEI Z H , ZHAO W Y , HU L , et al. Factors affecting the situational awareness of armored vehicle occupants [J ] . Sensors , 2024 , 24 ( 11 ): 3688 .

曹昭睿 , 郝永平 , 刘万成 , 等 . 紧凑折反式仿生复眼及图像快速拼接识别算法 [J ] . 兵工学报 , 2022 , 43 ( 8 ): 1845 - 1857 .

CAO Z R , HAO Y P , LIU W C , et al. Compact catadioptric bionic compound eye and fast image mosaic recognition algorithm [J ] . Acta Armamentarii , 2022 , 43 ( 8 ): 1845 - 1857 . (in Chinese) DOI: 10.12382/bgxb.2021.0393 http://doi.org/10.12382/bgxb.2021.0393 To resolve the problems of high mass and high volume of image data generated by the multi-channel camera array in a bionic compound eye, a large FOV bionic compound eye imaging system and an image fast mosaic recognition algorithm based on multi-channel single detector is proposed. By using optical path refraction and normalization, multi view sub eye image plane coplanar and single photodetector partition imaging are realized. Based on the imaging characteristics of catadioptric eyes, an image mosaic algorithm based on the structural similarity at the feature map level is proposed. Fast reconstruction and target recognition of global images with a large field of view (FOV) in a compact space are realized by using a convolution neural network for target recognition. The proposed compound eye system has an effective optical FOV of 138°×75°, an optical dimension is 29.78 mm×19.74 mm×6.86 mm, and a global image mosaic speed is 0.011 s. The compact catadioptric compound eye has the advantages of small volume, large FOV, and low computational cost. It can provide wide area vision and fast image mosaic recognition capabilities for small unmanned equipment and low speed projectiles with limited load and computational power.

CHEN J , YE X , GAO S L , et al. Planar wide-angle-imaging camera enabled by metalens array [J ] . Optica , 2022 , 9 ( 4 ): 431 - 437 .

PAN R F , ZHANG Y , XU L , et al. Stitching videos from unstructured camera arrays with rectangular boundaries [J ] . IEEE Access , 2024 , 12 : 21777 - 21786 .

QIAO K , WANG S K , JIAO G C , et al. Research on noise testing and reduction of low illumination imaging module [C ] //Proceedings of the Fifth Symposium on Novel Optoelectronic Detection Technology and Application.Xi’an, China:SPIE , 2019 , 11023 : 528 - 532 .

FU M Y , LIANG H , ZHU C H , et al. Image stitching techniques applied to plane or 3-D models:a review [J ] . IEEE Sensors Journal , 2023 , 23 ( 8 ): 8060 - 8079 .

裴红星 , 刘金达 , 葛佳隆 , 等 . 图像拼接技术综述 [J ] . 郑州大学学报(理学版) , 2019 , 51 ( 4 ): 1 - 10 ,29.

PEI H X , LIU J D , GE J L , et al. Review of image stitching techniques [J ] . Journal of Zhengzhou University(Natural Science Edition) , 2019 , 51 ( 4 ): 1 - 10 ,29. (in Chinese)

任海蕾 . 基于多相机标定的全景合成方法研究 [D ] . 西安 : 西安电子科技大学 , 2019 .

REN H L . Research on panorama synthesis method based on multi-camera calibration [D ] . Xi’an : Xidian University , 2019 . (in Chinese)

郑文玲 , 钱宏文 , 杨文豪 , 等 . 基于多相机标定的全景实时拼接算法研究 [J ] . 电子设计工程 , 2021 , 29 ( 17 ): 165 - 169 .

ZHENG W L , QIAN H W , YANG W H , et al. Research on real-time panoramic mosaic algorithm based on multi-camera calibration [J ] . Electronic Design Engineering , 2021 , 29 ( 17 ): 165 - 169 . (in Chinese)

CHEN H F , ZHUANG J L , LIU B Y , et al. Camera calibration method based on circular array calibration board [J ] . Systems Science & Control Engineering , 2023 , 11 ( 1 ): 2233562 .

黄文文 , 彭小红 , 李丽圆 , 等 . 相机标定方法及进展研究综述 [J ] . 激光与光电子学进展 , 2023 , 60 ( 16 ): 9 - 19 .

HUANG W W , PENG X H , LI L Y , et al. Review of camera calibration methods and their progress [J ] . Laser & Optoelectronics Progress , 2023 , 60 ( 16 ): 9 - 19 . (in Chinese)

段志瑜 , 罗哉 , 江文松 , 等 . 基于改进ArUco标签的位姿估计方法 [J ] . 计量学报 , 2024 , 45 ( 3 ): 364 - 371 .

DUAN Z Y , LUO Z , JANG W S , et al. Pose estimation method based on improved ArUco tags [J ] . Acta Metrologica Sinica , 2024 , 45 ( 3 ): 364 - 371 . (in Chinese)

LIN W W , LIANG P D , LUO G T , et al. Research of online hand-eye calibration method based on ChArUco board [J ] . Sensors , 2022 , 22 ( 10 ): 3805 .

ZHANG Z Y . Flexible camera calibration by viewing a plane from unknown orientations [C ] //Proceedings of the Seventh IEEE International Conference on Computer Vision.Kerkyra, Greece:IEEE , 1999 : 666 - 673 .

FISCHLER M A , BOLLES R C . Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography [J ] . Communications of the ACM , 1981 , 24 ( 6 ): 381 - 395 .

de JESUS RUBIO J . Stability analysis of the modified levenberg-marquardt algorithm for the artificial neural network training [J ] . IEEE Transactions on Neural Networks and Learning Systems , 2020 , 32 ( 8 ): 3510 - 3524 .

夏丹 , 周睿 . 视差图像配准技术研究综述 [J ] . 计算机工程与应用 , 2021 , 57 ( 2 ): 18 - 27 . DOI: 10.3778/j.issn.1002-8331.2007-0040 http://doi.org/10.3778/j.issn.1002-8331.2007-0040 传统图像配准技术受限于严苛的初始输入已难以满足人们的需求，近年来，视差图像的配准逐渐成为图像拼接技术中的研究热点。基于视差形成原理介绍了视差图像配准的难点与一般流程。主要研究了基于特征的视差图像配准技术，对近年来视差图像配准的研究成果进行了归纳梳理，并从基于多平面对齐的图像配准、基于网格变形的图像配准以及缝合线驱动的图像配准三个方面进行阐述。通过对各种典型的视差图像配准算法的算法思想、特点以及局限性进行描述和比较，提供该领域研究现状的系统综述，并对视差图像配准技术的研究趋势进行了展望。

XIA D , ZHOU R . Survey of parallax image registration technology [J ] . Computer Engineering and Applications , 2021 , 57 ( 2 ): 18 - 27 . (in Chinese) DOI: 10.3778/j.issn.1002-8331.2007-0040 http://doi.org/10.3778/j.issn.1002-8331.2007-0040 <p>Limited by the initial input images, traditional image registration technology cannot meet people&rsquo;s needs. Nowadays parallax image registration has gradually become a research focus in image mosaic technology. The difficulty and general flow of parallax image registration are introduced based on the principle of parallax formation. And the feature-based parallax image registration technology is mainly introduced. The research results of parallax image registration in recent years are summarized and expanded from the image registration based on multi-plane alignment, the image registration based on mesh deformation and the seam-driven image registration. Through summarizing and comparing the algorithm ideas, characteristics and limitations of various typical parallax image registration algorithms, a systematic overview of the research status in this field is provided. Furthermore, the future research directions of parallax image registration are also prospected.</p>

FARNEBACK G . Two-frame motion estimation based on polynomial expansion [C ] //Proceedings of the Image Analysis:13th Scandinavian Conference.Berlin,Heidelberg, Germany:Springer , 2003 : 363 - 370 .

BROWN M , LOWE D G . Automatic panoramic image stitching using invariant features [J ] . International Journal of Computer Vision , 2007 , 74 ( 1 ): 59 - 73 .

ZARAGOZA J , CHIN T J , BROWN M S , et al. As-projective-as-possible image stitching with moving DLT [C ] //Proceedings of 2013 IEEE Conference on Computer Vision and Pattern Recognition.Portland,OR, US:IEEE , 2013 : 2339 - 2346 .

刘杰 , 游品鸿 , 田明 , 等 . 基于局部投影的视差图像拼接平滑优化 [J ] . 电子学报 , 2022 , 50 ( 6 ): 1451 - 1456 . DOI: 10.12263/DZXB.20200664 http://doi.org/10.12263/DZXB.20200664 针对视差图像拼接之后存在对齐不准和扭曲的问题，提出一种基于局部投影的视差图像拼接的平滑优化方法.将输入图像进行特征点检测，通过局部保留结构进行图像匹配并计算投影矩阵，利用重合边界投影模型与投影矩阵进行归一化距离判定，距离小于阈值则保留，大于阈值则舍弃并继续矩阵计算.在图像非重合部分，利用图像的变形函数得到最小弯曲能量函数，使非重合区域向全局变换上过渡.实验结果表明：所提算法提高了图像匹配精度，对图像的扭曲具有优化作用，增强了图像的整体性并获得了更好的视觉体验.

LIU J , YOU P H , TIAN M , et al. Smooth optimization of parallax images mosaic based on local projection [J ] . Acta Electronica Sinica , 2022 , 50 ( 6 ): 1451 - 1456 . (in Chinese) DOI: 10.12263/DZXB.20200664 http://doi.org/10.12263/DZXB.20200664 Aiming at the problems of misalignment and distortion after parallax image stitching, a smooth optimization method for parallax image stitching based on local projection is proposed. The input image is performed feature point detection, matched by locality preserving structure, and calculated the projection matrix. The normalized distance is determined by the projection model of the coincident area and the projection matrix. If it is less than the threshold, it will be retained, otherwise it will be discarded and continue matrix calculation. In the non-coincident part of the image, the minimum bending energy function is obtained by calculating the deformation function of the image, so that the non-coincident region transits to the global transformation. The experimental results show that the proposed algorithm can not only improve the matching accuracy of the image, but also optimize the distortion of the image, enhance the integrity of the image and obtain a better visual experience.