Deep Learning-based Intelligent Target Recognition Technology for Electro-optical System

doi:10.12382/bgxb.2022.A004

Abstract

Abstract: Intelligent target recognition technology is an important support of multi-dimensional and three-dimensional reconnaissance system of electro-optical system, which is the basis of multi-angle and omni-directional target positioning and perception analysis. Focusing on the three challenges of data，algorithm and computing power，an intelligent target recognition method based on multi-source information fusion is proposed to meet the needs of deep learning-based target recognition of electro-optical system in complex environment.The proposed method is to learn and train the images fused by multiple sensors so as to improve the ability to recognize targets.The target recognition technology based on multi-dimensional image fusion is used to label，train and learn the multi band fused image data，thus automatically identifying the multiple targets in the image. Experimental results show that the proposed method can be used to accurately identify and locate the fusion target.

Key words: electro-opticalsystem, intelligenttargetrecognition, deeplearning, multi-sourcedata, imagefusion, visualperception

CLC Number:

TP29

LI Liangfu， CHEN Weidong， GAO Qiang， XU Kailuan， LIU Xuan， HE Xi， QIAN Jun. Deep Learning-based Intelligent Target Recognition Technology for Electro-optical System[J]. Acta Armamentarii, 2022, 43(S1): 162-168.

References

［1］ LEE J S，PARK T H.Fast road detection by CNN-based camera-lidar fusion and spherical coordinate transformation［J］.IEEE Transactions on Intelligent Transportation Systems，2021，22(9):5802-5810.
［2］ CAVALIERE D，LOIA V，SAGGESE A，et al. Semantically enhanced UAVs to increase the aerial scene understanding［J］.IEEE Transactions on Systems，Man，and Cybernetics:Systems，2019，49(3): 555-567.
［3］王芳，王海晏，寇添，等.多维特征点空间的红外弱小目标检测方法［J］.应用光学，2021，41(6):1268-1276.
WANG F，WANG H Y，KOU T，et al.Multi-dimensional feature point space infrared dim target detection method［J］.Journal of Applied Optics，2021，41(6):1268-1276.(in Chinese)
［4］牛畅，尹奎英，黄银和.无人机对地目标自动检测与跟踪技术［J］.应用光学，2021，41(6):1153-1160.
NIU C，YIN K Y，HUANG Y H.Automatic target detecting and tracking technology based on UAV ground target images［J］.Journal of Applied Optics，2021，41(6): 1153-1160.(in Chinese)
［5］高文静，杨预立，邢强，等.基于目标运动的复眼式双目视觉测距法［J］.应用光学，2020，41(3):571-579.
GAO W J，YANG Y L，XING Q,et al Compound eye binocular vision ranging method based on target motion ［J］. Journal of Applied Optics，2020，41(3): 571-579.(in Chinese)
［6］杜鹏飞，李小勇，高雅丽.多模态视觉语言表征学习研究综述［J］.软件学报，2021，32(2):327-348.
DU P F，LI X Y，GAO Y L. Survey on multimodal visual language representation learning［J］.Journal of Software，2021，32(2):327-348.(in Chinese)
［7］ WANG Z C，DU L，ZHANG P， et al.Visual attention-based target detection and discrimination for high-resolution SAR images in complex scenes［J］.IEEE Transactions on Geoscience and Remote Sensing，2018，56(4):1855-1872.
［8］ CHEN L C，PAPANDREOU G，KOKKINOS I，et al. DeepLab:semantic image segmentation with deep convolutional nets， atrous convolution，and fully connected CRFs［J］.IEEE Transactions on Pattern Analysis and Machine Intelligence，2018，40(4):834-848.
［9］ MADAWI K E，RASHED H.，SALLAB A E，et al. RGB and lidar
fusion based 3D semantic segmentation for autonomous driving［C］∥
Proceedings of IEEE Intelligent Transportation Systems Conference.Auckland，New Zealand:IEEE, 2019.
［10］ LIU J，GONG M G，QIN K，et al.A deep convolutional coupling network for change detection based on heterogeneous optical and radar images［J］.IEEE Transactions on Neural Networks and Learning Systems，2018，29(3):545-559.
［11］ MINAEIAN S，LIU J，SON Y J.Effective and efficient detection of moving targets from a UAV's camera［J］.IEEE Transactions on Intelligent Transportation Systems，2018，19(2):497-506.
［12］ AL-KAFF A, MARTN D, GARCA F，et al.Survey of computer vision algorithms and applications for unmanned aerial vehicles［J］. Expert Systems with Applications，2018，92:447-463.
［13］ XU D，DUAN Q，ZHENG J M, et al.Shading-based surface detail recovery under general unknown illumination［J］. IEEE Transactions on Pattern Analysis and Machine Intelligence，2018，40(2):423-436.
［14］高昂，董志明，叶红兵，等.基于深度强化学习的巡飞弹突防控制决策［J］.兵工学报，2021，42(5):1101-1110.
GAO A，DONG Z M，YE H B, et al. Loitering munition penetration control decision based on deep reinforcement learning［J］.Acta Armamentarii，2021，42(5):1101-1110.(in Chinese)
［15］闫孟达，杨任农，左家亮，等.基于深度学习的空空导弹多类攻击区实时解算［J］.兵工学报，2020，41(12):2466-2477.
YAN M D，YANG R N，ZUO J L, et al.Real-time computing of air-to-air missile multiple capture zones based on deep learning［J］. Acta Armamentarii，2021，41(12):2466-2477.(in Chinese)

[1]	ZHANG Tongtong, JIANG Huhai, YUE Wei, SI Chen, YUAN Man. Adaptive Control Based on RBF Neural Network for Electro-optical System [J]. Acta Armamentarii, 2022, 43(3): 556-564.
[2]	LI Jinqing, LIU Zefei, MAN Zhenlong. Key Generation Method Based on Generative Adversarial Network and Its Application in Low-light-level Image Encryption [J]. Acta Armamentarii, 2022, 43(2): 337-344.
[3]	PU Yunwei， LIU Taotao， GUO Jiang， WU Haixiao. Radar Emitter Signal Recognition Based on Convolutional Neural Network and Coordinate Transformation of AmbiguityFunction Main Ridge [J]. Acta Armamentarii, 2021, 42(8): 1680-1689.
[4]	ZHU Min， XU Aiqiang， XU Qing， LI Ruifeng. Fault Diagnosis of Analog Circuits Based on Improved Multilayer Kernel Extreme Learning Machine [J]. Acta Armamentarii, 2021, 42(2): 356-369.
[5]	ZHANG Feng, ZHANG Chao, YANG Huamin, WANG Fabin. Deep Learning-based Color Compensation Method for Projected Images in Combat Assistant System [J]. Acta Armamentarii, 2021, 42(11): 2418-2423.
[6]	XUE Lingzhi, ZENG Xiangyang, YANG Shuang. Underwater Acoustic Target Recognition Algorithm Based on Generative Adversarial Networks [J]. Acta Armamentarii, 2021, 42(11): 2444-2452.
[7]	YU Yue， WANG Honglun. Deep Learning-based Reentry Predictor-corrector Fault-tolerant Guidance for Hypersonic Vehicles [J]. Acta Armamentarii, 2020, 41(4): 656-669.
[8]	YAN Mengda， YANG Rennong， ZUO Jialiang， HU Dongyuan， YUE Longfei， ZHAO Yu. Real-time Computing of Air-to-air Missile Multiple Capture Zones Based on Deep Learning [J]. Acta Armamentarii, 2020, 41(12): 2466-2477.
[9]	LIANG Jie, REN Jun, LI Lei, QI Hang, ZHOU Hongli. Airport Runway Detection Agorithm Based on Accurate Regression of Typical Geometric Shapes [J]. Acta Armamentarii, 2020, 41(10): 2045-2054.
[10]	YU Yongwei， PENG Xi， DU Liuqing， CHEN Tianhao. Real-time Detection of Parts by Assembly Robot Based on Deep Learning Framework [J]. Acta Armamentarii, 2020, 41(10): 2122-2130.
[11]	WANG Jing， LI Tian-mei， HE Hua-feng， XU Cong-qi. Research on Multi-source Data Equivalent Methods for Testability Integrated Evaluation [J]. Acta Armamentarii, 2017, 38(1): 151-159.