1. 中国兵器工业计算机应用技术研究所, 北京 100089
2. 北京理工大学 机械与车辆学院, 北京 100081
*邮箱: wen20100723@126.com
收稿:2022-11-30,
网络出版:2023-12-12,
纸质出版:2023-11-30
移动端阅览
郭永红, 牛海涛, 史超, 等. 基于卷积和注意力机制的小样本目标检测[J]. 兵工学报, 2023,44(11):3508-3515.
Yonghong GUO, Haitao NIU, Chao SHI, et al. Few-shot Object Detection Based on Convolution Network and Attention Mechanism[J]. Acta Armamentarii, 2023, 44(11): 3508-3515.
郭永红, 牛海涛, 史超, 等. 基于卷积和注意力机制的小样本目标检测[J]. 兵工学报, 2023,44(11):3508-3515. DOI: 10.12382/bgxb.2022.1167.
Yonghong GUO, Haitao NIU, Chao SHI, et al. Few-shot Object Detection Based on Convolution Network and Attention Mechanism[J]. Acta Armamentarii, 2023, 44(11): 3508-3515. DOI: 10.12382/bgxb.2022.1167.
小样本目标检测(FSOD)旨在使检测器只用少量的训练样本就能适应未见的类别。典型的FSOD方法使用Faster R-CNN作为基本检测框架
利用卷积神经网络提取图像特征
而卷积神经网络中采用的旨在捕获尽可能多的图像信息的池化操作将不可避免地导致图像信息的丢失。在主干网络中引入混合扩张卷积
以确保更大的感受野并最大限度地减少图像信息的损失。在
k
-shot设置中
为充分利用给定的支持
数据
提出支持特征动态融合模块
以每个支持特征和查询特征之间的相关性为权重
自适应地融合支持特征
以获得更强大的支持线索。实验结果表明
新方法在公共Pascal VOC和MS-COCO数据集上实现了较好的FSOD性能。
Few-shot object detection(FSOD) aims to enable the detector with a small number of training samples. Typical FSOD method takes Faster R-CNN as the basic detection framework
and uses a convolutional neural network to extract the image features. However
the pooling operation used in the convolutional neural network inevitably leads to the loss of image information. Therefore
a hybrid dilated convolution is introduced into the backbone network to ensure a larger receptive field and minimize the loss of image information. A support feature dynamic fusion module is proposed to further utilize the given support data in
k
-shot setting
which adaptively fuses the support features with the weight of the correlation between each support feature and query feature to obtain stronger support clues. Experimental results show that rhe proposed method achieves good and state-of-the-art FSOD performance on public Pascal VOC and MS-COCO datasets.
王芳 , 王海晏 , 寇添 , 等 . 多维特征点空间的红外弱小目标检测方法 [J ] . 应用光学 , 2020 , 41 ( 6 ): 1268 - 1276 . DOI: 10.5768/JAO202041.0606002 http://doi.org/10.5768/JAO202041.0606002 将人工智能算法引入目标检测,空间红外弱小目标的检测也可归为模糊检测的二分类问题。依据空中红外弱小目标的探测模型,建立了信号电压比光谱模型,仿真分析表明电压比变化趋势与目标的速度、姿态和两机态势有关,可用以检测目标。采用动态特征构建理论,构建了红外弱小目标的双色比特征空间,基于该特征空间,优化最小二乘分类算法,用于从光谱信号层级检测目标。该方法不仅缩小了样本数据量,而且防止了高斯核函数参数选择引起的“过拟合”现象,既保证了分类精度,又使分类速率提高近1倍,为人工智能算法用于红外弱小目标检测提供了参考依据。
WANG F , WANG H Y , KOU T , et al . Multi-dimensional feature point space infrared dim target detection method [J ] . Journal of Applied Optics , 2020 , 41 ( 6 ): 1268 - 1276 . (in Chinese) DOI: 10.5768/JAO202041.0606002 http://doi.org/10.5768/JAO202041.0606002 As artificial intelligence algorithm was introduced into target detection, the detection of spatial infrared dim targets could be classified as the binary problem of fuzzy detection. According to the detection model of infrared dim target in the air, a signal voltage ratio spectrum model was established. The simulation analysis showed that the variation trend of voltage ratio was related to the speed, attitude of the target and the two-machine posture, which could be used to detect the target. The dynamic characteristics building theory was adopted to build the bicolor ratio feature space of infrared dim target. Based on this feature space, the least squares classification algorithm was optimized to identify the objects from the spectral signal hierarchy. This method not only reduces the amount of the sample data, but also prevents the phenomenon of over-fitting caused by the parameter selection of Gaussian kernel function. It ensures the classification accuracy and improves the classification efficiency nearly doubled. Reference basis is provided for infrared dim target detection by artificial intelligence algorithm.
牛畅 , 尹奎英 , 黄银和 . 无人机对地目标自动检测与跟踪技术 [J ] . 应用光学 , 2020 , 41 ( 6 ): 1153 - 1160 . DOI: 10.5768/JAO202041.0601003 http://doi.org/10.5768/JAO202041.0601003 针对无人机图像帧序列具有平台高速运动,视角旋转强烈,需要实时处理等特点,提出一种基于双级旋转不变特征空间检测(粗匹配-精细匹配)与并行特征提取跟踪的无人机对地目标图像帧序列自动快速目标检测与跟踪算法。采用图像子块的平均灰度值、灰度值方差、灰度值梯度构建特征空间。通过构造图像特征空间的方法来快速筛选待匹配图像的可疑区域,删除大量的背景区域,检测算法使用全局初步匹配加局部精细匹配的方法来规避算法复杂度的缺陷。理论及实验分析表明:该算法实时性强,对图像的旋转畸变具有抵消作用,对异常情况可以恰当处理,且全局初步匹配流程具有可移植性,可以在其他图像匹配跟踪算法中充当预处理器。实验结果表明:该算法在无人机对地的情况下可以保证对地面目标的稳定跟踪,配套检测算法具有较好的实时性,满足无人机图像目标检测跟踪实时处理的需要。
NIU C , YIN K Y , HUANG Y H . Automatic target detecting and tracking technology based on UAV ground target images [J ] . Journal of Applied Optics , 2020 , 41 ( 6 ): 1153 - 1160 . (in Chinese) DOI: 10.5768/JAO202041.0601003 http://doi.org/10.5768/JAO202041.0601003 Since UAV(unmanned aerial vehicle) image frames has characteristics such as high speed moving platform, intensity view rotation, real-time processing and so on, a UAV ground target image frames detecting and tracking algorithm based on two-level rotation invariant feature space detection and tracking on account of parallel feature extraction was put forward. The detection algorithm used primary matching and meticulous matching to reduce the algorithm complexity. The theoretical analysis and experiments showed that the proposed algorithm has better real-time performance, insensitive to image rotation and have better performance on abnormal conditions and the primary overall-match process in proposed algorithm can act as the pretreatment of other image matching and tracking algorithms. The experiment results indicate that the proposed algorithm can ensure stable target tracking under the situations of UAV images. At the same time, the detecting process has better real-time performance, which can meet the real-time processing demand of target detection and track of UAV image frames.
杜鹏飞 , 李小勇 , 高雅丽 . 多模态视觉语言表征学习研究综述 [J ] . 软件学报 , 2021 , 32 ( 2 ): 327 - 348 .
DU P F , LI X Y , GAO Y L . Survey on multimodal visual language representation learning [J ] . Journal of Software , 2021 , 32 ( 2 ): 327 - 348 . (in Chinese)
KANG B Y , LIU Z , WANG X , et al . Few-shot object detection via feature reweighting [C ] // Proceedings of the IEEE/CVF International Conference on Computer Vision . Changshu, China : IEEE , 2019 : 8420 - 8429 .
梁杰 , 任君 , 李磊 , 等 . 基于典型几何形状精确回归的机场跑道检测方法 [J ] . 兵工学报 , 2020 , 41 ( 10 ): 2045 - 2054 .
LIANG J , REN J , LI L , et al . Airport runway detection algorithm based on accurate regression of typical geometric shapes [J ] . Acta Armamentarii , 2020 , 41 ( 10 ): 2045 - 2054 . (in Chinese)
WANG Y X , RAMANAN D , HEBERT M . Meta-learning to detect rare objects [C ] // Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision . Seoul, Korea : IEEE , 2019 : 9924 - 9933 .
ZHANG G J , LUO Z P , CUI K W , et al . Meta-DETR: image-level few-shot detection with inter-class correlation Exploitation [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2023 , 45 ( 11 ): 12832 - 12843 .2, DOI: 10.1109/TPAMI.2022.3195735 https://dx.doi.org/10.1109/TPAMI.2022.3195735 .
VILALTA R , DRISSI Y . A perspective view and survey of meta-learning [J ] . Artificial Intelligence Review , 2002 , 18 ( 2 ): 77 - 95 . DOI: 10.1023/A:1019956318069 http://doi.org/10.1023/A:1019956318069 http://link.springer.com/10.1023/A:1019956318069 http://link.springer.com/10.1023/A:1019956318069
WEISS K , KHOSHGOFTAAR T M , WANG D D . A survey of transfer learning [J ] . Journal of Big Data , 2016 , 3 ( 1 ): 1 - 40 . DOI: 10.1186/s40537-015-0036-x http://doi.org/10.1186/s40537-015-0036-x http://www.journalofbigdata.com/content/3/1/1 http://www.journalofbigdata.com/content/3/1/1
HAN G X , HUANG S Y , MA J W J , et al . Meta faster R-CNN:towards accurate few-shot object detection with attentive feature alignment [C ] // Proceedings of the 36th AAAI Conference on Artificial Intelligence. Reston, VA,US:AIAA , 2022 , 36 ( 1 ): 780 - 789 .
REN S Q , HE K M , GIRSHICK R , et al . Towards real-time object detection with region proposal networks [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2016 , 39 ( 6 ): 1137 - 1149 . DOI: 10.1109/TPAMI.2016.2577031 http://doi.org/10.1109/TPAMI.2016.2577031 http://ieeexplore.ieee.org/document/7485869/ http://ieeexplore.ieee.org/document/7485869/
QIAO L M , ZHAO Y X , LI Z Y , et al . DeFRCN:Decoupled faster R-CNN for few-shot object detection [C ] // Proceedings of the IEEE/CVF International Conference on Computer Vision . Paris, France : IEEE , 2021 : 8681 - 8690 .
WANG P Q , CHEN P F , YUAN Y , et al . Understanding convolution for semantic segmentation [C ] // Proceedings of 2018 IEEE Winter Conference on Applications of Computer Vision . Lake Tahoe, NV, US : IEEE , 2018 : 1451 - 1460 .
LIU W , ANGUELOV D , ERHAN D , et al . SSD:single shot multibox detector [C ] // Proceedings of the 14th European Conference on Computer Vision . Amsterdam,the Netherlands : Springer , 2016 : 21 - 37 .
REDMON J , DIVVALA S , GIRSHICK R , et al . You only look once:unified, real-time object detection [C ] // Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition . Lyon, France : IEEE , 2016 : 779 - 788 .
GIRSHICK R . Fast R-CNN [C ] // Proceedings of the 2015 IEEE International Conference on Computer Vision. Santiago,Chile:IEEE , 2015 : 1440 - 1448 .
WU J X , LIU S T , HUANG D , et al . Multi-scale positive sample refinement for few-shot object detection [C ] // Proceedings of the 16th European Conference on Computer Vision . Glasgow, UK : Springer , 2020 : 456 - 472 .
YAN X P , CHEN Z , XU A , et al . Towards general solver for instance-level low-shot learning [C ] // Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision . Seoul, Korea : IEEE , 2019 : 9577 - 9586 .
WANG X , HUANG T E , DARRELL T , et al . Frustratingly simple few-shot object detection:arXiv:2003.06957 [R ] . Ithaca, NY, US: Cornell University , 2020 :2003.06957.
SUN B , LI B H , CAI S C , et al . Few-shot object detection via contrastive proposal encoding [C ] // Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition . Paris, France : IEEE , 2021 : 7352 - 7362 .
LI B H , YANG B Y , LIU C , et al . Beyond max-margin: class margin equilibrium for few-shot object detection [C ] // Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Nashville, TN, US : IEEE , 2021 : 7359 - 7368 .
CHEN L C , PAPANDROU G , KOKKINOS I , et al . DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs [J ] . IEEE Transactions on Pattern Analysis and Machine Intelligence , 2017 , 40 ( 4 ): 834 - 848 . DOI: 10.1109/TPAMI.2017.2699184 http://doi.org/10.1109/TPAMI.2017.2699184 http://ieeexplore.ieee.org/document/7913730/ http://ieeexplore.ieee.org/document/7913730/
EVERINGHAM M , COOL L V , WILLIAMS C K I , et al . The pascal visual object classes(VOC) challenge [J ] . International Journal of Computer Vision , 2010 , 88 ( 2 ): 303 - 338 . DOI: 10.1007/s11263-009-0275-4 http://doi.org/10.1007/s11263-009-0275-4 http://link.springer.com/10.1007/s11263-009-0275-4 http://link.springer.com/10.1007/s11263-009-0275-4
LIN T Y , MAIRE M , BELONGIE S , et al . Microsoft coco: common objects in context [C ] // Proceedings of the 13rd European Conference on Computer Vision . Zurich, Switzerland : Springer , 2014 : 740 - 755 .
RUSSAKOVSKY O , DENG J , SU H , et al . Imagenet large scale visual recognition challenge [J ] . International Journal of Computer Vision , 2015 , 115 ( 3 ): 211 - 252 . DOI: 10.1007/s11263-015-0816-y http://doi.org/10.1007/s11263-015-0816-y http://link.springer.com/10.1007/s11263-015-0816-y http://link.springer.com/10.1007/s11263-015-0816-y
0
浏览量
1025
下载量
0
CNKI被引量
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024360号