Detection of Metal Surface Scratch Based on YOLOv4 Network Model

doi:10.12382/bgxb.2022.A011

Abstract

Abstract: Metal surface scratch detection aims to achieve the classification recognition and precise scale localization of metal scratchs. The current traditional image processing methods are difficult to achieve the accurate localization and recognition of scratches due to their different shapes and low contrast with the background.A shallow neural network model based on small scale convolution kernel is proposed. The proposed model uses the correlation theory of small target detection to enhance the scratches at the data level first and then train the network model to achieve the accurate detection of surface scratches.Compared with the original YOLOv4 model， the proposed model can avoid the missing detection and false detection of insignificant scratches better， and also can extract the penetrating or long scratches more accurately and completely.The model can fully meet the requirements of accurate inspection of production line.

Key words: metalsurface, scratchdetection, YOLOv4networkmodel, NEUdataset

CLC Number:

TP391.4

ZHANG Boyao， LENG Yanbing. Detection of Metal Surface Scratch Based on YOLOv4 Network Model[J]. Acta Armamentarii, 2022, 43(S1): 214-221.

References

［1］ GHORAI S，MUKHERJEE A，GANGADARAN M，et al.Automatic defect detection on hot-rolled flat steel products［J］.

IEEE Transactions on Instrumentation and Measurement，2012，62(3):612-621.
［2］ SONG K C，YAN Y H.A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects［J］.Applied Surface Science，2013，285(Part B):858-864.
［3］ ZHANG H，JIN X T，WU Q M J，et al.Automatic visual detection system of railway surface defects with curvature filter and improved Gaussian mixture model［J］.IEEE Transactions on Instrumentation and Measurement，2018，67(7):1593-1608.
［4］ WANG H Y，ZHANG J W，TIAN Y，et al.A simple guidance template-based defect detection method for strip steel surfaces［J］.IEEE Transactions on Industrial Informatics，2018，15(5):2798-2809.
［5］ GIRSHICK R.Fast R-CNN［C］∥Proceedings of the IEEE International Conference on Computer Vision.Santiago，Chile:IEEE，2015:1440-1448.
［6］ HE K M，GKIOXARI G，DOLLR P，et al.Mask R-CNN［C］∥Proceedings of the IEEE International Conference on Computer Vision. Venice，Italy：IEEE，2017:2980-2988.
［7］ REN S，HE K，GIRSHICK R，et al.Faster R-CNN:towards real-time object detection with region proposal networks［J］.arXiv preprint arXiv，2015:1506.01497.

表5 金属表面划痕检测结果视觉比较（优化模型提取的目标范围信息较为完整，
原始模型只提取到划痕的一部分）
Tab.5 Visual comparison of metal surface scratch detection results (the target range information extracted from
the optimized model is relatively complete， and the original model only extracted a part of the scratches

［8］ REDMON J，DIVVALA S，GIRSHICK R，et al.You only look once: unified， real-time object detection［C］∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Las Vegas，NV，US: IEEE， 2016.
［9］ REDMON J，FARHADI A.YOLO 9000:better，faster，stronger［C］∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu，HI，US:IEEE，2017.
［10］ REDMON J，FARHADI A.YOLOv3:An incremental improvement［J］.arXiv preprint arXiv，2018：02767.
［11］ BOCHKOVSKIY A，WANG C Y，LIAO H Y M. YOLOv4: Optimal speed and accuracy of object detection［J］.arXiv preprint arXiv，2020：10934.
［12］张永梅，赖裕平，马健喆，等.基于视频的装甲车和飞机检测跟踪及轨迹预测算法［J］.兵工学报，2021，42（3）：545- 554.
ZHANG Y M，LAI Y P，MA J Z，et al. A video-based prediction algorithm for armored vehicle and aircraft detection/tracking and trajectory［J］.Acta Armamentarii，2021，42（3）：545-554.(in Chinese)
［13］穆思奇，林进健，汪海泉，等. 基于改进YOLOv4的X射线图像违禁品检测算法［J］. 兵工学报，2021，42（12）：2675-2683.
MU S Q，LIN J J，WANG H Q，et al. An algorithm for detection of prohibited items in X-ray images based on improved YOLOv4［J］.Acta Armamentarii，2021，42（12）：2675-2683.(in Chinese)
［14］ BOCHKOVSKIY A，WANG C Y，LIAO H Y M.YOLOv4:Optimal speed and accuracy of object detection［J］.arXiv preprint arXiv，2020：10934.
［15］ MASCI J，MEIER U，FRICOUT G，et al.Multi-scale pyramidal pooling network for generic steel defect classification［C］∥Proceedings of the 2013 International Joint Conference on Neural Networks. Dallas，TX，US:IEEE，2013.
［16］ NATARAJAN V，HUNG T Y，VAIKUNDAM S，et al.Convolutional networks for voting-based anomaly classification in metal surface inspection［C］∥Proceedings of the 2017 IEEE International Conference on Industrial Technology.Toronto，ON，Canada:IEEE，2017:986-991.
［17］ HE Y，SONG K C，DONG H W，et al.Semi-supervised defect classification of steel surface based on multi-training and generative adversarial network［J］.Optics and Lasers in Engineering，2019，122:294-302.
［18］ HE Y，SONG K C，MENG Q G，et al.An end-to-end steel surface defect detection approach via fusing multiple hierarchical features［J］.IEEE Transactions on Instrumentation and Measurement，2019，69(4):1493-1504.
［19］ JOSESH N， JACOB S. Responding to the controversy about YOLOv5［EB/OL］. (2022-06-13)［2022-06-13］. https:∥blog.roboflow.com/yolov4-versus-yolov5.
［20］ HE K M，ZHANG X Y，REN S Q，et al.Spatial pyramid pooling in deep convolutional networks for visual recognition［J］.IEEE Transactions on Pattern Analysis and Machine Intelligence，2015，37(9): 1904-1916.
［21］ LIU S，QI L，QIN H F，et al.Path aggregation network for instance segmentation［C］∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Salt Lake City，UT，US:IEEE， 2018:8759-8768.
［22］ WANG C Y，LIAO H Y M，WU Y H，et al.CSPNet: A new backbone that can enhance learning capability of CNN［C］∥Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.Seattle，WA，US:IEEE，2020.

[1]	LIN Sen, WANG Jingang, GAO Hongwei. Battlefield Image Dehazing Based on Global Compensation Attention Mechanism [J]. Acta Armamentarii, 2024, 45(4): 1344-1353.
[2]	SONG Xiaoru, LIU Kang, GAO Song, CHEN Chaobo, YAN Kun. Research on Improved YOLOv5-based Military Target Recognition Algorithm Used in Complex Battlefield Environment [J]. Acta Armamentarii, 2024, 45(3): 934-947.
[3]	DING Xiwen, CHENG Hongchang, YUAN Yuan, SU Yue. Detection Method for Field-of-view Defect of Ultraviolet Image Intensifier Based on Improved SSD Algorithm [J]. Acta Armamentarii, 0, (): 0-0.
[4]	DING Bosheng, ZHANG Ruiheng, XU Lixin, CHEN Huiming. Sand-dust Image Restoration Using Gray Compensation and Feature Fusion [J]. Acta Armamentarii, 2023, 44(10): 3115-3126.
[5]	WANG Qiang, WU Letian, LI Hong, WANG Yong, WANG Huan, YANG Wankou. An Infrared Small Target Detection Method via Dual Network Collaboration [J]. Acta Armamentarii, 2023, 44(10): 3165-3176.
[6]	HUI Kanghua, YANG Wei, LIU Haohan, ZHANG Zhi, ZHENG Jin, BAI Xiao. Enhanced Multi-scale Target Detection Method Based on YOLOv5 [J]. Acta Armamentarii, 2023, 44(9): 2600-2610.
[7]	ZHAO Xiaodong, ZHANG Xunying. Optimization Algorithm of Autonomous Target Recognition for Unmanned Vehicles Based on YOLOv5 [J]. Acta Armamentarii, 2023, 44(9): 2732-2744.
[8]	XIAO Feng, LU Hao, ZHANG Wenjuan, HUANG Shujuan, JIAO Yulin, LU Zhaoting, LI Zhaoshan. Aerial Infrared Image Target Recognition Algorithm Based on Rotation Equivariant Convolution [J]. Acta Armamentarii, 0, (): 0-0.
[9]	SUN Jiawei, WAN Gang, GU Jinliang, XU Mingjie, KONG Xiaofang. Research on Measurement Method of Dynamic Parameters of Underwater Projectiles and Supercavitation Evolution Process Based on Line Array Camera [J]. Acta Armamentarii, 0, (): 0-0.
[10]	CHANG Tianqing, ZHANG Jie, ZHAO Liyang, HAN Bin, ZAHGN Lei. Armored Vehicle Detection Algorithm Based on Fusion of Visible and Infrared Images [J]. Acta Armamentarii, 0, (): 0-0.
[11]	ZHANG Liang'an, CHEN Yang, XIE Shenglong, LIU Tongxin. Crack Detection System for Aircraft Protective Grill based on Machine Vision and Deep Learning [J]. Acta Armamentarii, 2023, 44(2): 507-516.
[12]	TANG Wei, JIA Fangxiu, WANG Xiaoming. Visible and Infrared Image Adaptive Fusion Based on Bilateral Filters [J]. Acta Armamentarii, 2022, 43(11): 2836-2845.
[13]	WANG Liang, CHEN Jianhua, LI Ye. A Target Identification Technique for Unmanned Surface Vessel Based on Deep Learning [J]. Acta Armamentarii, 2022, 43(S2): 13-19.
[14]	ZHAO Junmin， WEI Jiayi， WU Sijie， LI Xinguo， L Meibo. Anti-Interference Recognition Algorithm for Aerial Targets in the Complex Confrontation Environment on the Battlefield [J]. Acta Armamentarii, 2022, 43(10): 2576-2587.
[15]	LI Bo， WANG Bo， HAN Jingye， YANG Zongrui， LI Linyun， FU Changzhi. Infrared Image Moving Object Detection Technology Based on Onboard Computer [J]. Acta Armamentarii, 2022, 43(S1): 66-73.