Welcome to Acta Armamentarii ! Today is Share:

Acta Armamentarii ›› 2021, Vol. 42 ›› Issue (9): 1911-1922.doi: 10.3969/j.issn.1000-1093.2021.09.012

• Paper • Previous Articles     Next Articles

Infrared and Visible Images Fusion based on Non-subsampled Contourlet Transform and Guided Filter

DING Guipeng1, TAO Gang1, LI Yingchao2, PANG Chunqiao1, WANG Xiaofeng1, DUAN Guiru3   

  1. (1.School of Energy and Power Engineering, Nanjing University of Science and Technology, Nanjing 210094, Jiangsu,China;2.School of Optoelectronic Engineering, Changchun University of Science and Technology, Changchun 130022,Jilin,China;3.Military Representative Office in Jilin Region,Army General Armament Department, Jilin 132000,Jilin,China)
  • Online:2021-10-20

Abstract: An image fusion method based on non-subsampled contourlet transform (NSCT) and guided filter is proposed to overcome the shortcomings of traditional fusion methods for infrared and visible images with weak gray correlation. The source images are decomposed into multi-scale and multi-directional sub-bands using NSCT, which can separate the feature information contained in different frequency domains to obtain a low-frequency approximate image and the high-frequency directional sub-band images. The local window weighted average energy and sum-modified-Laplacian energy are regarded as the activity measures of low frequency approximate image, respectively, which are used to construct a salient feature map to solve the two key problems of energy preservation and detail extraction. In the directional sub-band image, the maximun activity measure rule is used to obtain the decision maps, the source images are taken as the guided images, and the decision maps are used as the input images for guided filtering. The weight distribution graph is obtained to weight and average the directional sub-band images to reduce the noise sensitivity. Finally, the fused approximate and directional sub-band images are reconstructed by non-subsampled contourlet inverse transform, and the final fusion image is obtained. Some fusion experiments on several sets of infrared and visible images were did, and the objective performance assessments were implemented to fusion results. The experimental results indicate that the proposed method performs better in subjective and objective assessments than a few existing typical fusion techniques,such as guided filter fusion method based on two-scale decomposition, sparse representation fusion method in NSCT domain, cross bilateral filter fusion method based on pixel saliency, convolution neural network fusion method based on deep learning, two-scale fusion method based on saliency detection, and obtains better fusion performance.

Key words: non-subsampledcontourlettransform, guidedfilter, infraredimage, salientfeaturemap, shift-invariance

CLC Number: