Fusion Method for Visible and Infrared Images Based on Non-subsampled Contourlet Transform and Sparse Representation

doi:10.3969/j.issn.1000-1093.2013.07.003

Abstract

Abstract: An image fusion method based on NSCT and spare representation is presented for the lowersparseness of low-frequency sub-band coefficients unfavorable to fusion. Firstly, the infrared and visibleimages are transformed by NSCT, the common and innovation coefficients are extracted from the sparsecoefficients of low-frequency sub-band, and the sparse coefficients are adaptively weighted by the specificcoefficients. Secondly, the high-frequency sub-band coefficients with higher sparseness are fused by usinga method which takes the sum of absolute values of its coefficients be maximal at the same scale. Finally,the fusion image is reconstructed by the inverse NSCT. The method has better fusion performance than thetraditional fusion method based on DWT, NSCT, and the SOMP, JSR fusion method based on sparse representation.

Key words: information processing, image fusion, non-subsampled Contourlet transform, sparse representation, infrared image, visible image

CLC Number:

TP391

WANG Jun, PENG Jin-ye, HE Gui-qing, FENG Xiao-yi, YAN Kun. Fusion Method for Visible and Infrared Images Based on Non-subsampled Contourlet Transform and Sparse Representation[J]. Acta Armamentarii, 2013, 34(7): 815-820.

References

[1] Mahyari A G, Yazdi M. Panchromatic and multispectral image fusion based on maximization of both spectral and spatial similarities[J]. IEEE Transactions on Geoscience and Remote Sensing,2011, 49(6): 1-10.

[2] 赵诚, 付梦印, 王立平. 基于粒子群优化的多分辨率图像融合[J]. 兵工学报, 2010,31(2):171-176.

ZHAO Cheng, FU Meng-yin, WANG Li-ping. Multi-resolution image fusion using particle swarm optimization[J]. Acta Armamentarii, 2010,31(2):171- 176. (in Chinese)

[3] Do M N, Vetterli M. The coutourlet transform: an efficient directional multiresolution image representation[J]. IEEE Transactions on Image Processing, 2005, 14(12): 2091- 2106.

[4] 常霞,焦李成,贾建华. 基于非下采样Contourlet 的多传感器图像自适应融合[J]. 计算机学报,2009,32(11):2229-2237.

CHANG Xia, JIAO Li-cheng, JIA Jian-hua, Multisensor image adaptive fusion based on nonsubsampled contourlet[ J]. Chinese Journal of Computers, 2009,32 (11):2229-2237. (in Chinese)

[5] Yang B, Li S T, Pixel-level image fusion with simultaneous orthogonal matching pursuit[J]. Information Fusion, 2012, 1(13):10-19.

[6] Yu N N, Qiu T S, Bi F. Image features extraction and fusion based on joint sparse representation[J]. IEEE Journal of Selected Topics in Signal Processing, 2011, 5(5):1074-1082.

[7] Cunha A L, Zhou J, Do M N. The nonsubsampled contourlet transform: theory, design, and applications[J]. IEEE Transactions on Image Processing, 2006,15(10): 3089-3101.

[8] Aharon M, Elad M, Bruckstein A. K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation [ J].IEEE Transactions on Signal Processing, 2006, 54(11): 4311-4322.

[9] Ophir B, Lustig M, Elad M. Multi-scale dictionary learning using wavelets[J]. IEEE Journal of Selected Topics in Signal Processing, 2011,5(5):1014-1024.

[10] Duarte M F, Sarvotham S, Baron D, et al. Distributed compressed sensing of jointly sparse signals[C]//Computer Society.Conference Record of The Thirty-Ninth Asilomar Conference on Signals, Systems and Computers. US: Institute of Electrical and Electronics Engineers Computer Society, 2005: 1537-1541.

[11] Piella G, Heijmans H, A new quality metric for image fusion[C]

//Proceedings of IEEE International Conference on Image Processing. Barcelona:IEEE,2003:173-176.

[12] Petrovic V. Subjective tests for image fusion evaluation and objective metric validation[J]. Information Fusion, 2007, 8(2):208-216.

[13] Xydeas C S, Petrovic V. Objective image fusion performance measure[J]. Electronics Letters, 2003, 6(4): 308-309.

[1]	WANG Zhong-mei, YANG Xiao-mei , GU Xing-fa. Small Target Detection in a Single Infrared Image Based on RPCA [J]. Acta Armamentarii, 2016, 37(9): 1753-1760.
[2]	LIU Yong-qing， JIANG Shuo， YU Dong， SHAO Xiao-tian. Effect of Narrowband Interference Suppression on Pseudorandom Code Zero Value [J]. Acta Armamentarii, 2016, 37(2): 293-298.
[3]	GUAN Si-hai， LI Zhi, HUANG Hui, WANG Zhe. Modified Zero-Attracting l₀-NLMS Algorithm [J]. Acta Armamentarii, 2016, 37(11): 2170-2176.
[4]	JIAO Chuan-hai, LI Yong-cheng, XIE Kai, YANG Yun-fu. Wideband Compressed Blind Sensing without Reconstruction Based on Expectation Deviation and Generalized Likelihood RatioTest [J]. Acta Armamentarii, 2016, 37(10): 1837-1843.
[5]	GUO Ye-cai, WU Hua-peng, WANG Hui, ZHANG Miao-qing. DNA Genetic Bat Algorithm Based Fractionally Spaced Multi-modulus Algorithm [J]. Acta Armamentarii, 2015, 36(8): 1502-1507.
[6]	LI Cheng， LI Jian-xun， TONG Zhong-xiang， JIA Lin-tong， ZHANG Zhi-bo. Research on Partial Image Recognition and Tracking in Infrared Imaging Terminal Guidance [J]. Acta Armamentarii, 2015, 36(7): 1213-1221.
[7]	ZHU Ming-qiang， HOU Jian-jun, LIU Ying ， LI Xu, TIAN Hong-juan. An Time Delay Difference Estimation Algorithm Based on Improved Unscented Particle Filter Suitable for Target Tracking inWireless Sensor Network [J]. Acta Armamentarii, 2015, 36(7): 1266-1272.
[8]	LI Zheng-zhou, HOU Qian, DAI Zhen, FU Hong-xia, GE Feng-zeng, JIN Gang. Dim Moving Target Detection Algorithm Based on Spatial-temporal Sparse Representation [J]. Acta Armamentarii, 2015, 36(7): 1273-1279.
[9]	GUO Ye-cai， ZHANG Miao-qing. A Multi-modulus Blind Equalization Algorithm Based on Shuffled Frog Leaping Algorithm [J]. Acta Armamentarii, 2015, 36(7): 1280-1287.
[10]	LIU Kun, MA Wen-ping, LIU Hong-ying. Speckle Suppression of Polarimetric Synthetic Aperture Radar Images Based on Sublook Data Correlation [J]. Acta Armamentarii, 2015, 36(7): 1288-1294.
[11]	ZHU Xia, CHEN Ren-wen, XIA Hua-kang, ZHANG Piao-yan. A Novel Image Registration Based on Cultural Particle Swarm Optimization Algorithm [J]. Acta Armamentarii, 2015, 36(6): 1033-1039.
[12]	DENG Bing, LUAN Jun-bao. Study of Reconnaissance Reception Algorithm of Wide-band Channelization in the Fractional Fourier Domain [J]. Acta Armamentarii, 2015, 36(6): 1040-1045.
[13]	WU Yi-quan， SONG Yu. Background Suppression of Small Infrared Target Image Based on Nonsubsampled Complex Contourlet Transform and GaussianWavelet Support Vector Regression [J]. Acta Armamentarii, 2015, 36(4): 687-695.
[14]	ZHANG Liang-jun, YANG Jie, LU Kai-wang, SUN Ya-dong. Underdetermined Blind Source Separation Based on Time-frequency Method Using Cyclostationary Characteristic [J]. Acta Armamentarii, 2015, 36(4): 703-709.
[15]	JIANG Run-xiang， LIN Chun-sheng， GONG Shen-guang. Electrostatic Electric Field Inversion Method for Ship Based on Point Charge Source Model [J]. Acta Armamentarii, 2015, 36(3): 545-551.