Abstract: A remote sensing image fusion method based on super-resolution reconstruction with convolutional neural network (CNN) is proposed to make full use of spatial information of multispectral image and obtain better fusion quality. Firstly,the mulispectral image is transformed with IHS transform,the gotten I component is reconstructed by Super-Resolution Convolutional Neural Network(SRCNN), which enhances the spatial information while expanding its size. Then the panchromatic image and the reconstructed I component of mulispectral image are fused with the fusion method based on wavelet transform,the fusion rule is the absolute value and the changed high frequency components of the fusion image are all derived from the panchromatic image in the traditional algorithms. Finally, the fused multispectral image is obtained via inverse IHS transform.The experiment results show that the algorithm outperforms other algorithms, and reduces the loss of spatial information and spectral information in the process of image fusion effectively.

Key words: remote sensing, image fusion, super-resolution reconstruction, convolutional neural network