TR2022-004

Fast and High-Quality Blind Multi-Spectral Image Pansharpening


Abstract:

Blind pansharpening addresses the problem of generating a high spatial-resolution multi-spectral (HRMS) image given a low spatial-resolution multi-spectral (LRMS) image with the guidance of its associated spatially misaligned high spatialresolution panchromatic (PAN) image without parametric side information. In this paper, we propose a fast approach to blind pansharpening and achieve state-of-the-art image reconstruction quality. Typical blind pansharpening algorithms are often computationally intensive since the blur kernel and the target
HRMS image are often computed using iterative solvers and in an alternating fashion. To achieve fast blind pansharpening, we decouple the solution of the blur kernel and of the HRMS image. First, we estimate the blur kernel by computing the kernel coefficients with minimum total generalized variation that blur a downsampled version of the PAN image to approximate a linear combination of the LRMS image channels. Then, we estimate each channel of the HRMS image using local Laplacian prior to regularize the relationship between each HRMS channel and the PAN image. Solving the HRMS image is accelerated by both parallerizing across the channels and by fast numerical algorithms for each channel. Due to the fast scheme and the powerful priors we used on the blur kernel coefficients (total generalized variation) and on the cross-channel relationship (local
Laplacian prior), numerical experiments demonstrate that our algorithm outperforms state-of-the-art model-based counterparts in terms of both computational time and reconstruction quality of the HRMS images.

 

  • Related Video

  • Related Publications

  •  Yu, L., Liu, D., Mansour, H., Boufounos, P.T., "Fast and High-Quality Blind Multi-Spectral Image Pansharpening", arXiv, March 2021.
    BibTeX arXiv
    • @article{Yu2021mar,
    • author = {Yu, Lantao and Liu, Dehong and Mansour, Hassan and Boufounos, Petros T.},
    • title = {Fast and High-Quality Blind Multi-Spectral Image Pansharpening},
    • journal = {arXiv},
    • year = 2021,
    • month = mar,
    • url = {https://arxiv.org/abs/2103.09943}
    • }
  •  Yu, L., Liu, D., Mansour, H., Boufounos, P.T., Ma, Y., "Blind Multi-Spectral Image Pan-Sharpening", IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), DOI: 10.1109/​ICASSP40776.2020.9053554, April 2020, pp. 1429-1433.
    BibTeX TR2020-047 PDF Video
    • @inproceedings{Yu2020apr,
    • author = {Yu, Lantao and Liu, Dehong and Mansour, Hassan and Boufounos, Petros T. and Ma, Yanting},
    • title = {Blind Multi-Spectral Image Pan-Sharpening},
    • booktitle = {IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
    • year = 2020,
    • pages = {1429--1433},
    • month = apr,
    • publisher = {IEEE},
    • doi = {10.1109/ICASSP40776.2020.9053554},
    • issn = {2379-190X},
    • isbn = {978-1-5090-6631-5},
    • url = {https://www.merl.com/publications/TR2020-047}
    • }