To cope with the lack of input-output training samples, deep learning (DL) methods for pansharpening usually resort to Wald's protocol or other similar downscaling processes. By doing so, the scaled versions of the multispectral (MS) and panchromatic (PAN) components serve as input while the original MS plays as output during the training phase. As a side effect, the informational gap between reduced and full scales causes a mismatch between the training and test phases. In fact, DL methods typically provide a pretty good performance at reduced scale, with a good margin over traditional solutions that tends to vanish in the full-resolution framework. In this work, we propose a training framework that involves both the reduced and the full scale versions of the multiresolution image samples. This is achieved thanks to a suitably defined loss which comprises costs for both scales. Our numerical and visual experimental results confirm that the proposed approach provides an improved performance in the full-resolution case.

A Cross-Scale Loss for CNN-Based Pansharpening / Vitale, S.; Scarpa, G.. - (2020), pp. 645-648. (Intervento presentato al convegno 2020 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2020 tenutosi a USA nel 2020) [10.1109/IGARSS39084.2020.9324219].

A Cross-Scale Loss for CNN-Based Pansharpening

Scarpa G.
2020

Abstract

To cope with the lack of input-output training samples, deep learning (DL) methods for pansharpening usually resort to Wald's protocol or other similar downscaling processes. By doing so, the scaled versions of the multispectral (MS) and panchromatic (PAN) components serve as input while the original MS plays as output during the training phase. As a side effect, the informational gap between reduced and full scales causes a mismatch between the training and test phases. In fact, DL methods typically provide a pretty good performance at reduced scale, with a good margin over traditional solutions that tends to vanish in the full-resolution framework. In this work, we propose a training framework that involves both the reduced and the full scale versions of the multiresolution image samples. This is achieved thanks to a suitably defined loss which comprises costs for both scales. Our numerical and visual experimental results confirm that the proposed approach provides an improved performance in the full-resolution case.
2020
978-1-7281-6374-1
A Cross-Scale Loss for CNN-Based Pansharpening / Vitale, S.; Scarpa, G.. - (2020), pp. 645-648. (Intervento presentato al convegno 2020 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2020 tenutosi a USA nel 2020) [10.1109/IGARSS39084.2020.9324219].
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11588/875506
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 2
social impact