Single-image super-resolution of sentinel-2 low resolution bands with residual dense convolutional neural networks

Sentinel-2 satellites have become one of the main resources for Earth observation images because they are free of charge, have a great spatial coverage and high temporal revisit. Sentinel-2 senses the same location providing different spatial resolutions as well as generating a multi-spectral image...

Descripción completa

Detalles Bibliográficos
Autores: Salgueiro Romero, Luis Fernando|||0000-0003-4048-8330, Marcello Ruiz, Javier, Vilaplana Besler, Verónica|||0000-0001-6924-9961
Tipo de recurso: artículo
Fecha de publicación:2021
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/362543
Acceso en línea:https://hdl.handle.net/2117/362543
https://dx.doi.org/10.3390/rs13245007
Access Level:acceso abierto
Palabra clave:Artificial satellites in earth sciences
Deep learning
Image analysis
Sentinel-2
Super-resolution
Convolutional neural network
Satèl·lits artificials en ciències de la terra
Aprenentatge profund
Imatges -- Anàlisi
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
Descripción
Sumario:Sentinel-2 satellites have become one of the main resources for Earth observation images because they are free of charge, have a great spatial coverage and high temporal revisit. Sentinel-2 senses the same location providing different spatial resolutions as well as generating a multi-spectral image with 13 bands of 10, 20, and 60 m/pixel. In this work, we propose a single-image super-resolution model based on convolutional neural networks that enhances the low-resolution bands (20 m and 60 m) to reach the maximal resolution sensed (10 m) at the same time, whereas other approaches provide two independent models for each group of LR bands. Our proposed model, named Sen2-RDSR, is made up of Residual in Residual blocks that produce two final outputs at maximal resolution, one for 20 m/pixel bands and the other for 60 m/pixel bands. The training is done in two stages, first focusing on 20 m bands and then on the 60 m bands. Experimental results using six quality metrics (RMSE, SRE, SAM, PSNR, SSIM, ERGAS) show that our model has superior performance compared to other state-of-the-art approaches, and it is very effective and suitable as a preliminary step for land and coastal applications, as studies involving pixel-based classification for Land-Use-Land-Cover or the generation of vegetation indices.