Single image super-resolution based on directional variance attention network

Recent advances in single image super-resolution (SISR) explore the power of deep convolutional neural networks (CNNs) to achieve better performance. However, most of the progress has been made by scaling CNN architectures, which usually raise computational demands and memory consumption. This makes...

Descripción completa

Detalles Bibliográficos
Autores: Behjati, Parichehr|||0000-0003-4266-545X, Rodríguez López, Pau|||0000-0002-1689-8084, Fernández Tena, Carles|||0000-0001-6185-3427, Hupont, Isabelle|||0000-0002-9811-9397, Mehri, Armin|||0000-0003-3472-2530, Gonzàlez, Jordi|||0000-0001-8033-0306
Tipo de recurso: artículo
Fecha de publicación:2023
País:España
Institución:Universitat Autònoma de Barcelona
Repositorio:Dipòsit Digital de Documents de la UAB
Idioma:inglés
OAI Identifier:oai:ddd.uab.cat:311821
Acceso en línea:https://ddd.uab.cat/record/311821
https://dx.doi.org/urn:doi:10.1016/j.patcog.2022.108997
Access Level:acceso abierto
Palabra clave:Attention mechanism
Efficient network
Single image super-resolution
Descripción
Sumario:Recent advances in single image super-resolution (SISR) explore the power of deep convolutional neural networks (CNNs) to achieve better performance. However, most of the progress has been made by scaling CNN architectures, which usually raise computational demands and memory consumption. This makes modern architectures less applicable in practice. In addition, most CNN-based SR methods do not fully utilize the informative hierarchical features that are helpful for final image recovery. In order to address these issues, we propose a directional variance attention network (DiVANet), a computationally efficient yet accurate network for SISR. Specifically, we introduce a novel directional variance attention (DiVA) mechanism to capture long-range spatial dependencies and exploit inter-channel dependencies simultaneously for more discriminative representations. Furthermore, we propose a residual attention feature group (RAFG) for parallelizing attention and residual block computation. The output of each residual block is linearly fused at the RAFG output to provide access to the whole feature hierarchy. In parallel, DiVA extracts most relevant features from the network for improving the final output and preventing information loss along the successive operations inside the network. Experimental results demonstrate the superiority of DiVANet over the state of the art in several datasets, while maintaining relatively low computation and memory footprint. The code is available at https://github.com/pbehjatii/DiVANet.