Shadow detection using a cross-attentional dual-decoder network with self-supervised image reconstruction features

Shadow detection is a challenging problem in computer vision due to the high variability in lighting conditions, object shapes, and scene layouts. Despite the positive results achieved by some existing technologies, the problem becomes particularly challenging with complex and heterogeneous images w...

ver descrição completa

Detalhes bibliográficos
Autores: Fernandez Beltran, Ruben, Guzmán Ponce, Angélica, Fernandez, Rafael, Kang, Jian, García Mateos, Ginés
Tipo de documento: artigo
Data de publicação:2024
País:España
Recursos:Universidad Católica San Antonio de Murcia (UCAM)
Repositório:RIUCAM. Repositorio Institucional de la Universidad Católica San Antonio de Murcia
OAI Identifier:oai:repositorio.ucam.edu:10952/10764
Acesso em linha:http://hdl.handle.net/10952/10764
Access Level:Acceso aberto
Palavra-chave:Shadow detection
Semantic segmentation
Convolutional neural networks
Cross-attention
Dual-decoder
Descrição
Resumo:Shadow detection is a challenging problem in computer vision due to the high variability in lighting conditions, object shapes, and scene layouts. Despite the positive results achieved by some existing technologies, the problem becomes particularly challenging with complex and heterogeneous images where shadow-casting objects coexist and shadows can have different depths, scales, and morphologies. As a result, more advanced and accurate solutions are still needed to deal with this type of complexities. To address these challenges, this paper proposes a novel deep learning model, called the Cross-Attentional Dual Decoder Network (CADDN), to improve shadow detection by using fine-grained image reconstruction features. Unlike other existing methods, the CADDN uses an innovative encoder-decoder architecture with two decoder segments that work together to reconstruct the input images and their corresponding shadow masks. In this way, the features used to reconstruct the original input image can be used to support the shadow detection process itself. The proposed model also incorporates a cross-attention mechanism to weight the most relevant features for detecting shadows and skip connections with noise to improve the quality of the transferred features. The experimental results, including several benchmark image datasets and state-of-the-art detection methods, demonstrate the suitability of the presented approach for detecting shadows in computer vision applications.