Three-Blind Validation Strategy of Deep Learning Models for Image Segmentation

[EN] Image segmentation plays a central role in computer vision applications such as medical imaging, industrial inspection, and environmental monitoring. However, evaluating segmentation performance can be particularly challenging when ground truth is not clearly defined, as is often the case in ta...

Descripción completa

Detalles Bibliográficos
Autores: Larroza, Andrés, Tendero, Raquel, Román, Marta, Perez-Benito, Francisco Javier|||0000-0002-6290-5644, Perez-Cortes, Juan-Carlos|||0000-0001-6506-090X, Llobet Azpitarte, Rafael|||0000-0002-8278-9740
Tipo de recurso: artículo
Fecha de publicación:2026
País:España
Institución:Universitat Politècnica de València (UPV)
Repositorio:RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Idioma:inglés
OAI Identifier:oai:dnet:riunet______::18950b54989a51535d34682781e78d91
Acceso en línea:https://riunet.upv.es/handle/10251/234715
Access Level:acceso abierto
Palabra clave:Deep learning
Image segmentation
Mammography
Descripción
Sumario:[EN] Image segmentation plays a central role in computer vision applications such as medical imaging, industrial inspection, and environmental monitoring. However, evaluating segmentation performance can be particularly challenging when ground truth is not clearly defined, as is often the case in tasks involving subjective interpretation. These challenges are amplified by inter- and intra-observer variability, which complicates the use of human annotations as a reliable reference. To address this, we propose a novel validation framework¿referred to as the three-blind validation strategy¿that enables rigorous assessment of segmentation models in contexts where subjectivity and label variability are significant. The core idea is to have a third independent expert, blind to the labeler identities, assess a shuffled set of segmentations produced by multiple human annotators and/or automated models. This allows for the unbiased evaluation of model performance and helps uncover patterns of disagreement that may indicate systematic issues with either human or machine annotations. The primary objective of this study is to introduce and demonstrate this validation strategy as a generalizable framework for robust model evaluation in subjective segmentation tasks. We illustrate its practical implementation in a mammography use case involving dense tissue segmentation while emphasizing its potential applicability to a broad range of segmentation scenarios.