Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation
The CoAtNet deep neural model has been shown to achieve state-of-the-art performance by stacking convolutional and self-attention layers. In particular, the initial layers of CoAtNet apply efficient convolutions for extracting local features out of the input image and the initial fine-resolution fea...
| Autores: | , , |
|---|---|
| Tipo de recurso: | artículo |
| Fecha de publicación: | 2024 |
| País: | España |
| Institución: | Universidad Autónoma de Madrid |
| Repositorio: | Biblos-e Archivo. Repositorio Institucional de la UAM |
| Idioma: | inglés |
| OAI Identifier: | oai:repositorio.uam.es:10486/714696 |
| Acceso en línea: | http://hdl.handle.net/10486/714696 https://dx.doi.org/10.1007/s00521-024-09963-w |
| Access Level: | acceso abierto |
| Palabra clave: | Breast cancer CoAtNet Deep neural networks Transformers Ultrasound image segmentation Telecomunicaciones |
| id |
ES_744c8f034c2e81ed2826e640b88a8ac3 |
|---|---|
| oai_identifier_str |
oai:repositorio.uam.es:10486/714696 |
| network_acronym_str |
ES |
| network_name_str |
España |
| repository_id_str |
|
| spelling |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentationZaidkilani, NadeemGarcía García, Miguel ÁngelPuig, DomenecBreast cancerCoAtNetDeep neural networksTransformersUltrasound image segmentationTelecomunicacionesThe CoAtNet deep neural model has been shown to achieve state-of-the-art performance by stacking convolutional and self-attention layers. In particular, the initial layers of CoAtNet apply efficient convolutions for extracting local features out of the input image and the initial fine-resolution feature maps. In turn, the final layers apply more cumbersome Transformers in order to extract global features from the coarse-resolution feature maps. The model’s outcome directly depends on those final global features. This paper proposes an extension of the original CoAtNet model based on the introduction of a dual stream of convolution and self-attention blocks applied at the final layers of CoAtNet. In this way, those final layers automatically aggregate both local and global features extracted from the initial feature maps. Two dual-stream topologies have been proposed and evaluated. This Dual-Stream CoAtNet model exhibits a significant improvement on the segmentation accuracy of breast ultrasound images, thus contributing to the development of more robust tumor detection methodsThe Spanish Government partly supported this research through Project TED2021-130081B-C21, and Project PDC2022-133383-I00SpringerDepartamento de Tecnología Electrónica y de las ComunicacionesEscuela Politécnica Superior20242024-05-27research articlehttp://purl.org/coar/resource_type/c_2df8fbb1AMhttp://purl.org/coar/version/c_ab4af688f83e57aainfo:eu-repo/semantics/articleapplication/pdfhttp://hdl.handle.net/10486/714696https://dx.doi.org/10.1007/s00521-024-09963-wreponame:Biblos-e Archivo. Repositorio Institucional de la UAMinstname:Universidad Autónoma de MadridInglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:repositorio.uam.es:10486/7146962026-06-23T12:46:27Z |
| dc.title.none.fl_str_mv |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation |
| title |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation |
| spellingShingle |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation Zaidkilani, Nadeem Breast cancer CoAtNet Deep neural networks Transformers Ultrasound image segmentation Telecomunicaciones |
| title_short |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation |
| title_full |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation |
| title_fullStr |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation |
| title_full_unstemmed |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation |
| title_sort |
Dual-Stream CoAtNet models for accurate breast ultrasound image segmentation |
| dc.creator.none.fl_str_mv |
Zaidkilani, Nadeem García García, Miguel Ángel Puig, Domenec |
| author |
Zaidkilani, Nadeem |
| author_facet |
Zaidkilani, Nadeem García García, Miguel Ángel Puig, Domenec |
| author_role |
author |
| author2 |
García García, Miguel Ángel Puig, Domenec |
| author2_role |
author author |
| dc.contributor.none.fl_str_mv |
Departamento de Tecnología Electrónica y de las Comunicaciones Escuela Politécnica Superior |
| dc.subject.none.fl_str_mv |
Breast cancer CoAtNet Deep neural networks Transformers Ultrasound image segmentation Telecomunicaciones |
| topic |
Breast cancer CoAtNet Deep neural networks Transformers Ultrasound image segmentation Telecomunicaciones |
| description |
The CoAtNet deep neural model has been shown to achieve state-of-the-art performance by stacking convolutional and self-attention layers. In particular, the initial layers of CoAtNet apply efficient convolutions for extracting local features out of the input image and the initial fine-resolution feature maps. In turn, the final layers apply more cumbersome Transformers in order to extract global features from the coarse-resolution feature maps. The model’s outcome directly depends on those final global features. This paper proposes an extension of the original CoAtNet model based on the introduction of a dual stream of convolution and self-attention blocks applied at the final layers of CoAtNet. In this way, those final layers automatically aggregate both local and global features extracted from the initial feature maps. Two dual-stream topologies have been proposed and evaluated. This Dual-Stream CoAtNet model exhibits a significant improvement on the segmentation accuracy of breast ultrasound images, thus contributing to the development of more robust tumor detection methods |
| publishDate |
2024 |
| dc.date.none.fl_str_mv |
2024 2024-05-27 |
| dc.type.none.fl_str_mv |
research article http://purl.org/coar/resource_type/c_2df8fbb1 AM http://purl.org/coar/version/c_ab4af688f83e57aa |
| dc.type.openaire.fl_str_mv |
info:eu-repo/semantics/article |
| format |
article |
| dc.identifier.none.fl_str_mv |
http://hdl.handle.net/10486/714696 https://dx.doi.org/10.1007/s00521-024-09963-w |
| url |
http://hdl.handle.net/10486/714696 https://dx.doi.org/10.1007/s00521-024-09963-w |
| dc.language.none.fl_str_mv |
Inglés eng |
| language_invalid_str_mv |
Inglés |
| language |
eng |
| dc.rights.none.fl_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| dc.rights.openaire.fl_str_mv |
info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.publisher.none.fl_str_mv |
Springer |
| publisher.none.fl_str_mv |
Springer |
| dc.source.none.fl_str_mv |
reponame:Biblos-e Archivo. Repositorio Institucional de la UAM instname:Universidad Autónoma de Madrid |
| instname_str |
Universidad Autónoma de Madrid |
| reponame_str |
Biblos-e Archivo. Repositorio Institucional de la UAM |
| collection |
Biblos-e Archivo. Repositorio Institucional de la UAM |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1869410885338923008 |
| score |
15,811543 |