Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks
Deep leaning and the use of Convolutional Neural Networks is following an upward trend in popularity in the recent years. As a lot of the research in this area is done empirically and based on experiments against a collection of datasets, research has been pushed to use techniques that alter the tra...
| Autor: | |
|---|---|
| Tipo de recurso: | tesis de maestría |
| Fecha de publicación: | 2022 |
| País: | España |
| Institución: | Universitat Politècnica de Catalunya (UPC) |
| Repositorio: | UPCommons. Portal del coneixement obert de la UPC |
| Idioma: | inglés |
| OAI Identifier: | oai:upcommons.upc.edu:2117/375197 |
| Acceso en línea: | https://hdl.handle.net/2117/375197 |
| Access Level: | acceso abierto |
| Palabra clave: | Deep learning Neural networks (Computer science) Kernel functions deep learning kernels convolutional neural networks padding border aware neurons contrast aware neurons Aprenentatge profund Xarxes neuronals (Informàtica) Kernel, Funcions de Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial |
| id |
ES_51f89da7bdf64fbee31e2b68ef02cf61 |
|---|---|
| oai_identifier_str |
oai:upcommons.upc.edu:2117/375197 |
| network_acronym_str |
ES |
| network_name_str |
España |
| repository_id_str |
|
| spelling |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural NetworksBadenas Crespo, VíctorDeep learningNeural networks (Computer science)Kernel functionsdeep learningkernelsconvolutional neural networkspaddingborder aware neuronscontrast aware neuronsAprenentatge profundXarxes neuronals (Informàtica)Kernel, Funcions deÀrees temàtiques de la UPC::Informàtica::Intel·ligència artificialDeep leaning and the use of Convolutional Neural Networks is following an upward trend in popularity in the recent years. As a lot of the research in this area is done empirically and based on experiments against a collection of datasets, research has been pushed to use techniques that alter the training behavior whose side effects have not been fully explored. In this thesis we aim to explore the effects of padding when used to allow convolution operations inside a neural network to be computed exhaustively though padding (artificial values added to complete a given shape) on the edges of the image. Previous research has been done studying the effects of padding for batching images as well as the effects of padding in the type of neurons generated in the network. This thesis aims to follow up on the second, where the concept of border aware neurons (BAN) was proposed. We will propose a method of detecting contrast aware neurons (CAN) and BAN in CNNs. We will also explore the effects of padding in the existence of CAN in the convolutional layers of a CNN by using the first proposed methods in a collection of models trained on Caltech101. Finally we will explore the existence of BAN as a subset of CAN and study the effects of padding in their appearance by clustering the sets of CAN found in the previous experiments. We found that CAN neurons can appear in a network with or without adding padding to the convolution but they have dissimilar characteristics. When padding is added, the contrast changes of the patterns is much greater. We also found that the existence of padding is the cause of BAN to appear in the network. These findings open new doors to future work: model pruning removing BAN neurons and study its implications, and optimization in the training methodology.Universitat Politècnica de CatalunyaGarcia Gasulla, DarioParés Pont, Ferran20222022-06-3020222022-10-27master thesishttp://purl.org/coar/resource_type/c_bdccNAhttp://purl.org/coar/version/c_be7fb7dd8ff6fe43info:eu-repo/semantics/masterThesisapplication/pdfhttps://hdl.handle.net/2117/375197reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/3751972026-05-27T15:37:01Z |
| dc.title.none.fl_str_mv |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks |
| title |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks |
| spellingShingle |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks Badenas Crespo, Víctor Deep learning Neural networks (Computer science) Kernel functions deep learning kernels convolutional neural networks padding border aware neurons contrast aware neurons Aprenentatge profund Xarxes neuronals (Informàtica) Kernel, Funcions de Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial |
| title_short |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks |
| title_full |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks |
| title_fullStr |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks |
| title_full_unstemmed |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks |
| title_sort |
Detection and location of contrast-aware and border-aware neurons in Convolutional Neural Networks |
| dc.creator.none.fl_str_mv |
Badenas Crespo, Víctor |
| author |
Badenas Crespo, Víctor |
| author_facet |
Badenas Crespo, Víctor |
| author_role |
author |
| dc.contributor.none.fl_str_mv |
Garcia Gasulla, Dario Parés Pont, Ferran |
| dc.subject.none.fl_str_mv |
Deep learning Neural networks (Computer science) Kernel functions deep learning kernels convolutional neural networks padding border aware neurons contrast aware neurons Aprenentatge profund Xarxes neuronals (Informàtica) Kernel, Funcions de Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial |
| topic |
Deep learning Neural networks (Computer science) Kernel functions deep learning kernels convolutional neural networks padding border aware neurons contrast aware neurons Aprenentatge profund Xarxes neuronals (Informàtica) Kernel, Funcions de Àrees temàtiques de la UPC::Informàtica::Intel·ligència artificial |
| description |
Deep leaning and the use of Convolutional Neural Networks is following an upward trend in popularity in the recent years. As a lot of the research in this area is done empirically and based on experiments against a collection of datasets, research has been pushed to use techniques that alter the training behavior whose side effects have not been fully explored. In this thesis we aim to explore the effects of padding when used to allow convolution operations inside a neural network to be computed exhaustively though padding (artificial values added to complete a given shape) on the edges of the image. Previous research has been done studying the effects of padding for batching images as well as the effects of padding in the type of neurons generated in the network. This thesis aims to follow up on the second, where the concept of border aware neurons (BAN) was proposed. We will propose a method of detecting contrast aware neurons (CAN) and BAN in CNNs. We will also explore the effects of padding in the existence of CAN in the convolutional layers of a CNN by using the first proposed methods in a collection of models trained on Caltech101. Finally we will explore the existence of BAN as a subset of CAN and study the effects of padding in their appearance by clustering the sets of CAN found in the previous experiments. We found that CAN neurons can appear in a network with or without adding padding to the convolution but they have dissimilar characteristics. When padding is added, the contrast changes of the patterns is much greater. We also found that the existence of padding is the cause of BAN to appear in the network. These findings open new doors to future work: model pruning removing BAN neurons and study its implications, and optimization in the training methodology. |
| publishDate |
2022 |
| dc.date.none.fl_str_mv |
2022 2022-06-30 2022 2022-10-27 |
| dc.type.none.fl_str_mv |
master thesis http://purl.org/coar/resource_type/c_bdcc NA http://purl.org/coar/version/c_be7fb7dd8ff6fe43 |
| dc.type.openaire.fl_str_mv |
info:eu-repo/semantics/masterThesis |
| format |
masterThesis |
| dc.identifier.none.fl_str_mv |
https://hdl.handle.net/2117/375197 |
| url |
https://hdl.handle.net/2117/375197 |
| dc.language.none.fl_str_mv |
Inglés eng |
| language_invalid_str_mv |
Inglés |
| language |
eng |
| dc.rights.none.fl_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| dc.rights.openaire.fl_str_mv |
info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
open access http://purl.org/coar/access_right/c_abf2 |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.publisher.none.fl_str_mv |
Universitat Politècnica de Catalunya |
| publisher.none.fl_str_mv |
Universitat Politècnica de Catalunya |
| dc.source.none.fl_str_mv |
reponame:UPCommons. Portal del coneixement obert de la UPC instname:Universitat Politècnica de Catalunya (UPC) |
| instname_str |
Universitat Politècnica de Catalunya (UPC) |
| reponame_str |
UPCommons. Portal del coneixement obert de la UPC |
| collection |
UPCommons. Portal del coneixement obert de la UPC |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1869408000906625024 |
| score |
15,300719 |