Two studies on Convolutional Neural Networks sensibility to resolution

Convolutional Neural Networks (CNNs) recently became the state-of-the-art for various Computer Vision tasks. However, for reasons not completely understood, they are very sensitive to low resolution images. This can be troublesome as real life applications such as automated driving or surveillance c...

Descripción completa

Detalles Bibliográficos
Autor: Abello, Antonio Augusto
Tipo de recurso: tesis de maestría
Estado:Versión publicada
Fecha de publicación:2021
País:Brasil
Institución:Universidade de São Paulo (USP)
Repositorio:Biblioteca Digital de Teses e Dissertações da USP
Idioma:inglés
OAI Identifier:oai:teses.usp.br:tde-16122021-182010
Acceso en línea:https://www.teses.usp.br/teses/disponiveis/45/45134/tde-16122021-182010/
Access Level:acceso abierto
Palabra clave:Deep learning
Face recognition
Reconhecimento facial
Super resolution
Super-resolução
Descripción
Sumario:Convolutional Neural Networks (CNNs) recently became the state-of-the-art for various Computer Vision tasks. However, for reasons not completely understood, they are very sensitive to low resolution images. This can be troublesome as real life applications such as automated driving or surveillance can not use high resolution sensors. In this work we perform two studies on this subject matter: on the first we empirically study the effect of resolution loss and image restoration algorithms on a Face Recognition model. On the second, we study the high frequency bias hypothesis, one of the current possible explanations for CNNs sensitivity. We are able to develop new techniques for image restoration that better deal with the low resolution recognition problem and advance the understanding of the high frequency bias in CNNs.