Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks

[EN] Neural networks have become the standard for high accuracy computer vision. These algorithms can be built with arbitrarily large architectures to handle an ever growing complexity in the data they process. State of the art neural network architectures are primarily concerned with increasing the...

ver descrição completa

Detalhes bibliográficos
Autor: Raveane, William
Formato: tesis doctoral
Fecha de publicación:2020
País:España
Recursos:Universidad de Salamanca (USAL)
Repositorio:GREDOS. Repositorio Institucional de la Universidad de Salamanca
OAI Identifier:oai:gredos.usal.es:10366/145412
Acesso em linha:http://hdl.handle.net/10366/145412
Access Level:acceso abierto
Palavra-chave:Tesis y disertaciones académicas
Universidad de Salamanca (España)
Tesis Doctoral
Academic dissertations
Deep Neural Networks
Mobile and Embedded Devices
Efficient Object Detection
Computer Vision
1203.17 Informática
id ES_5f6c3649be56eba4e36e2fed6fe3edb9
oai_identifier_str oai:gredos.usal.es:10366/145412
network_acronym_str ES
network_name_str España
repository_id_str
spelling Efficient Object Detection in Mobile and Embedded Devices with Deep Neural NetworksRaveane, WilliamTesis y disertaciones académicasUniversidad de Salamanca (España)Tesis DoctoralAcademic dissertationsDeep Neural NetworksMobile and Embedded DevicesEfficient Object DetectionComputer Vision1203.17 Informática[EN] Neural networks have become the standard for high accuracy computer vision. These algorithms can be built with arbitrarily large architectures to handle an ever growing complexity in the data they process. State of the art neural network architectures are primarily concerned with increasing the recognition accuracy when performing inference on an image, which creates an insatiable demand for energy and compute power. These models are primarily targeted to run on dense compute units such as GPUs. In recent years, demand to allow these models to execute in limited capacity environments such as smartphones, however even the most compact variations of these state of the art networks constantly push the boundaries of the power envelop under which they run. With the emergence of the Internet of Things, it is becoming a priority to enable mobile systems to perform image recognition at the edge, but with small energy requirements. This thesis focuses on the design and implementation of an object detection neural network that attempts to solve this problem, providing reasonable accuracy rates with extremely low compute power requirements. This is achieved by re-imagining the meta architecture of traditional object detection models and discovering a mechanism to classify and localize objects through a set of neural network based algorithms that are better aimed to mobile and embedded devices. The main contributions of this thesis are: (i) provide a better image processing algorithm that is more suitable at preparing data for consumption by taking advantage of the characteristics of the ISP available in these devices; (ii) provide a neural network architecture that maintains acceptable accuracy targets with minimal computational requirements by making efficient use of basic neural algorithms; and (iii) provide a programming framework for how these systems can be most efficiently implemented in a manner that is optimized for the underlying hardware units available in these devices by taking into account memory and computation restrictions.González Arrieta, María Angélica202120212020info:eu-repo/semantics/doctoralThesishttp://hdl.handle.net/10366/145412reponame:GREDOS. Repositorio Institucional de la Universidad de Salamancainstname:Universidad de Salamanca (USAL)InglésAttribution-NonCommercial-NoDerivatives 4.0 Internacionalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccessoai:gredos.usal.es:10366/1454122026-06-07T06:28:51Z
dc.title.none.fl_str_mv Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
title Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
spellingShingle Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
Raveane, William
Tesis y disertaciones académicas
Universidad de Salamanca (España)
Tesis Doctoral
Academic dissertations
Deep Neural Networks
Mobile and Embedded Devices
Efficient Object Detection
Computer Vision
1203.17 Informática
title_short Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
title_full Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
title_fullStr Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
title_full_unstemmed Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
title_sort Efficient Object Detection in Mobile and Embedded Devices with Deep Neural Networks
dc.creator.none.fl_str_mv Raveane, William
author Raveane, William
author_facet Raveane, William
author_role author
dc.contributor.none.fl_str_mv González Arrieta, María Angélica
dc.subject.none.fl_str_mv Tesis y disertaciones académicas
Universidad de Salamanca (España)
Tesis Doctoral
Academic dissertations
Deep Neural Networks
Mobile and Embedded Devices
Efficient Object Detection
Computer Vision
1203.17 Informática
topic Tesis y disertaciones académicas
Universidad de Salamanca (España)
Tesis Doctoral
Academic dissertations
Deep Neural Networks
Mobile and Embedded Devices
Efficient Object Detection
Computer Vision
1203.17 Informática
description [EN] Neural networks have become the standard for high accuracy computer vision. These algorithms can be built with arbitrarily large architectures to handle an ever growing complexity in the data they process. State of the art neural network architectures are primarily concerned with increasing the recognition accuracy when performing inference on an image, which creates an insatiable demand for energy and compute power. These models are primarily targeted to run on dense compute units such as GPUs. In recent years, demand to allow these models to execute in limited capacity environments such as smartphones, however even the most compact variations of these state of the art networks constantly push the boundaries of the power envelop under which they run. With the emergence of the Internet of Things, it is becoming a priority to enable mobile systems to perform image recognition at the edge, but with small energy requirements. This thesis focuses on the design and implementation of an object detection neural network that attempts to solve this problem, providing reasonable accuracy rates with extremely low compute power requirements. This is achieved by re-imagining the meta architecture of traditional object detection models and discovering a mechanism to classify and localize objects through a set of neural network based algorithms that are better aimed to mobile and embedded devices. The main contributions of this thesis are: (i) provide a better image processing algorithm that is more suitable at preparing data for consumption by taking advantage of the characteristics of the ISP available in these devices; (ii) provide a neural network architecture that maintains acceptable accuracy targets with minimal computational requirements by making efficient use of basic neural algorithms; and (iii) provide a programming framework for how these systems can be most efficiently implemented in a manner that is optimized for the underlying hardware units available in these devices by taking into account memory and computation restrictions.
publishDate 2020
dc.date.none.fl_str_mv 2020
2021
2021
dc.type.none.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
dc.identifier.none.fl_str_mv http://hdl.handle.net/10366/145412
url http://hdl.handle.net/10366/145412
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 Internacional
http://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 Internacional
http://creativecommons.org/licenses/by-nc-nd/4.0/
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:GREDOS. Repositorio Institucional de la Universidad de Salamanca
instname:Universidad de Salamanca (USAL)
instname_str Universidad de Salamanca (USAL)
reponame_str GREDOS. Repositorio Institucional de la Universidad de Salamanca
collection GREDOS. Repositorio Institucional de la Universidad de Salamanca
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869409205081866240
score 15,300724