Performance assessment of deep learning frameworks through metrics of CPU hardware exploitation on an embedded platform

In this paper, we analyze heterogeneous performance exhibited by some popular deep learning software frameworks for visual inference on a resource-constrained hardware platform. Benchmarking of Caffe, OpenCV, TensorFlow, and Caffe2 is performed on the same set of convolutional neural networks in ter...

Descripción completa

Detalles Bibliográficos
Autores: Velasco-Montero, Delia, Fernández-Berni, J., Carmona-Galán, R., Rodríguez-Vázquez, Ángel
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2020
País:España
Institución:Consejo Superior de Investigaciones Científicas (CSIC)
Repositorio:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/220048
Acceso en línea:http://hdl.handle.net/10261/220048
Access Level:acceso abierto
Palabra clave:Convolutional neural networks
Deep learning
Edge inference
Embedded vision
Hardware performance
Software frameworks
Descripción
Sumario:In this paper, we analyze heterogeneous performance exhibited by some popular deep learning software frameworks for visual inference on a resource-constrained hardware platform. Benchmarking of Caffe, OpenCV, TensorFlow, and Caffe2 is performed on the same set of convolutional neural networks in terms of instantaneous throughput, power consumption, memory footprint, and CPU utilization. To understand the resulting dissimilar behavior, we thoroughly examine how the resources in the processor are differently exploited by these frameworks. We demonstrate that a strong correlation exists between hardware events occurring in the processor and inference performance. The proposedhardware-aware analysis aims to findlimitations andbottlenecks emerging from the jointinteraction offrameworks andnetworks on a particular CPU-based platform. This provides insight into introducing suitable modifications in bothtypes of components to enhance their global performance. It also facilitates the selection of frameworks and networks among a large diversity of these components available these days for visual understanding.