Bottom-up performance analysis of focal-plane mixed-signal hardware for Viola–Jones early vision tasks

Focal-plane mixed-signal arrays have traditionally been designed according to the general claim that moderate accuracy in processing is affordable. The performance of their circuitry has been analyzed in these terms without a comprehensive study of the ultimate consequences of such moderate accuracy...

Descripción completa

Detalles Bibliográficos
Autores: Fernández-Berni, J., Carmona-Galán, R., Río, Rocío del, Rodríguez-Vázquez, Ángel
Tipo de recurso: artículo
Estado:Versión aceptada para publicación
Fecha de publicación:2015
País:España
Institución:Consejo Superior de Investigaciones Científicas (CSIC)
Repositorio:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/121432
Acceso en línea:http://hdl.handle.net/10261/121432
Access Level:acceso abierto
Palabra clave:Viola–Jones framework
Focal-plane sensing-processing
Mixed-signal circuitry
Integral images
Haar-like features
OpenCV library
Descripción
Sumario:Focal-plane mixed-signal arrays have traditionally been designed according to the general claim that moderate accuracy in processing is affordable. The performance of their circuitry has been analyzed in these terms without a comprehensive study of the ultimate consequences of such moderate accuracy. In this paper, for the first time to the best of our knowledge, we do carry out this study. We move expectable performance of mixed-signal image processing hardware directly into the vision algorithm making use of it. This permits to close a wider design loop, enabling a more aggressive design of this kind of hardware provided that the algorithm, at the highest level—semantic interpretation of the scene—, can afford it. Thus, we present a thorough analysis of the non-idealities associated with the implementation of a QVGA array tailored for the distinctive characteristics of the Viola–Jones processing framework. The resulting deviation models are then introduced in the processing flow of this framework provided by the OpenCV library. We have found, contrary to what could be expected, that these deviations do not necessarily degrade the performance of the Viola–Jones algorithm. They could be even beneficial for certain high-level specifications. Additionally, we demonstrate the architectural advantages of our approach: exploitation of focal-plane distributed memory and ultra-low-power operation.