Interactive multiple object learning with scanty human supervision

We present a fast and online human-robot interaction approach that progressively learns multiple object classifiers using scanty human supervision. Given an input video stream recorded during the human-robot interaction, the user just needs to annotate a small fraction of frames to compute object sp...

ver descrição completa

Detalhes bibliográficos
Autores: Villamizar, Michael, Garrell, Anaís, Sanfeliu, Alberto, Moreno-Noguer, Francesc
Tipo de documento: artigo
Estado:Versión enviada para evaluación y publicación
Data de publicação:2016
País:España
Recursos:Consejo Superior de Investigaciones Científicas (CSIC)
Repositório:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/166353
Acesso em linha:http://hdl.handle.net/10261/166353
Access Level:Acceso aberto
Palavra-chave:Human-robot interaction
Online classifier
Interactive learning
Object recognition
Descrição
Resumo:We present a fast and online human-robot interaction approach that progressively learns multiple object classifiers using scanty human supervision. Given an input video stream recorded during the human-robot interaction, the user just needs to annotate a small fraction of frames to compute object specific classifiers based on random ferns which share the same features. The resulting methodology is fast (in a few seconds, complex object appearances can be learned), versatile (it can be applied to unconstrained scenarios), scalable (real experiments show we can model up to 30 different object classes), and minimizes the amount of human intervention by leveraging the uncertainty measures associated to each classifier. We thoroughly validate the approach on synthetic data and on real sequences acquired with a mobile platform in indoor and outdoor scenarios containing a multitude of different objects. We show that with little human assistance, we are able to build object classifiers robust to viewpoint changes, partial occlusions, varying lighting and cluttered backgrounds.