Dependent multiple cue integration for robust tracking
We propose a new technique for fusing multiple cues to robustly segment an object from its background in video sequences that suffer from abrupt changes of both illumination and position of the target. Robustness is achieved by the integration of appearance and geometric object features and by their...
| Autores: | , , |
|---|---|
| Tipo de recurso: | artículo |
| Estado: | Versión publicada |
| Fecha de publicación: | 2008 |
| País: | España |
| Institución: | Consejo Superior de Investigaciones Científicas (CSIC) |
| Repositorio: | DIGITAL.CSIC. Repositorio Institucional del CSIC |
| OAI Identifier: | oai:digital.csic.es:10261/30597 |
| Acceso en línea: | http://hdl.handle.net/10261/30597 |
| Access Level: | acceso abierto |
| Palabra clave: | Bayesian tracking Multiple cue integration Pattern recognition |
| id |
ES_488f7e7965e59226fb8f206085a8a2b6 |
|---|---|
| oai_identifier_str |
oai:digital.csic.es:10261/30597 |
| network_acronym_str |
ES |
| network_name_str |
España |
| repository_id_str |
|
| spelling |
Dependent multiple cue integration for robust trackingMoreno-Noguer, FrancescSanfeliu, AlbertoSanfeliu, AlbertoSamaras, DimitrisBayesian trackingMultiple cue integrationPattern recognitionWe propose a new technique for fusing multiple cues to robustly segment an object from its background in video sequences that suffer from abrupt changes of both illumination and position of the target. Robustness is achieved by the integration of appearance and geometric object features and by their estimation using Bayesian filters, such as Kalman or particle filters. In particular, each filter estimates the state of a specific object feature, conditionally dependent on another feature estimated by a distinct filter. This dependence provides improved target representations, permitting us to segment it out from the background even in nonstationary sequences. Considering that the procedure of the Bayesian filters may be described by a "hypotheses generation-hypotheses correction" strategy, the major novelty of our methodology compared to previous approaches is that the mutual dependence between filters is considered during the feature observation, that is, into the "hypotheses-correction" stage, instead of considering it when generating the hypotheses. This proves to be much more effective in terms of accuracy and reliability. The proposed method is analytically justified and applied to develop a robust tracking system that adapts online and simultaneously the color space where the image points are represented, the color distributions, the contour of the object, and its bounding box. Results with synthetic data and real video sequences demonstrate the robustness and versatility of our method.This work was supported by projects: 'Integration of robust perception, learning, and navigation systems in mobile robotics' (J-0929), 'Ubiquitous networking robotics in urban settings' (E-00938), 'CONSOLIDER-INGENIO 2010 Multimodal interaction in pattern recognition and computer vision' (V-00069). This research was conducted at the Institut de Robòtica i Informàtica Industrial of the Technical University of Catalonia and Consejo Superior de Investigaciones Científicas. It was partially supported by Consolider Ingenio 2010, project CSD2007-00018, CICYT project DPI2007-614452, and IST-045062 of the European Community Union, by a fellowship from the Spanish Ministry of Science and Technology, and by grants from the US Department of Justice (2004-DD-BX-1224), Department of Energy (MO-068), and US National Science Foundation (ACI-0313184 and IIS-0527585).Peer ReviewedInstitute of Electrical and Electronics Engineers201020102008info:eu-repo/semantics/articlehttp://purl.org/coar/resource_type/c_6501Publisher's versioninfo:eu-repo/semantics/publishedVersionhttp://hdl.handle.net/10261/30597reponame:DIGITAL.CSIC. Repositorio Institucional del CSICinstname:Consejo Superior de Investigaciones Científicas (CSIC)Ingléshttp://dx.doi.org/10.1109/TPAMI.2007.70727info:eu-repo/semantics/openAccessoai:digital.csic.es:10261/305972026-05-22T06:33:51Z |
| dc.title.none.fl_str_mv |
Dependent multiple cue integration for robust tracking |
| title |
Dependent multiple cue integration for robust tracking |
| spellingShingle |
Dependent multiple cue integration for robust tracking Moreno-Noguer, Francesc Bayesian tracking Multiple cue integration Pattern recognition |
| title_short |
Dependent multiple cue integration for robust tracking |
| title_full |
Dependent multiple cue integration for robust tracking |
| title_fullStr |
Dependent multiple cue integration for robust tracking |
| title_full_unstemmed |
Dependent multiple cue integration for robust tracking |
| title_sort |
Dependent multiple cue integration for robust tracking |
| dc.creator.none.fl_str_mv |
Moreno-Noguer, Francesc Sanfeliu, Alberto Sanfeliu, Alberto Samaras, Dimitris |
| author |
Moreno-Noguer, Francesc |
| author_facet |
Moreno-Noguer, Francesc Sanfeliu, Alberto Samaras, Dimitris |
| author_role |
author |
| author2 |
Sanfeliu, Alberto Samaras, Dimitris |
| author2_role |
author author |
| dc.subject.none.fl_str_mv |
Bayesian tracking Multiple cue integration Pattern recognition |
| topic |
Bayesian tracking Multiple cue integration Pattern recognition |
| description |
We propose a new technique for fusing multiple cues to robustly segment an object from its background in video sequences that suffer from abrupt changes of both illumination and position of the target. Robustness is achieved by the integration of appearance and geometric object features and by their estimation using Bayesian filters, such as Kalman or particle filters. In particular, each filter estimates the state of a specific object feature, conditionally dependent on another feature estimated by a distinct filter. This dependence provides improved target representations, permitting us to segment it out from the background even in nonstationary sequences. Considering that the procedure of the Bayesian filters may be described by a "hypotheses generation-hypotheses correction" strategy, the major novelty of our methodology compared to previous approaches is that the mutual dependence between filters is considered during the feature observation, that is, into the "hypotheses-correction" stage, instead of considering it when generating the hypotheses. This proves to be much more effective in terms of accuracy and reliability. The proposed method is analytically justified and applied to develop a robust tracking system that adapts online and simultaneously the color space where the image points are represented, the color distributions, the contour of the object, and its bounding box. Results with synthetic data and real video sequences demonstrate the robustness and versatility of our method. |
| publishDate |
2008 |
| dc.date.none.fl_str_mv |
2008 2010 2010 |
| dc.type.none.fl_str_mv |
info:eu-repo/semantics/article http://purl.org/coar/resource_type/c_6501 Publisher's version info:eu-repo/semantics/publishedVersion |
| format |
article |
| status_str |
publishedVersion |
| dc.identifier.none.fl_str_mv |
http://hdl.handle.net/10261/30597 |
| url |
http://hdl.handle.net/10261/30597 |
| dc.language.none.fl_str_mv |
Inglés |
| language_invalid_str_mv |
Inglés |
| dc.relation.none.fl_str_mv |
http://dx.doi.org/10.1109/TPAMI.2007.70727 |
| dc.rights.none.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.publisher.none.fl_str_mv |
Institute of Electrical and Electronics Engineers |
| publisher.none.fl_str_mv |
Institute of Electrical and Electronics Engineers |
| dc.source.none.fl_str_mv |
reponame:DIGITAL.CSIC. Repositorio Institucional del CSIC instname:Consejo Superior de Investigaciones Científicas (CSIC) |
| instname_str |
Consejo Superior de Investigaciones Científicas (CSIC) |
| reponame_str |
DIGITAL.CSIC. Repositorio Institucional del CSIC |
| collection |
DIGITAL.CSIC. Repositorio Institucional del CSIC |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1869407367782727680 |
| score |
15.812429 |