Real-time segmentation of stereo videos on a portable system with a mobile GPU

In mobile robotic applications, visual information needs to be processed fast despite resource limitations of the mobile system. Here a novel real-time framework for model-free spatio-temporal segmentation of stereo videos is presented. It combines real-time optical flow and stereo with image segmen...

Full description

Bibliographic Details
Authors: Abramov, Alexey, Pauwels, Karl, Papon, Jeremie, Wörgötter, Florentin, Dellen, Babette
Format: article
Status:Versión aceptada para publicación
Publication Date:2012
Country:España
Institution:Consejo Superior de Investigaciones Científicas (CSIC)
Repository:DIGITAL.CSIC. Repositorio Institucional del CSIC
OAI Identifier:oai:digital.csic.es:10261/55699
Online Access:http://hdl.handle.net/10261/55699
Access Level:Open access
Keyword:Pattern recognition
Video segmentation
Mobile systems
Stereo segmentation
Visual front end
Description
Summary:In mobile robotic applications, visual information needs to be processed fast despite resource limitations of the mobile system. Here a novel real-time framework for model-free spatio-temporal segmentation of stereo videos is presented. It combines real-time optical flow and stereo with image segmentation and runs on a portable system with an integrated mobile GPU. The system performs on-line, automatic and dense segmentation of stereo videos and serves as a visual front-end for preprocessing in mobile robots, providing a condensed representation of the scene which can potentially be utilized in various applications, e.g., object manipulation, manipulation recognition, visual servoing. The method was tested on real-world sequences with arbitrary motions including videos acquired with a moving camera.