Relighting the scene by finding the intrinsic images

In this project we will embed virtual objects in a real-life scene looking auto- matically for the most realistic approach. Previous works have demonstrated the lighting as the most important feature to achieve a better and more realistic results. Moreover other researches that focus their works in...

Descripción completa

Detalles Bibliográficos
Autor: Rafael Antón, Eduard
Tipo de recurso: tesis de maestría
Fecha de publicación:2013
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2099.1/20441
Acceso en línea:https://hdl.handle.net/2099.1/20441
Access Level:acceso abierto
Palabra clave:Computer vision
Visió per ordinador
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
Descripción
Sumario:In this project we will embed virtual objects in a real-life scene looking auto- matically for the most realistic approach. Previous works have demonstrated the lighting as the most important feature to achieve a better and more realistic results. Moreover other researches that focus their works in which is the best way to descompose or classify the lighting of any scene. In this project, we have taken most of these concepts to begin our proposal. As a first step we didn't wish to get the real lights features or even their locations, our first goal was to relight the whole scene with a virtual light and do it in real-time. Proposal. Therefore, our goal is to be able to taking a frame from an input device (mostly Kinect), erase the current light conditions of the image to lately add new ones that must be common with the virtual objects included as augmented reality (AR). Create the new conditions will be done by setting up the virtual lights into a 3D enviroment and then use a render to extract the lighting and add it to the original image taken by the Kinect, all of it in real-time. The whole process itself, presents many challenges that must be faced. A way to isolate the lighting information from any image has to be find, the geometry of the scene or at least some significant areas must be retrieved to interact as similar as possible with the virtual lights and finally, a framework has to be developed to achieve the real-time objective for the whole task.