Uncalibrated photometric stereo under general lighting with physics characteristics

Treball fi de màster de: Master in Intelligent Interactive Systems

Bibliographic Details
Author: Adrián Matos, Jesús Miguel
Format: master thesis
Publication Date:2025
Country:España
Institution:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
Repository:Recercat. Dipósit de la Recerca de Catalunya
OAI Identifier:oai:recercat.cat:10230/71575
Online Access:http://hdl.handle.net/10230/71575
Access Level:Open access
Keyword:Visió per ordinador
id ES_0dc6cb72aa160fddcf99e303fd927918
oai_identifier_str oai:recercat.cat:10230/71575
network_acronym_str ES
network_name_str España
repository_id_str
spelling Uncalibrated photometric stereo under general lighting with physics characteristicsAdrián Matos, Jesús MiguelVisió per ordinadorTreball fi de màster de: Master in Intelligent Interactive SystemsSupervisor: Dr. Antonio AgudoThis thesis introduces a novel variational approach to uncalibrated photometric stereo for robust recovery of 3D surface shape, reflectance properties, and lighting from multiple images captured under varying and unknown illumination. Building on recent advances in physically-aware piecewise regularization, the proposed method incorporates a specialized depth regularizer acting separately on interior regions and object boundaries, substantially improving stability and accuracy in the estimation of depth and albedo compared to conventional methods. Unlike classical photometric stereo techniques that require strict calibration or prior knowledge of lighting conditions, the presented framework formulates the simultaneous recovery of normals, diffuse and specular albedo, and lighting parameters as an unsupervised joint optimization problem. Optimization is carried out via a lagged block coordinate descent scheme, alternately updating surface depth, normal maps, lighting coefficients, and albedo, with robust M-estimators and adaptive Huber-TV regularization applied to both diffuse and specular reflectance components. The effectiveness of this approach is validated through extensive experiments on both synthetic datasets—with known ground truth—and real-world multi-illumination image collections. In the synthetic setting, the method accurately reconstructs detailed surfaces and reflectance from controlled geometric and photometric configurations, demonstrating strong quantitative improvements over classical and learning based baselines, especially near object boundaries and in challenging regions with specular highlights. Crucially, when applied to real image datasets, the model retains its robustness, offering high-fidelity 3D reconstruction even in the presence of noise, missing data, or imperfect segmentation, thus evidencing its practical potential beyond laboratory conditions. Overall, this work advances the state of the art in uncalibrated photometric stereo by demonstrating that a variational, physically-motivated framework with piecewise regularization can faithfully recover geometry and reflectance from both synthetic and real uncalibrated multi-illumination images. The results lay the foundation for future efforts toward even more adaptive regularization and application to uncontrolled, in-the-wild photometric datasets, promising safer and more flexible geometry reconstruction for complex materials and scenes.202520252025infoinfo:eu-repo/semantics/masterThesisapplication/pdfhttp://hdl.handle.net/10230/71575http://hdl.handle.net/10230/71575reponame:Recercat. Dipósit de la Recerca de Catalunyainstname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)InglésLlicència CC Reconeixement-NoComercial-CompartirIgual 4.0 Internacional (CC BY-NC-SA 4.0)https://creativecommons.org/licenses/by-nc-sa/4.0/info:eu-repo/semantics/openAccessoai:recercat.cat:10230/715752026-05-29T05:05:01Z
dc.title.none.fl_str_mv Uncalibrated photometric stereo under general lighting with physics characteristics
title Uncalibrated photometric stereo under general lighting with physics characteristics
spellingShingle Uncalibrated photometric stereo under general lighting with physics characteristics
Adrián Matos, Jesús Miguel
Visió per ordinador
title_short Uncalibrated photometric stereo under general lighting with physics characteristics
title_full Uncalibrated photometric stereo under general lighting with physics characteristics
title_fullStr Uncalibrated photometric stereo under general lighting with physics characteristics
title_full_unstemmed Uncalibrated photometric stereo under general lighting with physics characteristics
title_sort Uncalibrated photometric stereo under general lighting with physics characteristics
dc.creator.none.fl_str_mv Adrián Matos, Jesús Miguel
author Adrián Matos, Jesús Miguel
author_facet Adrián Matos, Jesús Miguel
author_role author
dc.subject.none.fl_str_mv Visió per ordinador
topic Visió per ordinador
description Treball fi de màster de: Master in Intelligent Interactive Systems
publishDate 2025
dc.date.none.fl_str_mv 2025
2025
2025
info
dc.type.none.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
dc.identifier.none.fl_str_mv http://hdl.handle.net/10230/71575
http://hdl.handle.net/10230/71575
url http://hdl.handle.net/10230/71575
dc.language.none.fl_str_mv Inglés
language_invalid_str_mv Inglés
dc.rights.none.fl_str_mv Llicència CC Reconeixement-NoComercial-CompartirIgual 4.0 Internacional (CC BY-NC-SA 4.0)
https://creativecommons.org/licenses/by-nc-sa/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Llicència CC Reconeixement-NoComercial-CompartirIgual 4.0 Internacional (CC BY-NC-SA 4.0)
https://creativecommons.org/licenses/by-nc-sa/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.source.none.fl_str_mv reponame:Recercat. Dipósit de la Recerca de Catalunya
instname:Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
instname_str Varias* (Consorci de Biblioteques Universitáries de Catalunya, Centre de Serveis Científics i Acadèmics de Catalunya)
reponame_str Recercat. Dipósit de la Recerca de Catalunya
collection Recercat. Dipósit de la Recerca de Catalunya
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869403358535614464
score 15,812429