Egocentric scene interpretation

In this paper, we present Egocentric Scene Interpretation, an integrated framework that combines depth and semantic maps for 3D scene geometry, semantics, and appearance reconstruction. Furthermore, we introduce a new metric, called the Egocentric Scene Interpretation (ESI) Score, to evaluate the al...

Descripción completa

Detalles Bibliográficos
Autor: Forigua Díaz, Cristhian David
Tipo de recurso: tesis de maestría
Estado:Versión aceptada para publicación
Fecha de publicación:2023
País:Colombia
Institución:Universidad de los Andes
Repositorio:Séneca: repositorio Uniandes
Idioma:inglés
OAI Identifier:oai:repositorio.uniandes.edu.co:1992/73444
Acceso en línea:https://hdl.handle.net/1992/73444
Access Level:acceso abierto
Palabra clave:Egocentric Understanding
3D Reconstruction
Semantic Segmentation
Depth Estimation
Ingeniería
id CO_cf4dacd778a044a3fb09352cfbde717e
oai_identifier_str oai:repositorio.uniandes.edu.co:1992/73444
network_acronym_str CO
network_name_str Colombia
repository_id_str
spelling Egocentric scene interpretationForigua Díaz, Cristhian DavidEgocentric Understanding3D ReconstructionSemantic SegmentationDepth EstimationIngenieríaIn this paper, we present Egocentric Scene Interpretation, an integrated framework that combines depth and semantic maps for 3D scene geometry, semantics, and appearance reconstruction. Furthermore, we introduce a new metric, called the Egocentric Scene Interpretation (ESI) Score, to evaluate the alignment between geometry and semantics for 3D scene understanding. In addition to the experimental framework, we propose EgoScene, a diffusionbased approach that leverages temporal consistency in feature extraction for egocentric downstream tasks. We compare EgoScene against transformer-based methods. Our method outperforms transformer-based methods by 26% in the ESI score, establishing the state-of-the-art for Egocentric Scene Interpretation.Magíster en Ingeniería BiomédicaMaestríaUniversidad de los AndesMaestría en Ingeniería BiomédicaFacultad de IngenieríaDepartamento de Ingeniería BiomédicaArbeláez Escalante, Pablo AndrésManinis, Kevis-KokitsiGiraldo Trujillo, Luis Felipe2023-12-11Trabajo de grado - Maestríainfo:eu-repo/semantics/masterThesisinfo:eu-repo/semantics/acceptedVersionhttp://purl.org/coar/resource_type/c_bdcchttp://purl.org/coar/version/c_ab4af688f83e57aaTexthttps://purl.org/redcol/resource_type/TM11 páginasapplication/pdfapplication/pdfapplication/pdfhttps://hdl.handle.net/1992/73444instname:Universidad de los Andesreponame:Repositorio Institucional Sénecarepourl:https://repositorio.uniandes.edu.co/engAttribution-NonCommercial-NoDerivatives 4.0 Internationalhttp://creativecommons.org/licenses/by-nc-nd/4.0/info:eu-repo/semantics/openAccesshttp://purl.org/coar/access_right/c_abf2reponame:Séneca: repositorio Uniandesinstname:Universidad de los Andesinstacron:Universidad de los Andes2024-07-03T09:49:29Z
dc.title.none.fl_str_mv Egocentric scene interpretation
title Egocentric scene interpretation
spellingShingle Egocentric scene interpretation
Forigua Díaz, Cristhian David
Egocentric Understanding
3D Reconstruction
Semantic Segmentation
Depth Estimation
Ingeniería
title_short Egocentric scene interpretation
title_full Egocentric scene interpretation
title_fullStr Egocentric scene interpretation
title_full_unstemmed Egocentric scene interpretation
title_sort Egocentric scene interpretation
dc.creator.none.fl_str_mv Forigua Díaz, Cristhian David
author Forigua Díaz, Cristhian David
author_facet Forigua Díaz, Cristhian David
author_role author
dc.contributor.none.fl_str_mv Arbeláez Escalante, Pablo Andrés
Maninis, Kevis-Kokitsi
Giraldo Trujillo, Luis Felipe
dc.subject.none.fl_str_mv Egocentric Understanding
3D Reconstruction
Semantic Segmentation
Depth Estimation
Ingeniería
topic Egocentric Understanding
3D Reconstruction
Semantic Segmentation
Depth Estimation
Ingeniería
description In this paper, we present Egocentric Scene Interpretation, an integrated framework that combines depth and semantic maps for 3D scene geometry, semantics, and appearance reconstruction. Furthermore, we introduce a new metric, called the Egocentric Scene Interpretation (ESI) Score, to evaluate the alignment between geometry and semantics for 3D scene understanding. In addition to the experimental framework, we propose EgoScene, a diffusionbased approach that leverages temporal consistency in feature extraction for egocentric downstream tasks. We compare EgoScene against transformer-based methods. Our method outperforms transformer-based methods by 26% in the ESI score, establishing the state-of-the-art for Egocentric Scene Interpretation.
publishDate 2023
dc.date.none.fl_str_mv 2023-12-11
dc.type.none.fl_str_mv Trabajo de grado - Maestría
info:eu-repo/semantics/masterThesis
info:eu-repo/semantics/acceptedVersion
http://purl.org/coar/resource_type/c_bdcc
http://purl.org/coar/version/c_ab4af688f83e57aa
Text
https://purl.org/redcol/resource_type/TM
format masterThesis
status_str acceptedVersion
dc.identifier.none.fl_str_mv https://hdl.handle.net/1992/73444
instname:Universidad de los Andes
reponame:Repositorio Institucional Séneca
repourl:https://repositorio.uniandes.edu.co/
url https://hdl.handle.net/1992/73444
identifier_str_mv instname:Universidad de los Andes
reponame:Repositorio Institucional Séneca
repourl:https://repositorio.uniandes.edu.co/
dc.language.none.fl_str_mv eng
language eng
dc.rights.none.fl_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
info:eu-repo/semantics/openAccess
http://purl.org/coar/access_right/c_abf2
rights_invalid_str_mv Attribution-NonCommercial-NoDerivatives 4.0 International
http://creativecommons.org/licenses/by-nc-nd/4.0/
http://purl.org/coar/access_right/c_abf2
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv 11 páginas
application/pdf
application/pdf
application/pdf
dc.publisher.none.fl_str_mv Universidad de los Andes
Maestría en Ingeniería Biomédica
Facultad de Ingeniería
Departamento de Ingeniería Biomédica
publisher.none.fl_str_mv Universidad de los Andes
Maestría en Ingeniería Biomédica
Facultad de Ingeniería
Departamento de Ingeniería Biomédica
dc.source.none.fl_str_mv reponame:Séneca: repositorio Uniandes
instname:Universidad de los Andes
instacron:Universidad de los Andes
instname_str Universidad de los Andes
instacron_str Universidad de los Andes
institution Universidad de los Andes
reponame_str Séneca: repositorio Uniandes
collection Séneca: repositorio Uniandes
_version_ 1825052364128649216
score 15.812455

Similares en LA Referencia