Author profiling in social media with multimodal information
Determine aspects of a person as gender, age, residency, occupation, among others, through his/her texts is a task that is part of the natural language processing and is known as author profiling. In this thesis work, we propose a solution for the task of profiling authors in social networks. Our so...
| Autor: | |
|---|---|
| Tipo de recurso: | tesis doctoral |
| Estado: | Versión aceptada para publicación |
| Fecha de publicación: | 2019 |
| País: | México |
| Institución: | Instituto Nacional de Astrofísica, Óptica y Electrónica |
| Repositorio: | Repositorio Institucional del INAOE |
| Idioma: | inglés |
| OAI Identifier: | oai:inaoe.repositorioinstitucional.mx:1009/1686 |
| Acceso en línea: | http://inaoe.repositorioinstitucional.mx/jspui/handle/1009/1686 |
| Access Level: | acceso abierto |
| Palabra clave: | info:eu-repo/classification/Inspec/Natural languaje processing info:eu-repo/classification/Inspec/Textual classification info:eu-repo/classification/Inspec/Author profiling info:eu-repo/classification/Inspec/Multimodal information info:eu-repo/classification/Inspec/Images representation info:eu-repo/classification/cti/1 info:eu-repo/classification/cti/12 info:eu-repo/classification/cti/1203 info:eu-repo/classification/cti/120323 |
| id |
MX_de7d0eea8aa91cf36f25e624aa56e5fa |
|---|---|
| oai_identifier_str |
oai:inaoe.repositorioinstitucional.mx:1009/1686 |
| network_acronym_str |
MX |
| network_name_str |
México |
| repository_id_str |
|
| dc.title.none.fl_str_mv |
Author profiling in social media with multimodal information |
| title |
Author profiling in social media with multimodal information |
| spellingShingle |
Author profiling in social media with multimodal information Miguel Ángel Alvarez Carmona info:eu-repo/classification/Inspec/Natural languaje processing info:eu-repo/classification/Inspec/Textual classification info:eu-repo/classification/Inspec/Author profiling info:eu-repo/classification/Inspec/Multimodal information info:eu-repo/classification/Inspec/Images representation info:eu-repo/classification/cti/1 info:eu-repo/classification/cti/12 info:eu-repo/classification/cti/1203 info:eu-repo/classification/cti/120323 info:eu-repo/classification/cti/120323 |
| title_short |
Author profiling in social media with multimodal information |
| title_full |
Author profiling in social media with multimodal information |
| title_fullStr |
Author profiling in social media with multimodal information |
| title_full_unstemmed |
Author profiling in social media with multimodal information |
| title_sort |
Author profiling in social media with multimodal information |
| dc.creator.none.fl_str_mv |
Miguel Ángel Alvarez Carmona |
| author |
Miguel Ángel Alvarez Carmona |
| author_facet |
Miguel Ángel Alvarez Carmona |
| author_role |
author |
| dc.contributor.none.fl_str_mv |
Luis Villaseñor Pineda ESAU VILLATORO TELLO |
| dc.subject.none.fl_str_mv |
info:eu-repo/classification/Inspec/Natural languaje processing info:eu-repo/classification/Inspec/Textual classification info:eu-repo/classification/Inspec/Author profiling info:eu-repo/classification/Inspec/Multimodal information info:eu-repo/classification/Inspec/Images representation info:eu-repo/classification/cti/1 info:eu-repo/classification/cti/12 info:eu-repo/classification/cti/1203 info:eu-repo/classification/cti/120323 info:eu-repo/classification/cti/120323 |
| topic |
info:eu-repo/classification/Inspec/Natural languaje processing info:eu-repo/classification/Inspec/Textual classification info:eu-repo/classification/Inspec/Author profiling info:eu-repo/classification/Inspec/Multimodal information info:eu-repo/classification/Inspec/Images representation info:eu-repo/classification/cti/1 info:eu-repo/classification/cti/12 info:eu-repo/classification/cti/1203 info:eu-repo/classification/cti/120323 info:eu-repo/classification/cti/120323 |
| description |
Determine aspects of a person as gender, age, residency, occupation, among others, through his/her texts is a task that is part of the natural language processing and is known as author profiling. In this thesis work, we propose a solution for the task of profiling authors in social networks. Our solution uses a multimodal approach to extracting information from written messages and images shared by users. Previous work has shown the existence of useful information for this task in these modalities; however, our proposal goes further demonstrating the complementarity of the modalities when merging these two sources of information. To do this, we propose to map images in a text, and with that, to have the same framework of representation through which to achieve the fusion of information. Our work explores different methods for extracting information either from the text or from the images. To represent the textual information, different distributional term representations approaches were explored in order to identify the topics addressed by the user. For this purpose, an evaluation framework was proposed in order to identify the most appropriate method for this task. To represent visual information, approaches were explored to convert an image into a set of descriptive terms. The results show that the textual descriptions of the images contain information for the author profiling task, and the fusion of textual information with information extracted from the images increases the accuracy of this task. |
| publishDate |
2019 |
| dc.date.none.fl_str_mv |
2019-03 |
| dc.type.none.fl_str_mv |
info:eu-repo/semantics/doctoralThesis info:eu-repo/semantics/acceptedVersion |
| format |
doctoralThesis |
| status_str |
acceptedVersion |
| dc.identifier.none.fl_str_mv |
http://inaoe.repositorioinstitucional.mx/jspui/handle/1009/1686 |
| url |
http://inaoe.repositorioinstitucional.mx/jspui/handle/1009/1686 |
| dc.language.none.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
citation:Álvarez Carmona, M. A., (2019), Author profiling in social media with multimodal information, Tesis de Doctorado, Instituto Nacional de Astrofísica, Óptica y Electrónica. |
| dc.rights.none.fl_str_mv |
info:eu-repo/semantics/openAccess http://creativecommons.org/licenses/by-nc-nd/4.0 |
| eu_rights_str_mv |
openAccess |
| rights_invalid_str_mv |
http://creativecommons.org/licenses/by-nc-nd/4.0 |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.publisher.none.fl_str_mv |
Instituto Nacional de Astrofísica, Óptica y Electrónica. |
| publisher.none.fl_str_mv |
Instituto Nacional de Astrofísica, Óptica y Electrónica. |
| dc.source.none.fl_str_mv |
reponame:Repositorio Institucional del INAOE instname:Instituto Nacional de Astrofísica, Óptica y Electrónica instacron:INAOE |
| instname_str |
Instituto Nacional de Astrofísica, Óptica y Electrónica |
| instacron_str |
INAOE |
| institution |
INAOE |
| reponame_str |
Repositorio Institucional del INAOE |
| collection |
Repositorio Institucional del INAOE |
| repository.name.fl_str_mv |
|
| repository.mail.fl_str_mv |
|
| _version_ |
1858177317758566400 |
| spelling |
Author profiling in social media with multimodal informationMiguel Ángel Alvarez Carmonainfo:eu-repo/classification/Inspec/Natural languaje processinginfo:eu-repo/classification/Inspec/Textual classificationinfo:eu-repo/classification/Inspec/Author profilinginfo:eu-repo/classification/Inspec/Multimodal informationinfo:eu-repo/classification/Inspec/Images representationinfo:eu-repo/classification/cti/1info:eu-repo/classification/cti/12info:eu-repo/classification/cti/1203info:eu-repo/classification/cti/120323info:eu-repo/classification/cti/120323Determine aspects of a person as gender, age, residency, occupation, among others, through his/her texts is a task that is part of the natural language processing and is known as author profiling. In this thesis work, we propose a solution for the task of profiling authors in social networks. Our solution uses a multimodal approach to extracting information from written messages and images shared by users. Previous work has shown the existence of useful information for this task in these modalities; however, our proposal goes further demonstrating the complementarity of the modalities when merging these two sources of information. To do this, we propose to map images in a text, and with that, to have the same framework of representation through which to achieve the fusion of information. Our work explores different methods for extracting information either from the text or from the images. To represent the textual information, different distributional term representations approaches were explored in order to identify the topics addressed by the user. For this purpose, an evaluation framework was proposed in order to identify the most appropriate method for this task. To represent visual information, approaches were explored to convert an image into a set of descriptive terms. The results show that the textual descriptions of the images contain information for the author profiling task, and the fusion of textual information with information extracted from the images increases the accuracy of this task.Determinar aspectos de una persona como su género, edad, lugar de origen, ocupación, entre otros, a través de sus textos es una tarea que se enmarca dentro del procesamiento del lenguaje natural y se le conoce como perfilado del autor. En este trabajo de tesis se propone una solución para la tarea de perfilado de autores en redes sociales. Nuestra solución utiliza un enfoque multimodal extrayendo información tanto de los mensajes escritos como de las imágenes compartidos por los usuarios. Trabajos previos han demostrado la existencia de información útil para esta tarea en estas modalidades, sin embargo, nuestra propuesta va más allá demostrando la complementariedad de las modalidades al fusionar estas dos fuentes de información. Para ello, se optó por llevar a las imágenes a una representación textual, y con ello contar con un mismo marco de representación a través del cual lograr la fusión de información. Nuestro trabajo explora diferentes métodos para la extracción de información ya sea a partir del texto o de las imágenes. Para representar la información textual, se exploraron diferentes representaciones distribucionales con la finalidad de identificar los temas abordados por el usuario. Para ello se propuso un marco de evaluación de manera a identificar el método más adecuado para esta tarea. Para representar la información visual, se exploraron enfoques para convertir una imagen en conjuntos de términos descriptivos. Los resultados muestran que las descripciones textuales de las imágenes contienen información para la tarea de perfilado de autor; y la fusión de la información textual con información extraída de las imágenes incrementa la exactitud en esta tarea.Instituto Nacional de Astrofísica, Óptica y Electrónica.Luis Villaseñor PinedaESAU VILLATORO TELLO2019-03info:eu-repo/semantics/doctoralThesisinfo:eu-repo/semantics/acceptedVersionapplication/pdfhttp://inaoe.repositorioinstitucional.mx/jspui/handle/1009/1686reponame:Repositorio Institucional del INAOEinstname:Instituto Nacional de Astrofísica, Óptica y Electrónicainstacron:INAOEengcitation:Álvarez Carmona, M. A., (2019), Author profiling in social media with multimodal information, Tesis de Doctorado, Instituto Nacional de Astrofísica, Óptica y Electrónica.info:eu-repo/semantics/openAccesshttp://creativecommons.org/licenses/by-nc-nd/4.0oai:inaoe.repositorioinstitucional.mx:1009/16862024-08-28T03:22:59Z |
| score |
14.965132 |