Social network extraction and analysis based on multimodal dyadic interaction

Social interactions are a very important component in people's lives. Social network analysis has become a common technique used to model and quantify the properties of social interactions. In this paper, we propose an integrated framework to explore the characteristics of a social network extr...

Descripción completa

Detalles Bibliográficos
Autores: Escalera, Sergio, Baró, Xavier, Vitrià Marca, Jordi, Radeva Ivanova, Petia, Raducanu, Bogdan
Tipo de recurso: artículo
Estado:Versión publicada
Fecha de publicación:2012
País:España
Institución:Universitat Oberta de Catalunya (UOC)
Repositorio:O2, repositorio institucional de la UOC
OAI Identifier:oai:openaccess.uoc.edu:10609/92220
Acceso en línea:http://hdl.handle.net/10609/92220
Access Level:acceso abierto
Palabra clave:influence model
social interaction
audio/visual data fusion
social network analysis
interacción social
fusión de datos audio/visual
análisis de las redes sociales
modelo de influencia
interacció social
fusió de dades àudio/visual
anàlisi de les xarxes socials
model d'influència
Social networks
Xarxes socials
Redes sociales
Descripción
Sumario:Social interactions are a very important component in people's lives. Social network analysis has become a common technique used to model and quantify the properties of social interactions. In this paper, we propose an integrated framework to explore the characteristics of a social network extracted from multimodal dyadic interactions. For our study, we used a set of videos belonging to New York Times' Blogging Heads opinion blog. The Social Network is represented as an oriented graph, whose directed links are determined by the Influence Model. The links' weights are a measure of the "influence" a person has over the other. The states of the Influence Model encode automatically extracted audio/visual features from our videos using state-of-the art algorithms. Our results are reported in terms of accuracy of audio/visual data fusion for speaker segmentation and centrality measures used to characterize the extracted social network.