Automatic summarization of soccer highlights using audio-visual descriptors

Automatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that render quite limited results due to the complexity of the p...

Descripción completa

Detalles Bibliográficos
Autores: Raventós Mayoral, Arnau, Quijada Ferrero, Raúl, Torres Urgell, Lluís|||0000-0001-9141-9875, Tarrés Ruiz, Francisco|||0000-0003-0920-4782
Tipo de recurso: artículo
Fecha de publicación:2015
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/81686
Acceso en línea:https://hdl.handle.net/2117/81686
https://dx.doi.org/10.1186/s40064-015-1065-9
Access Level:acceso abierto
Palabra clave:Video description
Semantic computing
Soccer
Video summarization
Content analysis
Audiovisual descriptors
Multimedia feature extraction
Semantic detection
Multimodal processing and fusion
Shot-boundary detection
Of-the-art
Video
Retrieval
System
Vídeo
Semàntica computacional
Futbol
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
Descripción
Sumario:Automatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that render quite limited results due to the complexity of the problem and to the low capability of the descriptors to represent semantic content. In this paper, a new approach for automatic highlights summarization generation of soccer videos using audio-visual descriptors is presented. The approach is based on the segmentation of the video sequence into shots that will be further analyzed to determine its relevance and interest. Of special interest in the approach is the use of the audio information that provides additional robustness to the overall performance of the summarization system. For every video shot a set of low and mid level audio-visual descriptors are computed and lately adequately combined in order to obtain different relevance measures based on empirical knowledge rules. The final summary is generated by selecting those shots with highest interest according to the specifications of the user and the results of relevance measures. A variety of results are presented with real soccer video sequences that prove the validity of the approach.