Automatic summarization of soccer highlights using audio-visual descriptors

Automatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that render quite limited results due to the complexity of the p...

Descripción completa

Detalles Bibliográficos
Autores: Raventós Mayoral, Arnau, Quijada Ferrero, Raúl, Torres Urgell, Lluís|||0000-0001-9141-9875, Tarrés Ruiz, Francisco|||0000-0003-0920-4782
Tipo de recurso: artículo
Fecha de publicación:2015
País:España
Institución:Universitat Politècnica de Catalunya (UPC)
Repositorio:UPCommons. Portal del coneixement obert de la UPC
Idioma:inglés
OAI Identifier:oai:upcommons.upc.edu:2117/81686
Acceso en línea:https://hdl.handle.net/2117/81686
https://dx.doi.org/10.1186/s40064-015-1065-9
Access Level:acceso abierto
Palabra clave:Video description
Semantic computing
Soccer
Video summarization
Content analysis
Audiovisual descriptors
Multimedia feature extraction
Semantic detection
Multimodal processing and fusion
Shot-boundary detection
Of-the-art
Video
Retrieval
System
Vídeo
Semàntica computacional
Futbol
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
id ES_29eb24105ff7a6f7dcdd26f932cfa4bc
oai_identifier_str oai:upcommons.upc.edu:2117/81686
network_acronym_str ES
network_name_str España
repository_id_str
spelling Automatic summarization of soccer highlights using audio-visual descriptorsRaventós Mayoral, ArnauQuijada Ferrero, RaúlTorres Urgell, Lluís|||0000-0001-9141-9875Tarrés Ruiz, Francisco|||0000-0003-0920-4782Video descriptionSemantic computingSoccerVideo summarizationContent analysisAudiovisual descriptorsMultimedia feature extractionSemantic detectionMultimodal processing and fusionShot-boundary detectionOf-the-artVideoRetrievalSystemVídeoSemàntica computacionalFutbolÀrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeoAutomatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that render quite limited results due to the complexity of the problem and to the low capability of the descriptors to represent semantic content. In this paper, a new approach for automatic highlights summarization generation of soccer videos using audio-visual descriptors is presented. The approach is based on the segmentation of the video sequence into shots that will be further analyzed to determine its relevance and interest. Of special interest in the approach is the use of the audio information that provides additional robustness to the overall performance of the summarization system. For every video shot a set of low and mid level audio-visual descriptors are computed and lately adequately combined in order to obtain different relevance measures based on empirical knowledge rules. The final summary is generated by selecting those shots with highest interest according to the specifications of the user and the results of relevance measures. A variety of results are presented with real soccer video sequences that prove the validity of the approach.Peer ReviewedSpringer20152015-06-3020162016-01-19journal articlehttp://purl.org/coar/resource_type/c_6501VoRhttp://purl.org/coar/version/c_970fb48d4fbd8a85info:eu-repo/semantics/articleapplication/pdfhttps://hdl.handle.net/2117/81686https://dx.doi.org/10.1186/s40064-015-1065-926155440reponame:UPCommons. Portal del coneixement obert de la UPCinstname:Universitat Politècnica de Catalunya (UPC)Inglésengopen accesshttp://purl.org/coar/access_right/c_abf2http://creativecommons.org/licenses/by/3.0/es/info:eu-repo/semantics/openAccessoai:upcommons.upc.edu:2117/816862026-05-27T15:37:01Z
dc.title.none.fl_str_mv Automatic summarization of soccer highlights using audio-visual descriptors
title Automatic summarization of soccer highlights using audio-visual descriptors
spellingShingle Automatic summarization of soccer highlights using audio-visual descriptors
Raventós Mayoral, Arnau
Video description
Semantic computing
Soccer
Video summarization
Content analysis
Audiovisual descriptors
Multimedia feature extraction
Semantic detection
Multimodal processing and fusion
Shot-boundary detection
Of-the-art
Video
Retrieval
System
Vídeo
Semàntica computacional
Futbol
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
title_short Automatic summarization of soccer highlights using audio-visual descriptors
title_full Automatic summarization of soccer highlights using audio-visual descriptors
title_fullStr Automatic summarization of soccer highlights using audio-visual descriptors
title_full_unstemmed Automatic summarization of soccer highlights using audio-visual descriptors
title_sort Automatic summarization of soccer highlights using audio-visual descriptors
dc.creator.none.fl_str_mv Raventós Mayoral, Arnau
Quijada Ferrero, Raúl
Torres Urgell, Lluís|||0000-0001-9141-9875
Tarrés Ruiz, Francisco|||0000-0003-0920-4782
author Raventós Mayoral, Arnau
author_facet Raventós Mayoral, Arnau
Quijada Ferrero, Raúl
Torres Urgell, Lluís|||0000-0001-9141-9875
Tarrés Ruiz, Francisco|||0000-0003-0920-4782
author_role author
author2 Quijada Ferrero, Raúl
Torres Urgell, Lluís|||0000-0001-9141-9875
Tarrés Ruiz, Francisco|||0000-0003-0920-4782
author2_role author
author
author
dc.subject.none.fl_str_mv Video description
Semantic computing
Soccer
Video summarization
Content analysis
Audiovisual descriptors
Multimedia feature extraction
Semantic detection
Multimodal processing and fusion
Shot-boundary detection
Of-the-art
Video
Retrieval
System
Vídeo
Semàntica computacional
Futbol
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
topic Video description
Semantic computing
Soccer
Video summarization
Content analysis
Audiovisual descriptors
Multimedia feature extraction
Semantic detection
Multimodal processing and fusion
Shot-boundary detection
Of-the-art
Video
Retrieval
System
Vídeo
Semàntica computacional
Futbol
Àrees temàtiques de la UPC::Enginyeria de la telecomunicació::Processament del senyal::Processament de la imatge i del senyal vídeo
description Automatic summarization generation of sports video content has been object of great interest for many years. Although semantic descriptions techniques have been proposed, many of the approaches still rely on low-level video descriptors that render quite limited results due to the complexity of the problem and to the low capability of the descriptors to represent semantic content. In this paper, a new approach for automatic highlights summarization generation of soccer videos using audio-visual descriptors is presented. The approach is based on the segmentation of the video sequence into shots that will be further analyzed to determine its relevance and interest. Of special interest in the approach is the use of the audio information that provides additional robustness to the overall performance of the summarization system. For every video shot a set of low and mid level audio-visual descriptors are computed and lately adequately combined in order to obtain different relevance measures based on empirical knowledge rules. The final summary is generated by selecting those shots with highest interest according to the specifications of the user and the results of relevance measures. A variety of results are presented with real soccer video sequences that prove the validity of the approach.
publishDate 2015
dc.date.none.fl_str_mv 2015
2015-06-30
2016
2016-01-19
dc.type.none.fl_str_mv journal article
http://purl.org/coar/resource_type/c_6501
VoR
http://purl.org/coar/version/c_970fb48d4fbd8a85
dc.type.openaire.fl_str_mv info:eu-repo/semantics/article
format article
dc.identifier.none.fl_str_mv https://hdl.handle.net/2117/81686
https://dx.doi.org/10.1186/s40064-015-1065-9
26155440
url https://hdl.handle.net/2117/81686
https://dx.doi.org/10.1186/s40064-015-1065-9
identifier_str_mv 26155440
dc.language.none.fl_str_mv Inglés
eng
language_invalid_str_mv Inglés
language eng
dc.rights.none.fl_str_mv open access
http://purl.org/coar/access_right/c_abf2

http://creativecommons.org/licenses/by/3.0/es/
dc.rights.openaire.fl_str_mv info:eu-repo/semantics/openAccess
rights_invalid_str_mv open access
http://purl.org/coar/access_right/c_abf2

http://creativecommons.org/licenses/by/3.0/es/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Springer
publisher.none.fl_str_mv Springer
dc.source.none.fl_str_mv reponame:UPCommons. Portal del coneixement obert de la UPC
instname:Universitat Politècnica de Catalunya (UPC)
instname_str Universitat Politècnica de Catalunya (UPC)
reponame_str UPCommons. Portal del coneixement obert de la UPC
collection UPCommons. Portal del coneixement obert de la UPC
repository.name.fl_str_mv
repository.mail.fl_str_mv
_version_ 1869405037917110273
score 15,300719

Similares en LA Referencia