The multiple language question answering track at CLEF 2003

This paper reports on the pilot question answering track that was carried out within the CLEF initiative this year. The track was divided into monolingual and bilingual tasks: monolingual systems were evaluated within the frame of three non-English European languages, Dutch, Italian and Spanish, whi...

Descripción completa

Detalles Bibliográficos
Autores: Magnini, Bernardo, Romagnoli, Simone, Vallin, Alessandro, Herrera, Jesús, Peñas, Anselmo, Peinado, Víctor, Verdejo, Felisa, de Rijke, Maarten
Tipo de recurso: capítulo de libro
Fecha de publicación:2004
País:España
Institución:Universidad Complutense de Madrid (UCM)
Repositorio:Docta Complutense
Idioma:español
OAI Identifier:oai:docta.ucm.es:20.500.14352/53620
Acceso en línea:https://hdl.handle.net/20.500.14352/53620
Access Level:acceso abierto
Palabra clave:CLEF 2003
Question answering track
Tarea de pregunta respuesta
Inteligencia artificial (Informática)
1203.04 Inteligencia Artificial
Descripción
Sumario:This paper reports on the pilot question answering track that was carried out within the CLEF initiative this year. The track was divided into monolingual and bilingual tasks: monolingual systems were evaluated within the frame of three non-English European languages, Dutch, Italian and Spanish, while in the cross-language tasks an English document collection constituted the target corpus for Italian, Spanish, Dutch, French and German queries. Participants were given 200 questions for each task, and were allowed to submit up to two runs per task with up to three responses (either exact answers or 50 byte long strings) per question. We give here an overview of the track: we report on each task and discuss the creation of the multilingual test sets and the participants results.