TY - JOUR
T1 - Overview of QA4MRE at CLEF 2012
T2 - 2012 Cross Language Evaluation Forum Conference, CLEF 2012
AU - Peñas, Anselmo
AU - Hovy, Eduard
AU - Forner, Pamela
AU - Rodrigo, Álvaro
AU - Sutcliffe, Richard
AU - Sporleder, Caroline
AU - Forascu, Corina
AU - Benajiba, Yassine
AU - Osenova, Petya
PY - 2012
Y1 - 2012
N2 - This paper describes the Question Answering for Machine Reading (QA4MRE) task at the 2012 Cross Language Evaluation Forum. In the main task, systems answered multiple-choice questions on documents concerned with four different topics. There were also two pilot tasks, Processing Modality and Negation for Machine Reading, and Machine Reading on Biomedical Texts about Alzheimer's disease. This paper describes the preparation of the data sets, the definition of the background collections, the metric used for the evaluation of the systems' submissions, and the results. Eleven groups participated in the task submitting a total of 43 runs in seven languages.
AB - This paper describes the Question Answering for Machine Reading (QA4MRE) task at the 2012 Cross Language Evaluation Forum. In the main task, systems answered multiple-choice questions on documents concerned with four different topics. There were also two pilot tasks, Processing Modality and Negation for Machine Reading, and Machine Reading on Biomedical Texts about Alzheimer's disease. This paper describes the preparation of the data sets, the definition of the background collections, the metric used for the evaluation of the systems' submissions, and the results. Eleven groups participated in the task submitting a total of 43 runs in seven languages.
UR - http://www.scopus.com/inward/record.url?scp=84922021542&partnerID=8YFLogxK
M3 - Conference article
AN - SCOPUS:84922021542
SN - 1613-0073
VL - 1178
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
Y2 - 17 September 2012 through 20 September 2012
ER -