Evaluation of NLP and Speech Tools for Italian

Following the success of Evalita 2007, we are pleased to announce Evalita 2009, the second evaluation campaign of Natural Language Processing tools for Italian, supported by the NLP working group of AI*IA.

The general objective of Evalita is to promote the development of language and speech technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner. This year in conjunction with AISV (the Italian Association of Speech Science), Evalita will also hold the first speech input technology evaluation for Italian.

We invite participation, both from academic institutions and industrial organizations, on eight tasks (the formerly announced anaphora resolution task will not be held):

Text tasks

• PoS-Tagging
• Parsing
• Lexical Substitution
• Entity Recognition
• Textual Entailment

Speech tasks

• Connected Digits Recognition
• Spoken Dialogue Systems Evaluation
• Speaker Identity Verification

The results of the evaluation will be disseminated at the final workshop (December 12th, 2009) which will be organized in Reggio Emilia in conjunction with AI*IA 2009.

© 2009 - CELCT