TOWARDS A EUROPEAN EVALUATION INFRASTRUCTURE
FOR NL AND SPEECH.
A workshop jointly organised by the European Network of
Excellence in Language and Speech ELSNET and
the CEC Language Engineering-4 project ELSE
to be held on Wednesday May 27, 9:00-13:00
at the
FIRST INTERNATIONAL CONFERENCE
ON LANGUAGE RESOURCES AND EVALUATION
GRANADA, SPAIN
Right now, a generic framework for semi-automatic quantitative
black-box evaluation of Speech and NLP systems does not exist in
Europe. When confronted to a choice, developers and users prefer
to ask the opinion of local experts as any other way of
processing is either unrealistic or too costly. The LE4 project
ELSE aims at providing developers with a generic strategy and
definition of the primary building blocks needed to implement a
semi-automatic quantitative black-box evaluation scheme.
Prominent speakers from the field will be invited to present
papers addressing motivation, advantages, but also problems in
connection with the implementation of such an evaluation scheme
at an international scale. Topics include e.g. the multilingual
nature of evaluation, lessons from the past (in Europe and the
US), the need for language resources. At the workshop the first
intermediate results of the ELSE project will be presented and
discussed.
This call serves to invite interested parties to ACTIVE
participation in the workshop. During the workshop, ample
opportunity will be provided for the participants to react to the
presentation of the ELSE project, and the talks by the invited
speakers. Furthermore participants will be given the opportunity
to give brief position statements.
The workshop is very timely as it takes place when the EC's 5th
Framework Programme is taking shape. It is clear that the
availability of a European evaluation infrastucture can be an
important factor in European R&D activities, and that it can only
be successful if it is organized and implemented on a European
scale.
PROGRAMME COMMITTEE
The workshop will be coorganized by ELSNET and ELSE.
The Programme Committee will consist of the participants
in the ELSE LE project:
Niels Ole Bernsen
Jean-Pierre Chanod
Khalid Choukri
Robert Gaizauskas
Steven Krauwer
Isabelle de Lamberterie
Joseph Mariani
Klaus Netter
Patrick Paroubek
Martin Rajman
Antonio Zampolli
CONTACT
Steven Krauwer
Trans 10, 3512 JK Utrecht, The Netherlands
Phone: +31 30 253 6050
Fax: +31 30 253 6000
Email: steven.krauwer@let.ruu.nl
REGISTRATION
The registration fee for the workshop will be:
10,000 pesetas for those not attending LREC
5,000 pesetas for those attending LREC
These fees will include a coffee break and the proceedings of
the workshop.
Participation in the workshop will be limited by the venue.
Requests for participation will be processed on a first come
first served basis.
CONFERENCE INFORMATION
General information about the conference can be found at:
http://www.icp.inpg.fr/ELRA/conflre.html
Specific queries about the conference should be directed to:
LREC Secretariat
Facultad de Traduccion e Interpretacion
Dpto. de Traduccion e Interpretacion
C/ Puentezuelas, 55
18002 Granada, SPAIN
Tel: +34 58 24 41 00
Fax: +34 58 24 41 04
Email: reli98@goliat.ugr.es