HAREM: Evaluation contest on named entity recognition for Portuguese
Call for participation
HAREM, the first Portuguese NER evaluation contest, stands for "HAREM - Avaliação de Reconhecimento de Entidades Mencionadas" and is taking place on the 14-16th February 2005.
HAREM is organized by Linguateca (www.linguateca.pt) and has had, from the start, a substantial participation from the Portuguese-language processing community, helping to determine the categories and the setup and discussing language-specific issues. We have now completed the compilation of a golden resource and agreed on a set of categories and subcategories, as well as detailed guidelines to assign them.
With this call, we hope to be able to have several international groups joining HAREM in order to test / run Portuguese-specific approaches against general ones. NER systems are now invited to join by sending a mail to harem-org@linguateca.pt
The contest will run as follows:
- upon registering, participants will be given a small subset of the golden resource for familiarization and test purposes;
- on the 14th February, a large collection of texts will be provided, which the systems will have to classify and return within the next 48 hours (note that all participation is Web-mediated: no physical meeting is involved);
- shortly after, the organization will provide participants with detailed evaluation results, based on the golden resource, as well as rank the systems and announce the winner.
See the HAREM page for details (in the next days more information in English will be added).
http://poloxldb.linguateca.pt/harem.php
This archive was generated by hypermail 2b29 : Thu Jan 13 2005 - 20:05:31 MET