SENSEVAL-3
CALL FOR TASK PROPOSALS
The Senseval Committee invites proposals for tasks to be run as part
of Senseval-3. We welcome proposals for any kind of task that can
test a word sense disambiguation (WSD) system, be it application
dependent or independent. We especially encourage tasks for different
languages, cross-lingual tasks, and tasks that are relevant to
particular NLP applications such as MT and IR. We also encourage
tasks for areas related to WSD such as semantic tagging and
domain classification.
It will help us if tasks are designed in such that they can be run and
scored automatically from a central website (as in Senseval-2). We'll
be happy to help with task design, data formatting, and so on.
Information on the design of Senseval-1 and -2 tasks can be found at:
http://www.itri.bton.ac.uk/~Adam.Kilgarriff/framework.pdf
http://www.sle.sharp.co.uk/senseval2/archive/
The time period for Senseval-3 has not yet been finalised, but it will be
held over a 1-2 month period after July 2003.
SUBMISSION DETAILS
Proposals for tasks will ideally contain:
- A description of the task (max 1 page)
- How the training/testing data will be built and/or procured
- The evaluation methodology to be used including clear evaluation
criteria
- The availability of the resources to the participants (copyright,
costs, etc)
- The resources required to prepare the task (time, money, and human)
- How much of the resources your team can supply or muster
If you aren't yet at a point to provide outlines of all of these,
that's fine, but please give some thought to each, and present a note
of your first ideas. We will gladly give feedback.
Please submit proposals as soon as possible, preferably by electronic
mail in plain ASCII text to the Senseval chair: Phil Edmonds,
phil@sharp.co.uk
IMPORTANT DATES
Sep 21, 2002 Intention to submit (send a short-paragraph description)
Oct 26, 2002 Submission deadline for task proposals
Nov 23, 2002 Notification of acceptance
This archive was generated by hypermail 2b29 : Tue Aug 13 2002 - 16:14:34 MET DST