There is actually very little. There are the results from the MUC
conferences at http://cs.nyu.edu/cs/faculty/grishman/muc6.html.
And there are the pages posted at the Amalgam page at
http://www.scs.leeds.ac.uk/amalgam/amalgam/amalghome.htm. I have
seen some vague references in some of the materials I have but as
far as I know there is no such comparison in the literature. I will
be watching avidly for your summary. Hopefully, there is more than
I realize.
Recently there was a nice collection of addresses of on-line parsers
posted to the "Linguist" mailing list. The address is:
http://www.ifi.unizh.ch/CL/InteractiveTools.html
However, this list contains no comparative evaluation. If you are
become aware of anyone who is doing such work or who would like to
do such work, I would also like to know.
Phil Bralich
Philip A. Bralich, Ph.D.
President and CEO
Ergo Linguistic Technologies
2800 Woodlawn Drive, Suite 175
Honolulu, HI 96822
Tel: (808)539-3920
Fax: (808)5393924