Abstract
A serious bottleneck of comparative parser evaluation is the fact that different parsers subscribe to different formal frameworks and theoretical assumptions. Converting outputs from one framework to another is less than optimal as it easily introduces noise into the process. Here we present a principled protocol for evaluating parsing results across frameworks based on function trees, tree generalization and edit distance metrics. This extends a previously proposed framework for cross-Theory evaluation and allows us to compare a wider class of parsers. We demonstrate the usefulness and language independence of our procedure by evaluating constituency and dependency parsers on English and Swedish.
| Original language | English |
|---|---|
| Title of host publication | EACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings |
| Publisher | Association for Computational Linguistics (ACL) |
| Pages | 44-54 |
| Number of pages | 11 |
| ISBN (Electronic) | 9781937284190 |
| State | Published - 2012 |
| Externally published | Yes |
| Event | 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2012 - Avignon, France Duration: 23 Apr 2012 → 27 Apr 2012 |
Publication series
| Name | EACL 2012 - 13th Conference of the European Chapter of the Association for Computational Linguistics, Proceedings |
|---|
Conference
| Conference | 13th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2012 |
|---|---|
| Country/Territory | France |
| City | Avignon |
| Period | 23/04/12 → 27/04/12 |
Bibliographical note
Publisher Copyright:© 2012 Association for Computational Linguistics.