Overview of the SPMRL 2013 shared task: cross-framework evaluation of parsing morphologically rich languages
Seddah, Djamé and Tsarfaty, Reut and Kübler, Sandra and Candito, Marie and Choi, Jinho and Farkas , Richard and Foster, Jennifer and Goenaga, Iakes and Gojenola, Koldo and Goldberg, Yoav and Green, Spence and Habash, Nizar and Kuhlmann, Marco and Maier, Wolfgang and Nivre, Joakim and Przepiórkowski, Adam and Roth, Ryan and Seeker, Wolfgang and Versley, Yannick and Vincze, Veronika and Wolin ́ski, Marcin and Wróblewska, Alina and Villemonte de la Clérgerie, Eric (2013) Overview of the SPMRL 2013 shared task: cross-framework evaluation of parsing morphologically rich languages. In: Fourth Workshop on Statistical Parsing of Morphologically Rich Languages, 18 Oct 2013, Seattle, WA..
Full text available as:
This paper reports on the first shared task on statistical parsing of morphologically rich languages (MRLs). The task features data sets from nine languages, each available both in constituency and dependency annotation. We report on the preparation of the data sets, on the proposed parsing scenarios, and on the evaluation metrics for parsing MRLs given different representation types. We present and analyze parsing results obtained by the task participants, and then provide an analysis and comparison of the parsers across languages and frameworks, reported for gold input as well as more realistic parsing scenarios.
Archive Staff Only: edit this record