Large-scale induction and evaluation of lexical resources from the Penn-II and Penn-III treebanks
O'Donovan, Ruth, Burke, Michael, Cahill, AoifeORCID: 0000-0002-3519-7726, van Genabith, Josef and Way, AndyORCID: 0000-0001-5736-5930
(2005)
Large-scale induction and evaluation of lexical resources from the Penn-II and Penn-III treebanks.
Computational Linguistics, 31
(3).
pp. 328-365.
ISSN 1530-9312
We present a methodology for extracting subcategorization frames based on an automatic lexical-functional grammar (LFG) f-structure annotation algorithm for the Penn-II and
Penn-III Treebanks. We extract syntactic-function-based subcategorization frames (LFG semantic forms) and traditional CFG category-based subcategorization frames as well as mixed function/category-based frames, with or without preposition information for obliques and particle information for particle verbs. Our approach associates probabilities with frames conditional on the lemma, distinguishes between active and passive frames, and fully
reflects the effects of long-distance dependencies in the source data structures. In contrast to many other approaches, ours does not predefine the subcategorization frame types extracted, learning them instead from the source data. Including particles and prepositions, we extract 21,005 lemma frame types for 4,362 verb lemmas, with a total of 577 frame types and an average of 4.8 frame types per verb. We present a large-scale evaluation of the complete set of forms extracted against the full COMLEX resource. To our knowledge, this is the largest and most complete evaluation of subcategorization frames acquired automatically for English.