MIT Computational Psycholinguistics Laboratory

Tuesday February 19th 2013, 9:45 pm
Filed under:

Incremental probabilistic parsing

You can get an implementation of a probabilistic Earley parser here, based on Stolcke (1995). This parser has been used for research in several published journal articles.

Tree search and tree transformation

Roger Levy co-wrote the Tregex tree pattern matcher, similar to tgrep2, with Galen Andrew. The Tregex distribution also bundles tsurgeon, the leading tool for automated tree transformation. It’s distributed from Stanford.

Competition-Integration Model

An implementation of the Spivey-Knowlton (1996) competition-integration model can be found here.


Levy, R., & Andrew, G. (2006). Tregex and Tsurgeon: tools for querying and manipulating tree data structures. In Proceedings of the Fifth International Conference on Language Resources and Evaluation (pp. 2231-2234).
Spivey-Knowlton, M. J. (1996). Integration of visual and linguistic information: Human data and model simulations (Doctoral dissertation, University of Rochester. Department of Brain and Cognitive Sciences).
Stolcke, A. (1995). An efficient probabilistic context-free parsing algorithm that computes prefix probabilities. Computational Linguistics, 21(2), 165-201.
Comments Off on Software