Subsymbolic systems have been successfully used to model several aspects of human language processing. Subsymbolic parsers are appealing because they allow combining syntactic, semantic, and thematic constraints in sentence interpretation and revising that interpretation as each word is read in. These parsers are also cognitively plausible: processing is robust and multiple interpretations are simultaneously activated when the input is ambiguous. Yet, it has been very difficult to scale them up to realistic language. They have limited memory capacity, training takes a long time, and it is difficult to represent linguistic structure. In this study, we propose to scale up the subsymbolic approach by utilizing semantic self-organization. The resulting architecture, INSOMNET, was trained on semantic representations of the newly-released LINGO Redwoods HPSG Treebank of annotated sentences from the VerbMobil project. The results show that INSOMNET is able to accurately represent the semantic dependencies while demonstrating expectations and defaults, coactivation of multiple interpretations, and robust parsing of noisy input.

PDF

In Proceedings of the 25th Annual Conference of the Cognitive Science Society, 2003.

@InProceedings{mayberry:cogsci03, title={Incremental Nonmonotonic Parsing through SemanticSelf-Organization}, author={Marshall R. Mayberry III and Risto Miikkulainen}, booktitle={Proceedings of the 25th Annual Conference of the Cognitive Science Society}, url="http://nn.cs.utexas.edu/?mayberry:cogsci03", year={2003} }

Also show archived content