Tag Archives: linguistics

Why Hypergraphs?

I’ve recently been hacking on creating a new parser for the Link Grammar theory of natural language parsing. I want to couple parsing to machine learning (ML), to that I can use ML to learn natural languages. To do that, I need to place everything in a certain abstract data representation framework that allows graph rewrite rules, logical reasoning, and Bayesian probabilistic reasoning to be combined. This framework exists in OpenCog, but few people know or understand this. That this framework also has a firm foundation in model theory, category theory (even n-categories!) and type theory is even less well known. To explain all this, I just wrote a simple, easy introduction to all of these ideas, and how they come together. Follow the link for more. Continue reading

Posted in Design, Introduction, Theory | Tagged , , , , , , , , , | 39 Comments

The Viterbi Parser

The new Viterbi decoder for Link Grammar should offer better integration with higher level semantic algorithms! Continue reading

Posted in Design, Development, Theory | Tagged , , , , , , | 3 Comments

Meaning-Text Theory

During some recent reading, it struck me that a useful framework for thinking about and talking about sentence generation is the MTT or “meaning-text theory” of Igor Mel’cuk, et al Here is one readable reference: Igor A. Mel’čuk and Alain … Continue reading

Posted in Theory | Tagged , , , , , , , , | Leave a comment

Semantic dependency relations

I spent the weekend comparing the Stanford parser to RelEx, and learned a lot. RelEx really does deserve to be called a “semantic relation extractor”, and not just a “dependency relation extractor”. It provides a more abstract, more semantic output … Continue reading

Posted in Design, Development, Documentation, Theory | Tagged , , , , , , , | Leave a comment

Frequency of grammatical disjuncts

The link-grammar parser uses labeled links to connect together pairs of words.  In order to capture the idea of proper grammatical construction, any given word is only allowed to have very specific links to its right or left: for example, … Continue reading

Posted in Development, Theory | Tagged , , , , , | 4 Comments

Distribution of Mutual Information

A bit of corpus linguistics is performed to examine the mutual information distribution of word pairs. Continue reading

Posted in Development, Theory | Tagged , , , , , , | 2 Comments