-
Recent Posts
Recent Comments
- Linas Vepstas on Everything is a Network
- Borislav Iordanov (@bolerio) on Everything is a Network
- Oleksandr Fedorov on Value Flows
- GAVIN MCCREADIE on Many Worlds: Reasoning about Reasoning
- Nil Geisweiller on Value Flows
Archives
- June 2021
- April 2020
- January 2019
- October 2018
- May 2018
- October 2017
- December 2016
- October 2016
- August 2016
- November 2015
- January 2014
- September 2013
- March 2013
- July 2012
- March 2012
- February 2012
- August 2011
- May 2011
- February 2011
- December 2010
- September 2010
- August 2010
- February 2010
- November 2009
- October 2009
- September 2009
- July 2009
- June 2009
- April 2009
- March 2009
- February 2009
- January 2009
- October 2008
- September 2008
- August 2008
- July 2008
- June 2008
- May 2008
Categories
Meta
Tag Archives: Natural Language Processing
Symbolic and Neural Nets: Two Sides of the Same Coin
Deep learning and neural nets are all the rage, today, and have displaced symbolic AI systems in most applications. It’s commonly believed that the two approaches have nothing to do with each other; that they’re just completely different, and that’s … Continue reading
Posted in Theory
Tagged Bayesian Network, dependency grammar, linguistics, link-grammar, Machine Learning, Natural Language Processing, Neural Network, NLP
1 Comment
Why Hypergraphs?
I’ve recently been hacking on creating a new parser for the Link Grammar theory of natural language parsing. I want to couple parsing to machine learning (ML), to that I can use ML to learn natural languages. To do that, I need to place everything in a certain abstract data representation framework that allows graph rewrite rules, logical reasoning, and Bayesian probabilistic reasoning to be combined. This framework exists in OpenCog, but few people know or understand this. That this framework also has a firm foundation in model theory, category theory (even n-categories!) and type theory is even less well known. To explain all this, I just wrote a simple, easy introduction to all of these ideas, and how they come together. Follow the link for more. Continue reading
Posted in Design, Introduction, Theory
Tagged dependency grammar, HyperGraphDB, Learning, linguistics, link-grammar, MachineLearning, Natural Language Processing, OpenCog, PLN, RelEx
40 Comments
The Viterbi Parser
The new Viterbi decoder for Link Grammar should offer better integration with higher level semantic algorithms! Continue reading
Posted in Design, Development, Theory
Tagged Code, dependency grammar, linguistics, link-grammar, Natural Language Processing, NLP, RelEx
3 Comments
Meaning-Text Theory
During some recent reading, it struck me that a useful framework for thinking about and talking about sentence generation is the MTT or “meaning-text theory” of Igor Mel’cuk, et al Here is one readable reference: Igor A. Mel’čuk and Alain … Continue reading
Posted in Theory
Tagged linguistics, Mel'cuk, MTT, Natural Language Generation, Natural Language Processing, NLP, RelEx, semantics, Syntax
Leave a comment
Semantic dependency relations
I spent the weekend comparing the Stanford parser to RelEx, and learned a lot. RelEx really does deserve to be called a “semantic relation extractor”, and not just a “dependency relation extractor”. It provides a more abstract, more semantic output … Continue reading
Posted in Design, Development, Documentation, Theory
Tagged dependency grammar, grammar, linguistics, Natural Language Processing, NLP, Rel, Semantic relations, Syntax
Leave a comment