Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's kind of ridiculous that Chomsky is #1. You can't deny it was influential. Chomsky singlehandedly split the linguistics field into two camps, and it's taken the better half of the century to put his ideas to rest.

He basically argued that all languages are governed by the same set of rules, that such rules were innate, and that languages could thus be parsed into trees. The problem arises that a lot of primitive languages don't even seem to support the notion of recursion, let alone something that parses to a syntax tree. And the statistical NLP folks have a major bone to pick with such ideas, because real language apparently isn't so clean.

What seems more plausible is that more advanced societies developed rules of logic that they then imposed on their communication, hence the property that well-written English ought to be pars-able to a syntax tree. But even then you have ambiguities in how the tree is structured.

http://en.wikipedia.org/wiki/Syntactic_ambiguity

The flip side is that Chomsky's framework hasn't been useless to science. You can do some interesting things if you can parse a piece of text's syntax tree with halfway decent accuracy. One example would be idiom-finding. If a word seems misplaced, or used out of its usual context (e.g. "kicked the bucket"), then it is likely an idiom. One could simply do an analysis using the frequencies of the words as they appear next to each other, but applying a filter on only those phrases that are likely to be idioms improves your results by quite a bit.



Did you just say Noam Chomsky is just a really good troll? He does seem fond of meeting his critics as having "virtually no comprehension of the work they are discussing", being "technically correct, but completely irrelevant", etc.


chomsky adulation within the academic community is a huge pet peeve of mine. the man is a hypocrite. he makes wide ranging commentary on fields he has no background in.


Ditto regarding the pet peeve, but I just don't like his attitude - I've repeatedly seen him be combative in completely unnecessary ways. Also, he uses complicated words when simple ones would do.


The idea that any language lacks recursion is firstly very poorly supported — the only person who actually thinks this is true and demonstrated by any real language is Daniel Everett who thinks Pirahã lacks recursion, but there's a wealth of argumentation over whether this is true or not (for starters see Nevins, Pesetsky, and Rodrigues's "Piraha Exceptionality: a Reassessment" for a good discussion on this). Secondly, it's not crucial to any contemporary, wide-spread notions of Universal Grammar that languages have recursion in their structure — the theory of Syntactic Structures does not suppose, or even depend upon, expressions having recursive tree structures, it merely hypothesizes that the grammatical processes of a language can only employ structural relationships (and syntactic types) to determine when they can or cannot apply, but this idea has long since fallen into the dustbin of history as ever more non-structural phenomena (features, binding, etc.) became relevant to the grammatical theory.

Second, there has yet to be a demonstration from any known language that the language actually does not have an underlying tree structure to it — even the most free word-order languages such as Warlpiri display evidence of tree structure. NLP people may have a major bone to pick with core Chomskyan theory because of the incredibly difficult in parsing using it, but Chomskyan linguistics isn't about designing computationally efficient means of parsing sentences, it's about developing a good scientific theory about the nature of the constraints on human grammars. And I say core Chomskyan theory above because NLP people actually love various less core Chomskyan theory (Head-driven Phrase Structure Grammar, for instance, which has plenty of work done on it in the parsing world; or Combinatory Categorial Grammar which has been looked at quite a lot in the computational literature). The fact that NLP people prefer other methods such as dependency grammars doesn't say anything about the theoretical framework Chomsky introduced any more than their preference for numerical methods of differentiation and integration in mathematics bears on the theoretical importance or validity of precise symbolic differentiation and integration. Or to rephrase that more concisely — just because your computer isn't powerful enough to calculate these equations doesn't make the equations wrong.

I don't know whether or not Chomsky should be #1 on this list, but I do know that you have no clue what you're talking about with regards to contemporary linguistic theory.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: