reckless intuitions of an epistemic hygienist (![[info]](http://l-stat.livejournal.com/img/userinfo.gif){kind=small} gustavolacerda) wrote,@ 2006-09-10 21:58:00 |
|
| Entry tags: | information_theory |
confusion about information theory
Much of my motivation to try to understand "semantic information theory" comes from shortcomings in distinguishing signal from noise.
How Could Information Equal Entropy?
If someone says that information = uncertainty = entropy, then they are confused, or something was not stated that should have been. Those equalities lead to a contradiction, since entropy of a system increases as the system becomes more disordered. So information corresponds to disorder according to this confusion.
Also, Information is not uncertainty shows related errors in published papers.
If I get the time, I should read Dretske's "On Semantic Information" and Floridi, Luciano (2005) - Is Information Meaningful Data?.
