Data Skeptic

[MINI] Entropy

Dec 16, 2016 · 16 min · 20.0 MB
0:00-16:36

Streams straight from the publisher. podnod never proxies or re-hosts episode audio.

Classically, entropy is a measure of disorder in a system. From a statistical perspective, it is more useful to say it's a measure of the unpredictability of the system. In this episode we discuss how information reduces the entropy in deciding whether or not Yoshi the parrot will like a new chew toy. A few other everyday examples help us examine why entropy is a nice metric for constructing a decision tree.