A cultural appendix that connects probability to information. Entropy measures the “disorder” or the uncertainty of a random variable: the same formula describes the minimum average number of bits needed to identify an outcome and has the same structure as Boltzmann’s thermodynamic entropy. Claude Shannon introduced it in the 1940s as a measure of the average information transmitted by a probabilistic source.