Entropy, information, and computation

摘要

The relation between entropy, information, and randomness is discussed. Algorithmic information theory is introduced and used to provide a fundamental definition of entropy. The relation between algorithmic entropy and the usual Shannon-Gibbs entropy is discussed. (C) 1999 American Association of Physics Teachers. [References: 16]