Some Remarks on the Definition of Boltzmann, Shannon and Kolmogorov Entropy

摘要

We give an alternative definition of Shannon and Kolmogorov-Sinai entropies based on the Boltzmann formula S = k log W. We prove the equivalence of those new definitions with the traditional ones using some tools from Information Theory such as information function and empirical entropy.