Basic Background in Statistical Physics

摘要

In this section, we begin with some elementary background in statistical physics, and also relate some of the thermodynamic potentials, like entropy and free energy, to information measures, like the entropy and the Kullback-Leibler divergence.