Entropy

This chapter begins with the discussion of various meanings of the entropy: Boltzmann entropy, Shannon entropy, von Neumann entropy. It then presents the basic properties of the von Neumann entropy such as concavity, sub-additivity, strong sub-additivity, and continuity. It proves the existence of mean entropy for shift-invariant states on quantum spin chains, and then derives the expression for the mean entropy for quasi-free Fermions on a chain. The chapter defines the quantum relative entropy and presents its basic properties, including behaviour with respect to completely positive maps. The maximum entropy principle defines thermal equilibrium states (Gibbs states). This variational principle is illustrated by the Hartree–Fock approximation for a model of interacting Fermions. The entropy of an equilibrium state for a free quantum particle on a compact Riemannian manifold is also estimated. Finally, the notion of relative entropy is formulated in the algebraic setting using the relative modular operator.