Major Changes and Attrition: An Information Theoretic and Statistical Examination of Cohort Features Stratified on Major Switches

摘要

Information Theory is a field derived from a seminal paper by Shannon discussing the uncertainty extant in communication channels. We cover the details in the theory section but this paper focuses on a measure known as the mutual information. This measure, derived from Shannon's information entropy - a measure of uncertainty in a random variable - is the information gained with respect to one random variable given knowledge of another. In a sense, this measures the dependency between two random variables.