Comments on approximating discrete probability distributions with dependence trees

摘要

C.K. Chow and C.N. Liu (1968) introduced the notion of three dependence to approximate a kth-order probability distribution. More recently, A.K.C. Wong and C.C. Wang (1977) proposed a different product approximation. The present authors show that the tree dependence approximation suggested by Chow and Liu can be derived by minimizing an upper bound of the Bayes error rate under certain assumptions. They also show that the method proposed by Wong and Wang does not necessarily lead to fewer misclassifications, because it is a special case of such a minimization procedure.