Relations between the entropies, variational distance and Kullback Leibler distances of two distributions P={p/sub 1/,...,p/sub N/} and Q={q/sub 1/,...,q/sub N/} on the same alphabet A={a/sub 1/,...,a/sub N/}, are found. The concept of Renyi (1961) entropy is used to prove an inequality involving incomplete distributions, subject to a constraint.
展开▼
机译：两种分布的熵，变分距离和Kullback Leibler距离之间的关系P = {p / sub 1 /，...，p / sub N /}和Q = {q / sub 1 /，...，q / sub找到相同字母A = {a / sub 1 /，...，a / sub N /}上的N /}。 Renyi（1961）熵的概念用来证明不完全分布受不等式约束的不等式。
展开▼
