Jeffrey's divergence between autoregressive processes disturbed by additive white noises

摘要

Jeffrey’s divergence (JD), which is the symmetric version of the Kullback–Leibler divergence, has been used in a wide range of applications, from change detection to clutter homogeneity analysis in radar processing. It has been calculated between the joint probability density functions of successive values of autoregressive (AR) processes. In this case, the JD is a linear function of the variate number to be considered. Knowing the derivative of the JD with respect to the number of variates is hence enough to compare noise-free AR processes. However, the processes can be disturbed by additive uncorrelated white noises. In this paper, we suggest comparing two noisy 1st-order AR processes. For this purpose, the JD is expressed from the JD between noise-free AR processes and the bias the noises induce. After a transient period, the derivative of this bias with respect to the variate number becomes constant as well as the derivative of the JD. The resulting asymptotic JD increment is then used to compare noisy AR processes. Some examples illustrate this theoretical analysis.