Closed-Form Solution and Sparsity Path for Inverse Covariance Estimation Problem

摘要

regularization term in its objective function. The first goal of this work is to study the behavior of the optimal solution of Graphical Lasso as a function of its regularization coefficient. We show that if the number of samples is not too small compared to the number of parameters, the sparsity pattern of the optimal solution of Graphical Lasso changes gradually in terms of the regularization coefficient. More precisely, it is proved that each change in the sparsity pattern corresponds to the addition or removal of a single edge of the graph, under generic conditions. It is also shown that Graphical Lasso as a conic optimization problem has a closed-form solution if an acyclic graph is sought. This explicit formula also serves as an approximate solution for non-acyclic sparse graphs. The results are demonstrated on synthetic data and electrical systems.