On Efficiently Solving The Sub-problems Of A Level-set Method For Fused Lasso Problems

Xudong Li  Princeton University, Princeton

Defeng Sun The Hong Kong Polytechnic University, Hung Hom, Hong Kong

Kim Chuan Toh Department of Mathematics and Institute of Operations Research and Analytics, National University of Singapore

ABSTRACT

In applying the level-set method developed in [E. Van den Berg and M. P. Friedlander, SIAM J. Sci. Comput., 31 (2008), pp. 890–912] and [E. Van den Berg and M. P. Friedlander, SIAM J. Optim., 21 (2011), pp. 1201–1229] to solve the fused lasso problems, one needs to solve a sequence of regularized least squares sub-problems. In order to make the level-set method practical, we develop a highly efficient inexact semismooth Newton based augmented Lagrangian method for solving these sub-problems.
The efficiency of our approach is based on several ingredients that constitute the main contributions of this paper. First, an explicit formula for constructing the generalized Jacobian of the proximal mapping of the fused lasso regularizer is derived. Second, the special structure of the generalized Jacobian is carefully extracted and analyzed for the efficient implementation of the semismooth Newton method. Finally, numerical results, including the comparison between our approach and several state-of-the-art solvers, on real data sets are presented to demonstrate the high efficiency and robustness of our proposed algorithm in solving challenging large-scale fused lasso problems.