Journal of the Operations Research Society of China ›› 2018, Vol. 6 ›› Issue (4): 571-586.doi: https://doi.org/10.1007/s40305-018-0202-x

Special Issue: Continuous Optimization

• Continuous Optimization • Previous Articles     Next Articles

A Preconditioned Conjugate Gradient Method with Active Set Strategy for 1-Regularized Least Squares

Wan-You Cheng1 · Dong-Hui Li2   

  1. 1 College of Computer, Dongguan University of Technology, Dongguan 523000, Guangdong,China
    2 School of Mathematical Sciences, South China Normal University, Guangzhou 510631, China
  • Online:2018-12-30 Published:2018-12-30
  • Supported by:

    This work is supported by the National Natural Science Foundation of China (No. 11371154), the Foundation for Distinguished Young Talents in Higher Education of Guangdong (No. 3XZ150603) and Characteristic innovation project of Guangdong (No. 2015KTSCX1).

Abstract:

In the paper, we consider the -regularized least square problem which has been intensively involved in the fields of signal processing, compressive sensing, linear inverse problems and statistical inference. The considered problem has been proved recently to be equivalent to a nonnegatively constrained quadratic programming (QP). In this paper, we use a recently developed active conjugate gradient method to solve the resulting QP problem. To improve the algorithm’s performance, we design a subspace exact steplength as well as a precondition technique. The performance comparisons illustrate that the proposed algorithm is competitive and even performs little better than several state-of-the-art algorithms.

Key words: Compressed sensing ·, l1-Regularized optimization ·, Conjugate gradient method ·, Precondition