Global Optimization for Sparse Solution of Least Squares Problems - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année :

Global Optimization for Sparse Solution of Least Squares Problems

(1) , (1) , (2)


Finding solutions to least-squares problems with low cardinality has found many applications, including cardinality-constrained portfolio optimization, subset selection in Statistics, and many sparsity-enhancing inverse problems in signal processing. In general, this problem is NP-hard, and most works from a global optimization perspective consider a mixed integer programming (MIP) reformulation with binary variables, whose resolution is performed via branch-and-bound methods. We propose dedicated branch-and-bound algorithms for three possible formulations: cardinality-constrained and cardinality-penalized least-squares, and cardinality minimization under quadratic constraints. We show that the continuous relaxation problems involved at each node of the search tree are L1-norm-based optimization problems. A dedicated algorithm is built, based on the homotopy continuation principle , which efficiently computes the relaxed solutions for the three kinds of problems. The performance of the resulting global optimization procedure is then shown to compete with or improve over the CPLEX MIP solvers, especially for problems involving quadratic constraints. The proposed strategies are able to exactly solve some problems involving 500 to 1 000 unknowns in less than 1 000 seconds, for which CPLEX mostly fails.
Fichier principal
Vignette du fichier
benmhenni2019_HAL.pdf (384.51 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02066368 , version 1 (13-03-2019)


  • HAL Id : hal-02066368 , version 1


Ramzi Ben Mhenni, Sébastien Bourguignon, Jordan Ninin. Global Optimization for Sparse Solution of Least Squares Problems. 2019. ⟨hal-02066368⟩
262 Consultations
547 Téléchargements


Gmail Facebook Twitter LinkedIn More