Least Squares Problems with Inequality Constraints as Quadratic Constraints

Jodi Mead, Rosemary A. Renaut

Research output: Contribution to journalArticlepeer-review

26 Scopus citations

Abstract

Linear least squares problems with box constraints are commonly solved to find model parameters within bounds based on physical considerations. Common algorithms include Bounded Variable Least Squares (BVLS) and the Matlab function lsqlin . Here, the goal is to find solutions to ill-posed inverse problems that lie within box constraints. To do this, we formulate the box constraints as quadratic constraints, and solve the corresponding unconstrained regularized least squares problem. Using box constraints as quadratic constraints is an efficient approach because the optimization problem has a closed form solution.

The effectiveness of the proposed algorithm is investigated through solving three benchmark problems and one from a hydrological application. Results are compared with solutions found by lsqlin , and the quadratically constrained formulation is solved using the L-curve, maximum a posteriori estimation (MAP), and the χ 2 regularization method. The χ 2 regularization method with quadratic constraints is the most effective method for solving least squares problems with box constraints.

Original languageAmerican English
Pages (from-to)1936-1949
Number of pages14
JournalLinear Algebra and Its Applications
Volume432
Issue number8
DOIs
StatePublished - 1 Apr 2010

Keywords

  • Box constraints
  • Linear least squares
  • Regularization

EGS Disciplines

  • Mathematics

Fingerprint

Dive into the research topics of 'Least Squares Problems with Inequality Constraints as Quadratic Constraints'. Together they form a unique fingerprint.

Cite this