Convex Optimization. Mikhail Moklyachuk

      Note that the Lagrange multipliers are determined up to proportionality. If it is known that λ₀ ≠ 0, then we can choose λ₀ = 1. Then the number of equations and the number of unknowns are the same.

      Linear independence of the vectors of derivatives is the regularity condition that guarantees that λ₀ ≠ 0. However, verification of this condition is more complicated than direct verification of the fact that λ₀ cannot be equal to zero.

      Since the time of Lagrange, almost a century ago, the method of Lagrange multipliers has been used with λ₀ = 1, despite the fact that in the general case it is wrong.

As in the case of the unconstrained optimization problem, the stationary points of the constrained optimization problem need not be its solution. There also exist the necessary and sufficient conditions for optimality in terms of the second derivatives. Denote by

      the matrix of the second-order partial derivatives of the Lagrange function L (x, λ, λ₀).

      THEOREM 1.17.– Let the functions fi(x), i = 0,1, … , m be two times differentiable at a point and continuously differentiable in some neighborhood U of the point , and let the gradients be linearly independent. If is the point of local minimum of the problem [1.2], then

      for all λ, λ₀, satisfying the condition

      and all h ∈ ℝⁿ such that

      THEOREM 1.18.– Let the functions fi(x), i = 0, 1, … , m, be two times differentiable at a point ∈ ℝⁿ, satisfying the conditions

      Assume that for some λ, λ₀, the condition holds

      and, in addition,

      for all non-zero h ∈ ℝⁿ satisfying the condition

      Then is the point of local minimum of the problem [1.2].

      We can formulate the following rule of indeterminate Lagrange multipliers for solving constrained optimization problems with equality constraints:

      1 1) Write the Lagrange function

      2 2) Write the necessary conditions for the extremum of the function L, that is:

      3 3) Find the stationary points, that is, the solutions of these equations, provided that not all Lagrange multipliers λ0, λ1, … , λm are zero.

      4 4) Find a solution to the problem among the stationary points or prove that the problem has no solutions.

      1.4.2. Problems with equality and inequality constraints

      Let fi : ℝⁿ → ℝ be differentiable functions of n real variables. The constrained optimization problem with equality and inequality constraints is the following problem:

[1.3]

Скачать книгу