5 More On Optimum Design Concepts:: Optimality Conditions
5 More On Optimum Design Concepts:: Optimality Conditions
5
More on Optimum Design Concepts:
Optimality Conditions
5.1_________________________________________________________________________________
Answer True or False.
1. A convex programming problem always has a unique global minimum point. False
2. For a convex programming problem, KKT necessary conditions are also sufficient. True
3. The Hessian of the Lagrange function must be positive definite at constrained minimum
points. False
4. For a constrained problem, if the sufficiency condition of Theorem 5.2 is violated, the
5. If the Hessian of the Lagrange function at x∗, ∇2L(x∗), is positive definite, the optimum
feasible directions in a neighborhood of x∗ along which the cost function reduces. True
5.2 _________________________________________________________________________________
Formulate the problem of Exercise 4.84. Show that the solution point for the problem is not a regular
point. Write KKT conditions for the problem, and study the implication of the irregularity of the
solution point. Refer to solution of Exercises 4.84:
The company manufactures gasoline and lube oil from the crudes. Yield and sale price barrel of the
product and markets are shown in Table E2.2. How much crude oils should the company use to
maximize its profit? Formulate the optimum design problem.
Solution
According to the graphical solution, the point P (20000, 10000) is the minimum point with
f* = -4,600,000.
( ) ( ) ( ) (
u3 A − 20,000 + s32 + u 4 B − 30,000 + s 42 + u 5 − A + s52 + u 6 − B + s62 )
∂L ∂A =−180 + 0.6u1 + 0.4u2 + u3 − u5 = 0
∂L ∂B =−100 + 0.8u1 + 0.2u2 + u 4 − u6 =0
g i + s=
2
i 0, ui s=i 0, ui ≥ 0; =i 1 to 6
There are 64 cases because we have six inequality constraints. We shall examine three cases. Two
of them yield solutions.
Case 1. u2 = u4 = u5 = u6 = 0, s1 = s3 = 0 . The solution is given as A = 20,000, B = 10,000,
u 1 = 125, u 3 = 105; s 2 = 0, so g 2 is also active.
Case 2. u= 3 u=4 u=5 u=
6 0, s=1 s=2 0 . The solution is given as A = 20,000, B = 10,000, u 1 =
The candidate minimum point derived in Case 1 and Case 2 can be verified graphically. It is seen
that (20000, 10000 ) is the optimum point. At this optimum point, g1 , g 2 and g 3 (constraints on
gasoline and lube oil markets, and limit on crude A) are all active. The optimum cost is
f = -4,600,000. . The optimum point is irregular, since there are three active constraints and two
design variables. The Lagrange multipliers are not unique.
5.4 _________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x1 , x2 ) = 4 x12 + 3x22 − 5 x1 x2 − 8 x1 subject to h = x1 + x2 − 4 = 0 ;
L = 4 x12 + 3x22 − 5 x1 x2 − 8 x1 + v(x1 + x2 − 4) ;
The necessary conditions give
∂ L ∂x1 = 8 x1 − 5 x2 − 8 + v = 0; ∂ L ∂x2 = 6 x2 − 5 x1 + v = 0; h = x1 + x2 − 4 = 0
The solution of these equations is x1 = 13 / 6, x 2 = 11 / 6, v = −1 / 6.
Therefore, (13/6, 11/6) is a KKT point; f = −25 / 3
Check for regularity: Ñh = (1, 1). Since Ñh is the only vector, regularity of feasible points is
satisfied.
Referring to Exercises 4.43/4.97, the point satisfying the KKT necessary conditions is
x 1 = 2.166667, x 2 = 1.833333, v = − 0.166667, f = -8.3333. This point also satisfies second order
sufficiency condition for a local minimum. Hessian of the Lagrangian function is calculated as
8 −5
𝐇𝐇 = � �
−5 6
The Hessian is positive definite since 𝑀𝑀1 = 8 > 0 𝑎𝑎𝑎𝑎𝑎𝑎 𝑀𝑀2 = 8 × 6 − (−5) × (−5) = 23 > 0.
Therefore it is positive definite for those d that satisfy ∇ℎ ∙ 𝐝𝐝 = 0. Therefore the KKT point satisfies
second order necessary and sufficient conditions for a local minimum point.
The problem is solved graphically in Exercise 3.12. The graphical solution confirms this conclusion.
5.5 _________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Maximize F (x1 , x 2 ) = 4 x12 + 3x 22 − 5 x1 x 2 − 8 x1 subject to h = x1 + x2 − 4 = 0 ;
L = −4 x12 − 3x 22 + 5 x1 x 2 + 8 x1 + v(x1 + x 2 − 4) ;
The necessary conditions give
∂ L ∂x1 =−8 x1 + 5 x2 + 8 + v =0; ∂ L ∂x2 =−6 x2 +5 x1 + v =0; h =x1 + x2 − 4 =0
The solution of these equations is x1 = 13 / 6, x 2 = 11 / 6, v = 1 / 6.
Therefore, (2.166667, 1.833333) is a KKT point; F = −25 / 3
Check for regularity: Ñh = (1, 1). Since Ñh is the only vector, regularity of feasible points is
satisfied.
Referring to Exercises 4.44/4.98, the point satisfying the KKT necessary conditions is
x 1 = 2.166667, x 2 = 1.833333, v = 0.166667. However this point violates second order necessary
condition. Hessian of the Lagrangian function is calculated as
−8 5
𝐇𝐇 = � �
5 −6
The Hessian is negative definite since 𝑀𝑀1 = −8 < 0 𝑎𝑎𝑎𝑎𝑎𝑎 𝑀𝑀2 = −8 × −6 − (5) × (5) = 23 > 0.
Therefore it is negative definite for those d that satisfy ∇ℎ ∙ 𝐝𝐝 = 0. Therefore the point violates
the second order necessary conditions for a local minimum of f(x), or for the local maximum of F(x).
There is no maximum point for F(x).
The problem is solved graphically in Exercise 3.12. The graphical solution confirms this conclusion.
5.6 _________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x1 , x2 ) = ( x1 − 2 ) + ( x2 + 1) subject to h= 2 x1 + 3 x2 − 4 =
2 2
0;
L = ( x1 − 2 ) + ( x2 + 1) + v ( 2 x1 + 3 x2 − 4 ) ;
2 2
Referring to Exercises 4.45/4.99, the point satisfying the KKT necessary conditions is
x 1 = 2.46154, x 2 = -0.307692, v = -0.46154, f = 0.69231. The point satisfies second order
sufficiency condition.
5.7 _________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize 𝑓𝑓(𝑥𝑥1 , 𝑥𝑥2 ) = 4𝑥𝑥12 + 9𝑥𝑥22 + 6𝑥𝑥2 − 4𝑥𝑥1 + 13 subject to h = 𝑥𝑥1 − 3𝑥𝑥2 + 3 = 0;
𝐿𝐿 = 4𝑥𝑥12 + 9𝑥𝑥22 + 6𝑥𝑥2 − 4𝑥𝑥1 + 13 + 𝜈𝜈(𝑥𝑥1 − 3𝑥𝑥2 + 3)
The KKT necessary conditions give
∂L ∂L ∂L
= 8𝑥𝑥1 − 4 + 𝜈𝜈 = 0, = 18𝑥𝑥2 + 6 − 3𝜈𝜈 = 0, = 𝑥𝑥1 − 3𝑥𝑥2 + 3 = 0
∂𝑥𝑥1 ∂𝑥𝑥2 ∂𝜈𝜈
The solution of these equations is 𝑥𝑥1 = −0.4, 𝑥𝑥2 = 2.6/3, 𝜈𝜈 = 7.2
Therefore, (-0.4, 2.6/3) is a KKT point; 𝑓𝑓 = 27.2
Check for regularity: Ñh = (1,-3). Since Ñh is the only vector, regularity of feasible points is
satisfied.
Referring to Exercises 4.46/4.100, the point satisfying the KKT necessary conditions is
x 1 = -0.4, x 2 = 0.866667, v = 7.2, f = 27.2. The point satisfies second order sufficiency condition.
5.8 _________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
f ( x1 , x2 ) = ( x1 − 1) + ( x2 + 2 ) + ( x3 − 2 ) h1= 2 x1 + 3 x2 − 1 ;
2 2 2
Minimize subject to h2=
x1 + x2 + 2 x3 − 4
L = ( x1 − 1) + ( x2 + 2 ) + ( x3 − 2 ) + v1 ( 2 x1 + 3 x2 − 1) + v2 ( x1 + x2 + 2 x3 − 4 ) ;
2 2 2
Referring to Exercises 4.47/4.101, the point satisfying the KKT necessary conditions is
x 1 = 1.71698, x 2 = -0.81132, x 3 = 1.54714, v1 = -0.943396, v2 = 0.4528299, f = 2.11318. The point
satisfies second order sufficiency condition.
5.9 _________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize ( )
f x1 , x2 = 9 x12 + 18 x1 x2 + 13x22 − 4 subject to h = x12 + x22 + 2 x1 − 16 = 0
L ( x1 , x2 , v )= 9 x12 + 18 x1 x2 + 13 x22 − 4 + v ( x12 + x22 + 2 x1 − 16 )
∂L ∂x=
1 18 x1 + 18 x2 + 2vx1 + 2v= 0; ∂L ∂x2= 18 x1 + 26 x2 + 2vx=
1 0;
h = x12 + x22 + 2 x1 − 16 = 0
These equations are nonlinear, which can be solved numerically. Using any nonlinear equation
solver, we can find the following KKT points:
1. x1 = 1.5088, x2 = 3.2720, v = −17.151503, f = 244.528
2. x1 = 2.5945, x2 = −2.0198, v = −1.4390, f = 15.291
3. x1 = −3.630, x2 = −3.1754, v = −23.2885, f = 453.154
4. x1 = −3.7322, x2 = 3.0879, v = −2.1222, f =37.877
5.10 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f = ( x1 − 1) + ( x2 − 1) subject to h = x1 + x2 − 4 = 0
2 2
∂L ∂x1 = 2 ( x1 − 1) + v = 0; ∂L ∂x2 = 2 ( x2 − 1) + v = 0; h = x1 + x2 − 4 = 0
Solution of these equations is x1 = 2, x2 = 2, v = −2 . Therefore, (2, 2 ) is a KKT point; f = 2.
Check for regularity: Ñh = (1, 1) . Since Ñh is the only vector, regularity of feasible points is
satisfied.
5.11 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f = 4 x1 + 3 x2 − 5 x1 x2 − 8 subject to
2 2
h = x1 + x2 − 4 = 0
L= 4 x12 + 3x22 − 5 x1 x2 − 8 + v ( x1 + x2 − 4 ) ; the KKT necessary conditions are
∂L ∂x1 = 8 x1 − 5 x2 + v = 0; ∂L ∂x2 = 6 x2 − 5 x1 + v = 0; h = x1 + x2 − 4 = 0
Solution of these equations is x1 = 11/ 6, x2 = 13 / 6, v = −23 / 6 .
Therefore, (11/ 6, 13 / 6 ) is a KKT point; f* = -1/3.
Check for regularity: Ñh = (1, 1) . Since Ñh is the only vector, regularity of feasible point is
satisfied.
Referring to Exercises 4.51/4.105, the point satisfying the KKT necessary conditions is
x 1 = 1.83333, x 2 = 2.16667, v = -3.83333, f = -0.33333. The point satisfies second order sufficiency
condition. The sufficiency check is same as in Exercise 5.5.
5.12 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f =
−4 x1 − 3x2 + 5 x1 x2 + 8 subject to
2 2
h = x1 + x2 − 4 = 0
L =−4 x12 − 3x22 + 5 x1 x2 + 8 + v ( x1 + x2 − 4 )
The KKT necessary conditions are
∂L ∂x1 =−8 x1 + 5 x2 + v =0; ∂L ∂x2 =−6 x2 + 5 x1 + v =0; h =x1 + x2 − 4 =0
=
Solution of these equations =
is x1 11/ 6, x2 13= / 6, v 23 / 6 .
Therefore, (11/ 6, 13 / 6 ) is a KKT point; F = -1/3.
Check for regularity: Ñh = (1, 1) . Since Ñh is the only vector, regularity of feasible point is
satisfied.
Referring to Exercises 4.52/4.106, the point satisfying the KKT necessary conditions is
x 1 = 1.83333, x 2 = 2.16667, v = 3.83333, f = 0.33333. This point violates second order necessary
condition. The check for the second order conditions is the same as in Exercise 5.6. F(x) has no
maximum points.
5.13 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f =
−4 x1 − 3x2 + 5 x1 x2 + 8 subject to
2 2
g = x1 + x2 − 4 ≤ 0
L =−4 x12 − 3 x22 + 5 x1 x2 + 8 + u ( x1 + x2 − 4 + s 2 ) ; the KKT necessary conditions are
∂L ∂x1 =−8 x1 + 5 x2 + u =0; ∂L ∂x2 =−6 x2 + 5 x1 + u =0;
∂L ∂u = x1 + x2 − 4 + s 2 = 0; ∂L ∂s = 2us = 0
Referring to Exercises 4.54/4.107, the points satisfying the KKT necessary conditions are:
x 1 = 0, x 2 = 0, u = 0; x 1 = 1.83333, x 2 = 2.16667, u = 3.83329. Both points violate second order
necessary condition. The check for the second order conditions is the same as in Exercise 5.6. F(x)
has no maximum points.
5.14 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f = 4 x1 + 3 x2 − 5 x1 x2 − 8 subject to
2 2
g = x1 + x2 − 4 ≤ 0
L= 4 x12 + 3 x22 − 5 x1 x2 − 8 + u ( x1 + x2 − 4 + s 2 ) ; the KKT necessary conditions are
∂L ∂x1 = 8 x1 − 5 x2 + u = 0; ∂L ∂x2 = 6 x2 − 5 x1 + u = 0;
∂L ∂u = x1 + x2 − 4 + s 2 = 0; ∂L ∂s = 2us = 0
Referring to Exercises 4.55/4.108, the point satisfying the KKT necessary condition are:
x 1 = 0, x 2 = 0, u = 0. The point satisfies second order sufficiency condition.
5.15 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f =
−4 x1 − 3x2 + 5 x1 x2 + 8 x1 subject to
2 2
g = x1 + x2 − 4 ≤ 0
L= 4 x12 + 3 x22 − 5 x1 x2 − 8 x1 + u ( x1 + x2 − 4 + s 2 ) ; the KKT necessary conditions are
∂L ∂x1 =−8 x1 + 5 x2 + 8 + u =0; ∂L ∂x2 =−6 x2 + 5 x1 + u =0;
∂L ∂u = x1 + x2 − 4 + s 2 = 0; ∂L ∂s = 2us = 0
Referring to Exercises 4.56/4.109, the points satisfying the KKT necessary conditions are:
x 1 = 2.08696, x 2 = 1.73913, u = 0; x 1 = 2.16667, x 2 = 1.83333, u = 0.16667. Both points violate
second order necessary condition.
5.16 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x ) = ( x1 − 1) + ( x2 − 1) ; subject to
2 2
h = x1 − x2 − 2 = 0; g =− x1 − x2 + 4 ≤ 0 .
L= ( x1 − 1) + ( x2 − 1) + v ( x1 − x2 − 2 ) + u ( − x1 − x2 + 4 + s 2 )
2 2
∂L ∂x1= 2 ( x1 − 1) + v − u= 0; ∂L ∂x2= 2 ( x2 − 1) − v − u= 0
h = x1 − x2 − 2 = 0; -x1 − x2 + 4 + s 2 = 0; us = 0, u ≥ 0.
Case 1. u = 0; no candidate minimum.
Case 2. s = 0; gives ( 3, 1) as a KKT point with v =
−2, u =
2, f =
4.
h (1, − 1) and Ñg =
Since Ñ= ( −1, -1) are linearly independent, regularity is satisfied.
Referring to Exercises 4.57/4.110, the point satisfying the KKT necessary condition is:
x 1 = 3, x 2 = 1, ν = -2, u = 2. The point satisfies second order sufficiency condition.
5.17 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x ) = ( x1 − 1) + ( x2 − 1) ; subject to
2 2
h = x1 + x2 − 4 = 0; g =− x1 + x2 + 2 ≤ 0 .
L= ( x1 − 1) + ( x2 − 1) + v ( x1 + x2 − 4 ) + u ( − x1 + x2 + 2 + s 2 )
2 2
∂L ∂x=
1 2 ( x1 − 1) + v − u= 0; ∂L ∂x2= 2 ( x2 − 1) + v + u= 0
h = x1 + x2 − 4 = 0; -x1 + x2 + 2 + s 2 = 0; us = 0, u ≥ 0.
Case 1. u = 0; no candidate minimum.
Case 2. s = 0; gives ( 3, 1) as a KKT point with v =
−2, u =
2, f =
4.
5.18 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x ) = ( x1 − 1) + ( x2 − 1) ; subject to
2 2
g1 =− x1 − x2 + 4 ≤ 0; g 2 =− x1 + x2 + 2 ≤ 0 .
L= ( x1 − 1) + ( x2 − 1) + u1 ( − x1 − x2 + 4 + s12 ) + u2 ( − x1 + x2 + 2 + s22 )
2 2
5.19 _______________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x, y ) = ( x − 4 ) + ( y − 6 ) ;
2 2
subject to g1 = x + y − 12 ≤ 0;
g 2 =− x + 6 ≤ 0 ;
g3 =− y ≤ 0
L =( x − 4 ) + ( y − 6 ) + u1 ( x + y − 12 + s12 ) + u2 ( − x + 6 + s22 ) + u3 ( − y + s32 )
2 2
∂L ∂x= 2 ( x − 4 ) + u1 − u=
2 0;
y 2 ( y − 6 ) + u1 − u=
∂L ∂= 3 0
x + y − 12 + s12 =0;
− x + 6 + s22 =0;
− y + s32 =0
=
u1s1 0,= =
u2 s2 0, u3 s3 0
u1 , u2 , u3 ≥ 0.
Case 1. u=1 u=
2 u=3 0 ; no candidate minimum.
Case 2. u=1 u=
2 0, s=3 0 ; no candidate minimum.
Case 3. u=1 u=
3 0, s=2 0 ; gives ( 6, 6 ) as a KKT=
point with u2 4,=
s1 =0, s3 =6, f 4 .
Case 4. u=
2 u=3 0, s=1 0 ; no candidate minimum.
Case 5. u=1 0, s=2 s=
3 0 ; no candidate minimum.
Case 6. u=2 0, s=1 s= 3 0 ; no candidate minimum.
Case 7. u=3 0, s=1 s= 2 0 ; gives ( 6, 6 ) as a KKT point with=
u1 0,=
u2 4,=
s3 6,=
f 4.
Case 8. s=
1 s=2 s=3 0 ; no candidate minimum.
Referring to Exercises 4.60/4.108, the point satisfying the KKT necessary condition is:
x = 6, y = 6, u 1 = 0, u 2 = 4, u 3 = 0. The point satisfies second order sufficiency condition.
5.20 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x ) = 2 x1 + 3x2 − x13 − 2 x22 ;
subject to g1 = x1 + 3x2 − 6 ≤ 0;
g2 =5 x1 + 2 x2 − 10 ≤ 0; g3 =− x1 ≤ 0; g 4 =− x2 ≤ 0;
( ) ( ) (
L = 2 x1 + 3x2 − x13 − 2 x22 + u1 x1 + 3 x2 − 6 + s12 + u2 5 x1 + 2 x2 − 10 + s22 )
( ) (
+ u3 − x1 + s32 + u4 − x2 + s42 )
∂L ∂x1 = 2 − 3x12 + u1 + 5u2 − u3 = 0;
∂L ∂x2 = 3 − 4 x2 + 3u1 + 2u2 − u4 = 0;
x1 + 3x 2 − 6 + s12 = 0 ; 5 x1 + 2 x 2 − 10 + s 22 = 0 ; − x1 + s32 = 0; − x 2 + s 42 = 0 ;
u i si = 0 ; u i ≥ 0 ; i = 1 to 4 (there are 16 cases).
Case 1. u1 = u2 = u3 = u4 = 0 .There are two possible solution points: (− 0.816, 0.75) and
(0.816, 0.75) . For (− 0.816, 0.75) , g 3 = 0.816 > 0 (violation). For (0.816, 0.75) , g 1 = − 2.934 < 0,
g 2 = − 4.42 < 0, g 3 = − 0.816 < 0, g 4 = − 0.75 < 0. All the KKT conditions are satisfied; therefore
(0.816,0.75) is a KKT point ( f = 2.214 ).
Case 2. u1 = u2 = u3 = 0, s4 = 0 . g 4 =0 → x2 =0 ; x = ± 0.816, u 4 = 3 > 0. x1 =
1
− 0.816 → g3 > 0
(violated). At x 1 = 0.816 and x 2 = 0, g1 = −5.184 < 0, g 2 = −5.92 < 0. All the KKT conditions
are satisfied; therefore (0.816, 0 ) is a KKT point (f = 1.0887).
Case 3. u1 = u2 = u4 = 0, s3 = 0 . KKT point: (0, 0.75) , u 3 = 2, f = 1.125.
Case 4. u1 = u3 = u4 = 0, s2 = 0 . Candidate points: (− 9.8407, 1.2317 ) and (1.5073, 1.2317 ) ; first
point violates g 3 ; the second point is a KKT point with u 2 = 0.9632; f = 0.251.
Case 5. u2 = u3 = u4 = 0, s1 = 0. Candidate points: (− 1.821, 1.655) and (1.0339, 1.655) ; first point
violates g 3 ; second is a KKT point with u 1 = 1.2067; f = 0.4496.
Case 6. u1 = u2 = 0, s3 = s4 = 0; (0, 0) is a KKT point with u 3 = 2 and u 4 = 3; f = 0.
Case 7. u1 = u3 = 0, s2 = s4 = 0; gives (2, 0) as a KKT point with u 2 = 2, u 4 = 7; f = − 4.
Check for regularity: For cases 1, 2, 3, 4 and 5, there is only one active constraint, so regularity is
satisfied. For case 6, Ñg3 = ( 0, − 1) . Since
( −1, 0 ) , Ñg 4 = Ñg3 and Ñg 4 are linearly independent,
regularity is satisfied. For case 7, Ñg=2 ( 5, 2 ) , Ñg=
4 ( 0, − 1) . Since Ñg 2 and Ñg 4 are linearly
independent, regularity is satisfied. For case 10, Ñg1 = (1, 3) , Ñg3 = ( −1, 0 ) . Since Ñg1 and Ñg3
are linearly independent, regularity is satisfied. For case 11, Ñg1 = (1, 3) , Ñg 2 = ( 5, 2 ) . Since Ñg1
and Ñg 2 are linearly independent regularity is satisfied.
Referring to Exercises 4.61/4.114, the points satisfying the KKT necessary conditions are
5.21 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x ) = 4 x12 + 3x22 − 5 x1 x2 − 8 x1; subject to x1 + x2 − 4 ≤ 0 .
( )
L (x, u ) = 4 x12 + 3x 22 − 5 x1 x 2 − 8 x1 + u x1 + x 2 − 4 + s 2
∂L ∂x1 = 8 x1 − 5 x 2 − 8 + u = 0 ; ∂L ∂x 2 = 6 x 2 − 5 x1 + u = 0 ;
Referring to Exercises 4.62/4.115, the point satisfying the KKT necessary conditions is:
= x1∗ 2=.0870, x2∗ 1= .7391, u1∗ 0 .
The constraint function is linear and the Hessian of cost function is positive definite. Therefore this
is a convex programming problem and from Theorem 4.11, the point is an isolated global minimum.
5.22 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x1 , x2 ) = x12 + x22 − 4 x1 − 2 x2 + 6 ; subject to g =− x1 − x2 + 4 ≤ 0 .
(
L = x12 + x 22 − 4 x1 − 2 x 2 + 6 + u − x1 − x 2 + 4 + s 2 )
∂L ∂x 1 = 2 x1 − 4 − u = 0 ; ∂L ∂x 2 = 2 x 2 − 2 − u = 0
− x1 − x2 + 4 + s=
2
0; us= 0, u ≥ 0
Case 1. u = 0; gives no candidate point s 2 = −1 .
Case 2. s = 0; gives (2.5, 1.5) as a KKT point with u = 1 and f = 1.5. Since only one constraint is
active, regularity is satisfied.
5.23 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x ) = 2 x12 − 6 x1 x2 + 9 x22 − 18 x1 + 9 x2 , subject to g1 = x1 + 2 x2 − 10 ≤ 0,
g2 =4 x1 − 3x2 − 20 ≤ 0, g3 = − x1 ≤ 0, g 4 = − x2 ≤ 0 .
There are 16 cases, but only the case u=1 u=
3 u=
4 0, s=
2 0 yields a solution:
(6.3, 1.733), u 2 = 0.8 , f = −56.901 .
Since only one constraint is active, regularity is satisfied.
5.24________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x1 , x2 ) = ( x1 − 1) + ( x2 − 1) , subject to
2 2
g1 = x1 + x2 − 4 ≤ 0
(
L = (x1 − 1) + (x2 − 1) + u1 x1 + x2 − 4 + s12
2 2
)
∂L ∂x1 = 2(x1 − 1) + u1 = 0 ;
∂L ∂x 2 = 2(x 2 − 1) + u1 = 0 ;
x1 + x 2 − 4 + s12 = 0 ; u1 s1 = 0 ; u1 ≥ 0
Case 1. u1 = 0, gives (1, 1) as a KKT point ( f = 0 ) . Since no constraint is active, regularity is
satisfied.
Case 2. s1 = 0; gives no candidate point.
5.25________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x ) = ( x1 − 1) + ( x2 − 1) ; subject to
2 2
g1 = x1 + x2 − 4 ≤ 0; g 2 = x1 − x2 − 2 ≤ 0 .
( ) (
L = (x1 − 1) + (x 2 − 1) + u1 x1 + x 2 − 4 + s12 + u 2 x1 − x 2 − 2 + s 22
2 2
)
∂L ∂x1 = 2(x1 − 1) + u1 + u 2 = 0 ; ∂L ∂x 2 = 2(x 2 − 1) + u1 − u 2 = 0
x1 + x 2 − 4 + s12 = 0 ; x1 − x 2 − 2 + s 22 = 0 ;
u1 s1 = 0 , u 2 s 2 = 0 ; u1 ≥ 0, u 2 ≥ 0
Case 1. u1 = 0, u 2 = 0 ; gives (1, 1) as a KKT point, f = 0
Case 2. u1 = 0, s 2 = 0 ; no candidate minimum.
Case 3. s1 = 0 , u 2 = 0 ; no candidate minimum.
Case 4. s1 = 0 , s 2 = 0 ; no candidate minimum.
Only the first case gives a solution that satisfies all the KKT necessary conditions. Since no
constraint is active, regularity is satisfied.
5.26 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x ) = ( x1 − 1) + ( x2 − 1) ; subject to: g1
2 2
= x1 + x2 − 4 ≤ 0; g 2 = 2 − x1 ≤ 0 .
( ) (
L = (x1 − 1) + (x 2 − 1) + u1 x1 + x 2 − 4 + s12 + u 2 2 − x1 + s 22
2 2
)
∂L ∂x1 = 2 (x1 − 1) + u1 − u 2 = 0 ; ∂L ∂x 2 = 2 (x 2 − 1) + u1 = 0
x1 + x 2 − 4 + s12 = 0 ; 2 − x1 + s 22 = 0 ; u1s1 = 0 , u 2 s2 = 0 , u1 ≥ 0 , u 2 ≥ 0
u1 s1 = 0 ; u 2 s 2 = 0 ; u1 ≥ 0, u 2 ≥ 0
5.27 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x1 , x2 ) = 9 x12 − 18 x1 x2 + 13x22 − 4 , subject to g1 = 16 − ( x12 + x22 + 2 x1 ) ≤ 0 .
(
L = 9 x12 − 18 x1 x 2 + 13x 22 − 4 + u1 16 − x12 − x 22 − 2 x1 + s12 )
∂L ∂x1 = 18 x1 − 18 x 2 − 2u1 x1 − 2u1 = 0; ∂L ∂x 2 = −18 x1 + 26 x 2 − 2u1 x 2 = 0
x1 + x2 − 4 + s12 = 0; 2 − x1 + s22 = 0 ; u s = 0 ,
1 1 u 2 s2 = 0 , u1 ≥ 0 , u 2 ≥ 0
Referring to Exercise 4.68/4.121, the points satisfying the KKT necessary conditions are
x1∗ x2∗ u∗
(1) 2.5945 2.0198 1.4390
(2) − 3.630 3.1754 23.2885
(3) 1.5088 − 3.2720 17.1503
(4) − 3.7322 − 3.0879 2.1222
=
1. At point (1), x1 2.=
5945, x2 2= .0198, u 1.4390, Ñ 2 L is positive definite. It follows from
Theorem 5.3 that the point is an isolated local minimum.
3. At point (3), x1 =
1.5088, x2 =
−3.2720, u =
17.1503;
−16.3006 −18
Ñ2 L =
−18 −8.3006
Let d = (d1 , d 2 ) . We need to find d such that Ñg1 ⋅ d = 0. This gives d = c (1, 0.7667 ) where c ≠ 0 is
( )
any constant. Q = d T Ñ 2 L d = − 48.7811 c 2 < 0. So, sufficient condition is not satisfied at this point.
It cannot be a local minimum since it violates second order necessary condition.
4. At point (4), x1 =
−3.7322, x2 =
−3.8790, u =
2.1222,
13.7556 −18
Ñ2 L =
−18 21.7556
Ñg1 ⋅ d = 0 gives d = c (1, − 0.8848
= ) . Q d=
T
( )
Ñ 2 L d 62.6402 c 2 > 0. The sufficient condition is
satisfied. Thus, the point is an isolated minimum point.
5.28 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x ) = (x1 − 3) + (x2 − 3) ; subject to h = x1 − 3x2 − 1 = 0; g = x1 + x2 − 4 ≤ 0 .
2 2
(
L = (x1 − 3) + (x2 − 3) + v ≤ (x1 − 3x2 − 1) + u x1 + x2 − 4 + s 2
2 2
)
∂L ∂x1 = 2(x1 − 3) + v + u = 0 ; ∂L ∂x 2 = 2(x 2 − 3) + 3v + u = 0
h = x1 − 3x2 − 1 = 0; x1 + x2 − 4 + s 2 = 0; us = 0, u ≥ 0.
Case 1. u = 0; no candidate minimum s < 0 . ( 2
)
Case 2. s = 0; gives (3.25, 0.75) as a KKT point with v = −1.25, u = 0.75, f = 5.125 .
Since Ñ=
h (1, − 3) and Ñg = (1, 1) are linearly independent, regularity is satisfied.
Referring to Exercise 4.69/4.122, the point satisfying the KKT necessary conditions is
x1∗ = 3.25, x2∗ = −3.8790, u = 0.75, v = − 1.25.
The Hessian of cost function is positive definite and both the constraints are linear. Therefore, this is
a convex problem. It follows from Theorem 4.11 that the point is an isolated global minimum.
5.29 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x1 , x2 ) = x13 − 16 x1 + 2 x2 − 3x22 , subject to g = x1 + x2 − 3 ≤ 0 .
(
L = x13 − 16 x1 + 2 x2 − 3x22 + u x1 + x2 − 3 + s 2)
∂L ∂x1 = 3x12 − 16 + u = 0; ∂L ∂x2 = 2 − 6 x2 + u = 0; x1 + x2 − 3 + s 2 =0;=
u g 0, u ≥ 0.
( ) ( )
Case 1. u = 0; gives 4 3 , 1 3 , f = −24.3 and − 4 3 , 1 3 , f = 24.967 , as KKT points.
Case 2. s = 0; gives (0, 3) , u = 16, f = − 21 ; (2, 1) , u = 4, f = −25, as KKT points.
For both cases, there is only one active constraint; so, regularity is satisfied.
Referring to Exercise 4.70/4.123, the points satisfying the KKT necessary conditions are
x1∗ x2∗ u∗
(1) 2.3094 0.3333 0
(2) − 2.3094 0.3333 0
(3) 0 3 16
(4) 2 1 4
12 0
4. At point (4), x1 = 2, x2 = 1, u = 4, Ñ 2 L = .
0 −6
Ñg ⋅ d = 0 gives d = c (1, − 1) where c ≠ 0 is any constant.
= Q d=
T
( )
∇ 2 L d 6c 2 > 0, for c ≠ 0. Since
Q > 0, sufficient condition is satisfied. Thus the point is an isolated local minimum point.
5.30 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f (x1 , x2 ) = 3x12 − 2 x1 x2 + 5 x22 + 8 x2 , subject to g = x12 − x22 + 8 x2 − 16 ≤ 0
(
L = 3x12 − 2 x1 x2 + 5 x22 + 8 x2 + u x12 − x22 + 8 x2 − 16 + s 2 )
∂L ∂x1 = 6 x1 − 2 x 2 + 2ux1 = 0 ; ∂L ∂x 2 = −2 x1 + 10 x 2 + 8 − 2ux 2 + 8u = 0.
x12 − x 22 + 8 x 2 − 16 + s 2 ≤ 0 ; us = 0 , u ≥ 0
Case 1. u = 0; gives (− 2 7 , − 6 7 ) as a KKT point ( f = − 24 7 ) .
Case 2. s = 0; no candidate minima (u < 0 ) .
For case 1, since there is no active constraint, the regularity is satisfied.
Referring to Exercise 4.71/4.124, the point satisfying the KKT necessary condition is
x1∗ =− 0.2857, x2∗ = − 0.8571, u ∗ =0.
The Hessian of Lagrangian is positive definite. The sufficient condition is satisfied and the point is
an isolated local minimum.
5.31 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x, y ) = ( x − 4 ) + ( y − 6 ) ; subject to g1 = x + y − 12 ≤ 0;
2 2
g 2 =x − 6 ≤ 0; g3 =− x ≤ 0; g 4 =− y ≤ 0;
L= (( x − 4) 2
+ ( y − 6)
2
) + u ( x + y −12 + s ) + u ( x − 6 + s )
1
2
1 2
2
2
( ) (
+u3 − x + s32 + u4 − y + s42 )
∂L ∂x= 2 ( x − 4 ) + u1 + u2 − u3 = 0; ∂L ∂y= 2 ( y − 6 ) + u1 − u4 = 0;
x + y − 12 + s12 = 0; x − 6 + s22 = 0; − x + s32 = 0; − y + s42 = 0;
u i si = 0 ; u i ≥ 0 ; i = 1 to 4 (there are 16 cases).
Check for regularity: Only the first case gives a solution that satisfies all the KKT necessary
conditions. Since no constraint is active, regularity is satisfied.
Referring to Exercise 4.72/4.125, the point satisfying the KKT necessary condition is
=x 4= , y 6= , u 0.
The constraint functions are linear and the Hessian of cost function is positive definite. Therefore
this is a convex programming problem and from Theorem 4.11, the point is an isolated global
minimum.
5.32 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x, y ) = ( x − 8 ) + ( y − 8 ) ; subject to g1 = x + y − 12 ≤ 0;
2 2
g 2 =x − 6 ≤ 0; g3 =− x ≤ 0; g 4 =− y ≤ 0;
L= ( ( x − 8) 2
+ ( y − 8)
2
) + u ( x + y −12 + s ) + u ( x − 6 + s )
1
2
1 2
2
2
( ) (
+u3 − x + s32 + u4 − y + s42 )
∂L ∂x= 2 ( x − 8 ) + u1 + u2 − u3 = 0; ∂L ∂y= 2 ( y − 8 ) + u1 − u4 = 0;
x + y − 12 + s12 = 0; x − 6 + s22 = 0; − x + s32 = 0; − y + s42 = 0;
u i si = 0 ; u i ≥ 0 ; i = 1 to 4 (there are 16 cases).
Check for regularity: For case 5, there is only one active constraint, so regularity is satisfied. For
case 11, Ñg1 = (1, 1) , Ñg 2 = (1,0 ) . Since Ñg1 and Ñg 2 are linearly independent regularity is
satisfied.
Referring to Exercise 4.73/4.126, the point satisfying the KKT necessary condition is
=x 6= , y 6 ,= u1 4= , u2 0=
, u3 0= , u4 0 .
The constraint functions are linear and the Hessian of cost function is positive definite. Therefore
this is a convex programming problem and from Theorem 4.11, the point is an isolated global
minimum.
5.33 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( x, y ) =− ( x − 4 ) − ( y − 6 ) ; subject to g1 =x + y − 12 ≤ 0;
2 2
g 2 =x − 6 ≤ 0; g3 =− x ≤ 0; g 4 =− y ≤ 0;
(
L = − ( x − 4) − ( y − 6)
2 2
) + u ( x + y −12 + s ) + u ( x − 6 + s )
1
2
1 2
2
2
( ) (
+ u3 − x + s32 + u4 − y + s42 )
−2 ( x − 4 ) + u1 + u2 − u3 =
∂L ∂x = 0;
∂L ∂y =−2 ( y − 6 ) + u1 − u4 =0;
x + y − 12 + s12 =0;
x − 6 + s22 =0;
− x + s32 =0;
− y + s42 =0;
u i si = 0 ; u i ≥ 0 ; i = 1 to 4 (there are 16 cases).
Case 1. u= 1 u= 2 u=3 u=4 0; gives ( 4, 6 ) as a KKT point ; F = 0 .
Case 2. u= 1 u= 2 u=3 0, s=
4 0; gives ( 4, 0 ) as a KKT point with u 4 =12; F = 36 .
Case 3. u= 1 u= 2 u=4 0, s=
3 0; gives ( 0, 6 ) as a KKT point with u 3 =8; F = 16 .
Case 4. u=1 u=3 u=
4 0, s=
2 0; gives ( 6, 6 ) as a KKT point with u 2 = 4; F = 4 .
Case 5. u= 2 u= 3 u=4 0, s=1 0; gives ( 5, 7 ) as a KKT point with u 1 = 2; F = 2 .
Case 6. u1 = u2 = 0, s3 = s4 = 0; gives ( 0, 0 ) as a KKT point with u 3 = 8 and u 4 = 12; F = 52 .
Case 7. u1 = u3 = 0, s2 = s4 = 0; gives ( 6, 0 ) as a KKT point with u 2 = 4, u 4 = 12; F = 40 .
Case 8. u1 = u4 = 0, s2 = s3 = 0; gives no candidate point.
Case 9. u2 = u3 = 0, s1 = s4 = 0; gives no candidate point.
Case 10. u=
2 u= 4 0, s= 1 s= 3 0; gives ( 0, 12 ) as a KKT point with u 1 = 12, u 3 = 20; F = 52 .
Check for regularity: For cases 1, 2, 3, 4 and 5, there is only one active constraint, so regularity is
( −1, 0 ) , Ñg 4 =
satisfied. For case 6, Ñg3 = ( 0, − 1) . Since Ñg3 and Ñg 4 are linearly independent,
regularity is satisfied. For case 7, Ñg=2 (1, 0 ) , Ñg=
4 ( 0, − 1) . Since Ñg 2 and Ñg 4 are linearly
independent, regularity is satisfied. For case 10, Ñg1 = (1, 1) , Ñg3 = ( −1, 0 ) . Since Ñg1 and Ñg3
are linearly independent, regularity is satisfied. For case 11, Ñg1 = (1, 1) , Ñg 2 = (1, 0 ) . Since Ñg1
and Ñg 2 are linearly independent regularity is satisfied.
Refer to Exercise 4.74/4.127. There are seven points that satisfy the KKT necessary conditions.
Only the points (0, 0) and (6, 0) are the local maximum points. Others violate second order
sufficiency conditions.
5.34 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( r , t ) =− ( r − 8 ) − ( t − 8 ) ; subject to g1 =r + t − 10 ≤ 0;
2 2
g 2 =t − 5 ≤ 0; g3 =−r ≤ 0; g 4 =−t ≤ 0;
L= (
− ( r − 8) − ( t − 8)
2 2
) + u ( r + t −10 + s ) + u (t − 5 + s )
1
2
1 2
2
2
( ) (
+u3 − r + s32 + u4 −t + s42 )
∂L ∂r =−2 ( r − 8 ) + u1 − u3 =0; ∂L ∂t =−2 ( t − 8 ) + u1 + u2 − u4 =0;
r + t − 10 + s12 = 0; t − 5 + s22 = 0; − r + s32 = 0; − t + s42 = 0;
u i si = 0 ; u i ≥ 0 ; i = 1 to 4 (there are 16 cases).
Case 1. u= 1 u= 2 u=3 u=4 0; gives no candidate point.
Case 2. u=1 u=2 u=3 0, s=4 0; gives ( 8, 0 ) as a KKT point with u 4 = 16; F = 64 .
Case 3. u= 1 u=2 u=4 0, s=3 0; gives no candidate point.
Case 4. u=1 u=3 u=4 0, s=2 0; gives no candidate point.
Case 5. u= 2 u= 3 u= 4 0, s=1 0; gives no candidate point.
Case 6. u1 = u2 = 0, s3 = s4 = 0; gives ( 0, 0 ) as a KKT point with u 3 = 16, u 4 = 16; F =128.
Case 7. u1 = u3 = 0, s2 = s4 = 0; gives no candidate point.
Case 8. u1 = u4 = 0, s2 = s3 = 0; gives no candidate point.
Case 9. u2 = u3 = 0, s1 = s4 = 0; gives (10, 0 ) as a KKT point with u 1 = 4, u 4 = 20; F =68.
Case 10. u=2 u=4 0, s=1 s=3 0; gives no candidate point.
Case 11. u3 = u4 = 0, s1 = s2 = 0; gives no candidate point.
Case 12. u1 = 0, s2 = s3 = s4 = 0; gives no candidate point.
Case 13. u2 = 0, s1 = s3 = s4 = 0; gives no candidate point.
Case 14. u3 = 0, s1 = s2 = s4 = 0 ; gives no candidate point.
Arora, Introduction to Optimum Design, 4e 5-38
Chapter 5 More on Optimum Design Concepts: Optimality Conditions
Check for regularity: For cases 2, there is only one active constraint, so regularity is satisfied. For
( −1, 0 ) , Ñg 4 =
case 6, Ñg3 = ( 0, − 1) . Since
Ñg3 and Ñg 4 are linearly independent, regularity is
1 (1, 1) , Ñg=
satisfied. For case 9, Ñg= 4 ( 0, − 1) . Since Ñg1 and Ñg 4 are linearly independent,
regularity is satisfied.
Refer to Exercise 4.75/4.128. There are three points that satisfy the KKT necessary conditions. Only
the points (0, 0) and (10, 0) are the local maximum points.
5.35 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( r , t ) =− ( r − 3) − ( t − 2 ) ; subject to g1 =r + t − 10 ≤ 0;
2 2
g 2 =t − 5 ≤ 0; g3 =−r ≤ 0; g 4 =−t ≤ 0;
L= (
− ( r − 3) − ( t − 2 )
2 2
) + u ( r + t −10 + s ) + u (t − 5 + s )
1
2
1 2
2
2
( ) (
+u3 − r + s32 + u4 −t + s42 )
∂L ∂r =−2 ( r − 3) + u1 − u3 =0; ∂L ∂t =−2 ( t − 2 ) + u1 + u2 − u4 =0;
r + t − 10 + s12 = 0; t − 5 + s22 = 0; − r + s32 = 0; − t + s42 = 0;
u i si = 0 ; u i ≥ 0 ; i = 1 to 4 (there are 16 cases).
Case 1. u= 1 u= 2 u=3 u=4 0; gives ( 3, 2 ) as a KKT point ; F = 0.
Case 2. u=1 u=2 u=3 0, s=4 0; gives ( 3, 0 ) as a KKT point with u 4 = 0; F = 4 .
Case 3. u= 1 u=2 u=4 0, s=3 0; gives ( 0, 2 ) as a KKT point with u 3 = 6; F = 9 .
Case 4. u=1 u=3 u=4 0, s=2 0; gives ( 3, 5) as a KKT point with u 2 = 6; F = 9 .
Case 5. u=
2 u=3 u=
4 0, s=1 0; gives ( 5.5, 4.5 ) as a KKT point with u 1 = 5; F = 12.5 .
Case 6. u1 = u2 = 0, s3 = s4 = 0; gives ( 0, 0 ) as a KKT point with u 3 = 6, u 4 = 4; F =13.
Case 7. u1 = u3 = 0, s2 = s4 = 0; gives no candidate point.
Case 8. u1 = u4 = 0, s2 = s3 = 0; gives ( 0, 5) as a KKT point with u 2 = 6, u 3 = 6; F = 18 .
Case 9. u2 = u3 = 0, s1 = s4 = 0; gives (10, 0 ) as a KKT point with u 1 = 14, u 4 = 18; F =53.
Case 10. u=
2 u= 4 0, s= 1 s= 3 0; gives no candidate point.
Check for regularity: For cases 1, 2, 3, 4 and 5, there is only one active constraint, so regularity is
( −1, 0 ) , Ñg 4 =
satisfied. For case 6, Ñg3 = ( 0, − 1) . Since Ñg3 and Ñg 4 are linearly independent,
regularity is satisfied. For case 8, Ñg 2 = ( 0, 1) , Ñg3 = ( −1,0 ) . Since Ñg 2 and Ñg3 are linearly
independent, regularity is satisfied. For case 9, Ñ= g1 (1, 1) , Ñ= g 4 ( 0, − 1) . Since Ñg1 and Ñg 4
are linearly independent, regularity is satisfied. For case 11, Ñg1 = (1, 1) , Ñg 2 = ( 0, 1) . Since Ñg1
and Ñg 2 are linearly independent regularity is satisfied.
Refer to Exercise 4.76/4.129. There are nine points that satisfy the KKT necessary conditions. Only
the points (0, 0), (0, 5), (10, 0) and (5, 5) are the local maximum points. Others violate second order
sufficiency conditions.
5.36 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( r , t ) =− ( r − 8 ) − ( t − 8 ) ; subject to g1 =r + t − 10 ≤ 0;
2 2
g 2 =r ≤ 0; g3 =−t ≤ 0;
(
L = − ( r − 8) − ( t − 8)
2 2
) + u ( r + t −10 + s ) + u ( −t + s )
1
2
1 2
2
2
(
+u3 r + s32 )
∂L ∂r =−2 ( r − 8 ) + u1 + u3 =0; ∂L ∂t =−2 ( t − 8 ) + u1 + u2 =0;
r + t − 10 + s12 = 0; − t + s22 = 0; r + s32 = 0;
u i si = 0 ; u i ≥ 0 ; i = 1 to 3 (there are 8 cases).
Case 1. u=1 u=
2 u=
3 0 ; no candidate minimum.
Case 2. u=1 u=2 0, s=3
0 ; no candidate minimum.
Case 3. u=1 u=3 0, s=
0 ; no candidate minimum.
2
Refer to Exercise 4.77/4.130. There are no points that satisfy the KKT necessary conditions.
5.37 ________________________________________________________________________________
Solve the following problem graphically. Check necessary and sufficient conditions for candidate
local minimum points and verify them on the graph for the problem.
Solution
Minimize f ( r , t ) =− ( r − 3) − ( t − 2 ) ; subject to g1 =r + t − 10 ≤ 0;
2 2
( ) (
+u3 − r + s32 + u4 −t + s42 )
∂L ∂r =−2 ( r − 3) + u1 − u3 =0; ∂L ∂t =−2 ( t − 2 ) + u1 − u2 − u4 =0;
r + t − 10 + s12 = 0; − t+5 + s22 = 0; − r + s32 = 0; − t + s42 = 0;
u i si = 0 ; u i ≥ 0 ; i = 1 to 4 (there are 16 cases).
Check for regularity: For cases 4, there is only one active constraint, so regularity is satisfied. For
case 10, Ñg1 = (1, 1) , Ñg3 = ( −1, 0 ) . Since Ñg1 and Ñg3 are linearly independent regularity is
satisfied.
Refer to Exercise 4.78/4.131. There are two points that satisfy the KKT necessary conditions; (3, 5)
and (0, 10). Only the point (0, 100) is a local maximum point.
5.38 ________________________________________________________________________________
Rewrite the formulation of Exercise 2.23, the problem is written in the standard form as (note that
some of the data used here is different from that used in Exercise 2.23):
( )
Minimize f = 12.331 Ro2 − Ri2 , subject to = ( ) ( )
g1 6.3662 × 106 Ro Ro4 − Ri4 − 2.5 × 104 ≤ 0
= (
g 2 4244.132 Ro2 + Ro Ri + Ri2 ) (R
4
o )
− Ri4 − 9000 ≤ 0,
g3 =
Ro − 20 ≤ 0; g 4 =
Ri − 20 ≤ 0; g 5 =
− Ro ≤ 0; g 6 =
− Ri ≤ 0;
1. Check for necessary conditions. Since at the optimum only g1 and g 3 are active, we can assume
u2 = u4 = u5 = u6 = 0 and s1 = s3 = 0.
The KKT necessary conditions are
∂L
= 24.662 Ro + ( 2.5 × 104 ) u1 254.648 ( Ro4 − Ri4 ) − 254.648 Ro ( 4 Ro3 ) ( Ro4 − Ri4 ) + u3 =0
2
(1)
∂Ro
∂L
−24.662 Ri + ( 2.5 × 104 ) u1 −254.648 Ro ( −4 Ri3 ) ( Ro4 − Ri4 ) =
2
= 0 (2)
∂Ri
gi + si2= 0, ui s=
i 0, ui ≥ 0; =
i 1 to 6
Substituting the optimum value into (1) and (2), we get u1 = 3.5596 × 10 −3 > 0, u3 = 5.29 > 0. The other
conditions are obviously satisfied. Thus the point Ro∗ = −20, Ri∗ = 19.84 satisfies all of the necessary
conditions.
2. Check for sufficient condition. Since this is the case that the number of active constraints equals
the number of design variables, the point is indeed an isolated local minimum.
5.39 ________________________________________________________________________________
Rewriting the formulation of Exercise 2.24, we have
Minimize f = 1.44086 Rt , subject to
= g1 7957.7 Rt − 250 ≤ =
0 ; g 2 767.8 R 2 − 3 ≤ 0;
g3 = 20 − R t ≤ 0; g 4 = 20 − R ≤ 0; g5 = R − 200 ≤ 0; g 6 = 1 − t ≤ 0; g 7 = t − 10 ≤ 0
The optimum solutions found by the graphical method are the points on g 1 between ( 31.83 , 1.0 ) and
( 25.23, 1.26 ) , where f ∗ = 45.9 and g 1 is active.
5.40________________________________________________________________________________
Rewrite the formulation of Exercise 3.28, we have
Minimize f = 50.077 R t + 0.1885 ( R + t 2 ) , subject to g1 =25 − 25.038 ( R − t 2 ) ≤ 0 ;
2 2
1. Check for necessary conditions. Since only g 1 and g 2 are active, we can set u3 = u4 = u5 = 0 and
s1 = s2 = 0.
L = 50.077 Rt + 0.1885 ( R + t 2 ) + u1 25 − 25.038 ( R + t 2 ) + u2 ( 3.5 R t − 210 )
2 2
∂L ∂=R 50.077t + 0.377 ( R + t 2 ) − 2u1 ( 25.038 )( R + t 2 ) + u2 ( 3.5 t=) 0 (1)
∂L = (
∂t 50.077 R + 0.1885 ( R + t 2 ) + u1 ( 25.038 )( R + t 2 ) − u2 3.5 R t=
2
0 ) (2)
gi + si2= 0, ui s=
i 0, ui ≥ 0 ; i = 1 to 5 (3)
Substituting the optimum value into (1) and (2);
1.216434 − 1.9833 =
u1 + u 2 0, 50.267074 + 0.99165=
u1 − 60u 2 0
Solving for u1 and u2 , we get u1 = 0.0417 > 0 (o.k.), u2 = 4.080 × 10 −3 > 0 (o.k.). All the other
conditions in (3) are satisfied. Therefore, the point ( R ∗ = 1.0m, t ∗ = 0.0167m) satisfies all of the
necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
design variables, the point ( R ∗ = 1.0, t ∗ = 0.0167) is indeed a local minimum.
5.41 ________________________________________________________________________________
Referring to the formulation of Exercise 4.80, we have
Minimize f = 2.4662 ×105 R t , subject=
to g1 795.775 Rt − 2.5 × 108 ≤ 0 ;
g 2 =5 × 104 − 6.5113 × 1010 R 3t ≤ 0 ; g3 =R t − 50 < 0 ; g 4 =− R ≤ 0 ; g5 =−t ≤ 0
=
The optimum solution found by the graphical method is R∗ 0=
.0787, t ∗ 0.00157,
= f ∗ 30.56 kg;
where g 2 and g 3 are active.
1. Check for necessary conditions. Since only g 2 and g 3 are active, we can set u1 = u4 = u5 = 0 and
s2 = s3 = 0. The KKT necessary conditions are
∂L = ( )( )
∂R 2.4662 × 105 t + u2 −6.5113 × 1010 3R 2 t + u3 (1= t) 0 (1)
( ) ( )
∂L ∂t = 2.4662 × 105 R + u2 − 6.5113 × 1010 R 3 + u3 − R t 3 = 0 (2)
gi + si=
2
0, ui s=
i 0, ui ≥ 0; =i 1 to 5 (3)
Substituting the optimum value into (1) and (2), we get
u2 = 3.056 × 10 −4 > 0, u3 = 0.3038 > 0 (o.k.).
(
All of the other constraints in (3) are also satisfied. Thus, the point R ∗ = 0.0787, t ∗ = 0.00157 )
satisfies the necessary conditions.
2. Check for sufficient condition. Since this is the case that the number of active constraints is equal
to the number of design variables, the point is indeed an isolated local minimum.
5.42 ________________________________________________________________________________
Referring to the formulation of Exercise 4.81, we have
( )
Minimize f = 1.2331 × 105 Ro2 − Ri2 , subject to = (
g1 1.59155×104 Ro2 − Ri2 − 2.5 × 108 ≤ 0; )
g 2 =×
5 10 − 1.62783 × 10
4 10
(R
4
o −R i
4
) ≤ 0; g3 =0.5 ( Ro + Ri ) − 50 ≤ 0; g 4 =− Ro ≤ 0; g5 =− Ri ≤ 0
=
The optimum solution found by the graphical method is Ro∗ 0=
.0795, Ri∗ 0=
.0779 , f * 30.56 kg
where g 2 and g 3 are active.
1. Check for necessary conditions. Since only g 2 and g 3 are active, we can set u1 = u4 = u5 = 0, and s 2
and s 3 = 0.
( ) ( )
L= 1.2331 × 105 Ro2 − Ri2 + u2 5 × 104 − 1.62783 × 1010 Ro4 − Ri4 + u3 0.5 ( Ro + Ri ) ( Ro + Ri ) − 50
The KKT necessary conditions are
∂L = ( ) ( )( )
∂Ro 2.4662 × 105 Ro + u2 − 1.62783 × 1010 4 Ro3 + u3 − Ri ( Ro − R= i)
2
0 (1)
∂L ∂Ri = ( ) ( )( )
− 2.4662 × 105 Ri + u2 1.62783 × 1010 4 Ri3 + u3 Ro ( Ro − Ri ) =
2
0 (2)
gi + si2= 0, ui s=
i 0, ui ≥ 0 ; i = 1 to 5 (3)
Substituting the optimum value into (1) and (2), we get
u2 = 3.056 × 10 −4 > 0, u3 = 0.3055 > 0 (o.k.).
point Ro∗ 0=
All other conditions in (3) are satisfied. Thus, the= .0795, Ri∗ 0.0779 satisfies the
necessary conditions.
2. Check for sufficient condition. Since this is the case that the number of active constraints is equal
to the number of design variables, the point is indeed a local minimum. Sufficient condition is
deemed satisfied at this point.
5.43________________________________________________________________________________
Referring to Exercise 4.79, we have
Minimize f = π DH + π D 2 2 , subject to g=
1 400 − π D 2 H 4 ≤ 0; g=
2 3.5 − D ≤ 0;
g3 = D − 8 ≤ 0; g 4 = 8 − H ≤ 0; g5 = H − 18 ≤ 0
The optimum solution found by the graphical method is= H ∗ 8,= D∗ 7.98,= f ∗ 300.6 cm 2 where
g 1 and g 4 are active.
1. Check for necessary conditions. Since only g 1 and g 4 are active, we can set u2 = u3 = u5 = 0 and
s 1 = s 4 = 0.
( )
L = π DH + π D 2 2 + u1 400 − π D 2 H 4 + u4 ( 8 − H )
The KKT necessary conditions are
( )
∂L ∂D = π H + π D + u1 ( −π DH 2 ) = 0; ∂L ∂H = π D + u1 −π D 2 4 − u4 = 0
gi + s = 0, ui s=
2
i i 0, ui ≥ 0 ; i = 1 to 5
Substituting the optimum value into equations, we get u 1 = 0.5 > 0, u 4 = 0.063 > 0 (o.k.). All the
other conditions in (3) are also satisfied. Thus, the point (H ∗ = 8, D ∗ = 7.98) satisfies the necessary
conditions.
2. Check for sufficient condition. Since this is the case that the number of active constraints is equal
to the number of design variables, the point is indeed local minimum point.
5.44 ________________________________________________________________________________
Rewriting the formulation of Exercise 4.83, we have
Minimize f = 0.6h + 0.001A , subject to g1 = 20,000 − hA 3.5 ≤ 0;
g 2 =0.25 hA 3.5 + A − 10,000 ≤ 0; g3 =3.5 − h ≤ 0; g 4 =h − 21 ≤ 0; g5 =− A ≤ 0
The graphical optimum solution is A∗ = 5,000, h∗ = 14, f ∗ = 13.4, where g 1 and g 2 are active.
2. Check for sufficient condition. Since the number of constraints active at the candidate point and
the number of design variables are the same, the point is indeed a local minimum point.
5.45 ________________________________________________________________________________
Rewriting the formulation of Exercise 3.34, we have
( ) ( )
Minimize f = 3.083 × 10 −3 x12 1 − x22 , subject to g1= 5.093 × 107 x13 1 − x24 − 275 ≤ 0;
=
g 2 6.36619 × 105 x14 (1 − x ) − 3.49066 × 10
4
2
−2
≤ 0; g3 = 2.0 × 107 − ( 4.17246 × 10 ) x (1 − x )
4 3
1 2
2.5
≤ 0;
g 4 = 20 − x1 ≤ 0; g5 = x1 − 500 ≤ 0; g 6 = 0.6 − x2 ≤ 0; g 7 = x2 − 0.999 ≤ 0
is x1∗ 103,
The optimum solution obtained by the graphical method= = x2∗ 0.955,
= f ∗ 2.9 where g 1
and g 3 are active.
1. Check for necessary conditions. Since only g 1 and g 3 are active, we can set u 2 = u 4 = u 5 = u 6 = u 7
= 0.
( ) (
L= 3.083 × 10−3 x12 1 − x22 + u1 5.093 × 107 x13 1 − x24 − 275 )
( )
+ u3 2.0 × 107 − 4.17246 × 104 x13 (1 − x2 )
2.5
The KKT necessary conditions are
∂L ∂= ( ) (
x1 6.166 × 10−3 x1 1 − x22 + u1 −3 5.093 × 107 x14 1 − x24 ) ( )
( )( )
+u3 − 4.17246 × 104 3 x12 (1 − x2 ) =
2.5
0 (1)
( )
∂L ∂x2 =−6.166 × 10−3 x12 x2 + u1 4 5.093 × 107 x23 x13 1 − x24 ( )
2
( )( )
+u3 − 4.17246 × 104 3 x12 (1 − x2 ) =
2.5
0 (2)
gi ≤ 0, ui gi =0, ui ≥ 0 ; i = 1 to 7 (3)
−3
Substituting the optimum values into (1) and (2), respectively, we get u1 = 4.568 × 10 > 0,
u3 3.332 × 10− 8 > 0 (o.k.). All the other conditions in (3) are also satisfied. Therefore, the point
=
(x∗
1 )
= 103, x2∗ = 0.955 satisfies all of the necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
( )
design variables, the point x1∗ = 103, x2∗ = 0.955 is indeed a local minimum point.
5.46 ________________________________________________________________________________
Rewriting the formulation of Exercise 3.35, we have
(
Minimize f = 3.083 × 10 −3 d o2 − d i2 , subject to g=
1 ) (
5.093 × 107 d o d o4 − di4 − 275 ≤ 0; ) ( )
g=
2 ( 6.3662 × 10 ) ( d − d ) − 3.49066 × 10
5 4
o i
4 −2
≤ 0;
= 2.0 × 10 − ( 4.17246 × 10 ) d (1 − d d )
2.5
g3 7 4 3
o i o ≤ 0; g 4 = 20 − d o ≤ 0;
g5 =d o − 500 ≤ 0; g 6 =0.6 − di d o ≤ 0; g 7 =di d o − 0.999 ≤ 0;
The optimum solution obtained by the graphical method is d o∗ = 103, d i∗ = 98.36, f ∗ = 2.9 where g1
and g 3 are active.
1. Check for necessary conditions. Since only g1 and g 3 are active, we can set u2 = u4 = u5 = u6 = u7
= 0.
( ) (
L = 3.083 × 10−3 do2 − di2 + u1 5.093 × 107 do do2 − di2 − 275
) ( )
( )
+ u3 2.0 × 107 − 4.17246 × 104 do3 (1 − di do )
2.5
The KKT necessary conditions are
(
) ( ) ( )
2
∂L ∂d= o 6.166 × 10−3 do + u1 5.093 × 107 1 do4 − di4 − 4do do4 − di4
( )( )
− u3 4.17246 × 104 3do2 (1 − di do ) + 2.5 ( di do )(1 − di do ) =
2.5 1.5
0 (1)
( ) ( )( )
2
∂L ∂di =− 6.166 × 10−3 di + u1 5.093 × 107 do 4di3 do4 − di4
(
)
+u3 4.17246 × 104 ( 2.5 ) d02 (1 − di do ) =
1.5
0 (2)
gi ≤ 0, ui gi = 0, ui ≥ 0 ; i = 1 to 7 (3)
Substituting the optimum values into (1) and (2) respectively, we get
u 1 = 4.657 × 10 −3 > 0,=u3 3.281 × 10−8 > 0 (o.k.).
All the other conditions in (3) are also satisfied. Therefore, the point obtained from graphic method
satisfies all of the necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
( )
design variables, the point d o∗ = 103, d i∗ = 98.36 is indeed an isolated local minimum point. The
sufficient condition is deemed satisfied at this point.
5.47 ________________________________________________________________________________
Rewriting the formulation of Exercise 3.36, we have
Minimize f = 0.02466 R t , subject to g=
1 ( 3.1831× 106 ) ( 2R + t ) ( 4R3t + Rt 3 ) − 275 ≤ 0;
(
g 2 = 3.97886 × 104 ) ( 4 R t + Rt ) − 3.49066 × 10
3 3 −2
( )
≤ 0; g3 = 2.0 × 107 − 3.37972 × 105 ( R + 0.5t ) t 2.5 ≤ 0;
0.5
g 4 = 50 − R ≤ 0; g5 = R − 200 ≤ 0; g 6 = 2 − t ≤ 0; g 7 = t − 40 ≤ 0
The optimum solution obtained by the graphical method is R ∗ = 50.3, t ∗ = 2.34, f ∗ = 2.9 where g 1
and g 3 are active.
1. Check for necessary conditions. Since only g 1 and g 3 are active, we can set
u=2 u=4 u=
5 u=
6 u=
7 0.
( )
L= 0.02466 Rt + u1 3.1831 × 106 ( 2 R + t ) 4 R 3t + Rt 3 ( )
( )
+u3 2.0 × 107 − 3.37972 × 105 ( R + 0.5t ) t 2.5
0.5
The KKT necessary conditions are
( ) ( )
L ∂R 0.02466t + u1 3.1831 × 106 2 4 R 3t + Rt 3 − ( 2 R + t ) 12 R 2 + t 3 4 R 3t + Rt 3 ( )( )
2
∂=
( )
− u3 3.37972 × 105 ( 12 ) t 2.5 ( R + 0.5t ) =
0.5
0 (1)
( ) ( )
∂L ∂t 0.02466 R + u1 3.1831 × 106 1 4 R 3t + Rt 3 − ( 2 R + t ) 4 R 3 + 3Rt 2 4 R 3t + Rt 3 ( )( )
2
=
( )
− u3 3.37972 × 105 ( 14 ) t 2.5 ( R + 0.5 t ) + 2.5t1.5 ( ) ( R + 0.5 t ) 0.5
=
0 (2)
gi ≤ 0, ui gi =0, ui ≥ 0 ; i = 1 to 7 (3)
−3
Substituting the optimum value into (1) and (2) respectively, we obtain u 1 = 4.643 × 10 > 0, u 3 =
3.240 × 10 −8 > 0 (o.k.). All the other conditions in (3) are also satisfied. Therefore, the point obtained
from graphical method satisfies all the necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
( )
design variables, the point R ∗ = 50.3, t ∗ = 2.34 is indeed an isolated local minimum point. The
sufficient condition is deemed satisfied at this point.
5.48 ________________________________________________________________________________
Referring to the formulation of Exercise 3.54, we have
( ) , subject to
Minimize f = 6.59734 − 10 −3 D 2 H 2 + 4800 ) ( 12
( )( ) ( ) ( )
1
g 2 =2.0 × 104 H 2 + 4800 2
H − 1.816774 × 106 D 4 H 2 + 4800 ≤ 0;
g3 = H − 500 ≤ 0; g 4 = 50 − H ≤ 0; g5 = D − 50 ≤ 0; g 6 = 0.5 − D ≤ 0 .
=
The optimum solution obtained by the graphical method is H ∗ 50,
= D∗ 3.42,
= f ∗ 6.6 , where g 2
and g 4 are active.
1. Check for necessary conditions. Since only g 2 and g 4 are active, we can set u1 = u3 = u5 = u6 = 0
and s2 = s4 = 0 .
( ) ( )
1
L= 6.59734 × 10−3 D 2 H 2 + 4800 2
+
( )( ) ( ) ( )
1
u2 2.0 × 104 H 2 + 4800 2 H − 1.816774 × 106 D 4 H 2 + 4800 + u4 ( 50 − H )
The KKT necessary conditions are
( ) ( ) ( )
1
=∂L ∂D 0.0131947 D H 2 + 4800 2+ u −7.267096 × 106 D3 =
H 2 + 4800 0 (1)
2
( ) ( ) ( )( )
1 1
∂L
= ∂H 6.59734 × 10−3 D 2 H H 2 + 4800 2 + u2 − 2.0 × 104 H 2 + 4800 2 H 2
2
( )( ) ( ) ( )
1
+ 2.0 × 104 H 2 + 4800 2 + 3.633548 × 106 D 4 H H 2 + 4800 − u4 = 0 (2)
gi + si2= 0, ui s=
i 0, ui ≥ 0 ; i = 1 to 6 (3)
−5 −2
Substituting the optimum value into (1) and (2), we get u2 = 9.68 × 10 > 0,=
u4 4.68 × 10 >0 (o.k.)
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
(
design variables, the point H ∗ = 50, D ∗ = 3.42 is indeed an isolated local minimum point. The )
sufficient condition is deemed satisfied at this point.
5.49 ________________________________________________________________________________
Answer True or False.
1. Candidate minimum points for a constrained problem that do not satisfy second-order
2. Lagrange multipliers may be used to calculate the sensitivity coefficient for the cost
function with respect to the right side parameters even if Theorem 4.7 cannot be used.
True
3. Relative magnitudes of the Lagrange multipliers provide useful information for practical
5.50 ________________________________________________________________________________
A circular tank that is closed at both ends is to be fabricated to have a volume of 250π m3. The
fabrication cost is found to be proportional to the surface area of the sheet metal needed for fabrication
of the tank and is $400/m2. The tank is to be housed in a shed with a sloping roof which limits the height
of the tank by the relation H≤8D, where H is the height and D is the diameter of the tank. The problem is
3. Solve KKT necessary conditions for local minimum points. Check sufficient conditions
4. What will be the change in cost if the volume requirement is changed to 255π m3 in place
of 250π m3?
=
Minimize ( )
f 400 0.5π D 2 + π DH , subject to h1 = πD 2 H 4 − 250π = 0; g1 = H − 8 D ≤ 0
( )
∂L ∂H = 400π D + v1 π D 2 4 + u1 = 0 (2)
h1 =0, g1 ≤ 0, u1 g1 =0 and u1 ≥ 0
4. Change in cost.
Applying the constraint variation sensitivity theorem, we get the cost increase as
Δf = − u1e1 =160 ( 225 p − 250 p ) = 800 p
5.51 ________________________________________________________________________________
A symmetric (area of member 1 is the same as area of member 3) three-bar truss problem is
1. Formulate the minimum mass design problem treating A 1 and A 2 as design variables.
4. Solve the optimum design problem using the data: P=50 kN, θ=30°, ρ=7800 kg/m3,
σa=150 MPa. Verify the solution graphically and interpret the necessary conditions on
5. What will be the effect on the cost function if σa is increased to 152 MPa?
4. Solve the design problem. Use Newton, meter and kilogram as units for force, length and mass
respectively.
P = 50 kN = 5× 10 4 N, σ a = 150 MPa = 1.5 × 108 N/m2, q = 30°, ρ = 7800 kg/m3,
l = 1 m, s1 = P cos q =4.330127 × 104 N, s2 =
P sin q =
2.5 × 104 N
Substituting the above values we have:
Minimize f = 7.8 × 103 2 2 A1 + A2 ( )
Arora, Introduction to Optimum Design, 4e 5-58
Chapter 5 More on Optimum Design Concepts: Optimality Conditions
=
subject to g 1 4.330127 × 104 2 A 1 + 2.5 × 104 ( )
2 A1 + 2 A 2 − 1.5 × 108 ≤ 0
(
g 2 =2 2.5 × 104 ) ( A1 + )
2 A 2 − 1.5 × 108 ≤ 0; g3 =
− A1 ≤ 0; g 4 =
−A2 ≤ 0
The KKT conditions become
(
) ( )
2
∂L= ∂A 1 2 2 7.8 × 103 + u1 − 4.330127 × 104 2 A12 − 2.5 × 104 2 A 1+ 2 A 2
( )( )
2
+u2 − 2 2.5 × 104 A1 + 2 A 2 − u3 = 0 (1)
( )
2
∂L ∂A 2 = 7.8 × 103 + u1 −2.5 × 104 A 1+ 2 A 2
(
+u2 −2 2.5 × 104
2
)(
A 1+ 2 A 2 − u4 =
0 ) (2)
gi ≤ 0, ui gi =0, ui ≥ 0 ; i = 1, 2, 3, 4
There are totally 16 cases, since there are 4 inequality constraints. We shall solve for the case
(u2 = u3 = u4 = 0, g1 = 0) which yields a solution. The solution is also a global solution because
this is a convex programming problem.
∂L ∂A2 = 7.8 × 103 − u1 2.5 × 104 ( (
2 A1 + 2 A2 ) )=
2
0 (3)
∂L= ( )
∂A1 2 2 7.8 × 103 + u1 −4.330127 × 104 2 A12 − 2.5 × 104 2 A1 + 2 A=
2
2
0 ( ) (4)
=
g1 4.330127 × 104 2 A 1+ 2.5 × 104 2 A 1+ 2 A 2 − 1.5 ×= 108 0 ( ) (5)
Solving the nonlinear system for unknowns, we get
A1 = 2.937 × 10− 4 , A 2 =6.556 × 10− 5 , u 1=4.658 × 10− 8 , and f ∗ = 7.0
5. If σ a is increased to 152 MPa, the cost will decrease since u 1 > 0. The amount will be
Δf = (
− 4.658 × 10−8 2 × 106 =
− u1Δe = − 0.0932 . )( )
5.52 ________________________________________________________________________________
A 100 ×100m lot is available to construct a multistory office building. At least 20,000 m2 total
floor space is needed. According to a zoning ordinance, the maximum height of the building can
be only 21m, and the area for parking outside the building must be at least 25 percent of the floor
area. It has been decided to fix the height of each story at 3.5m. The cost of the building in millions
of dollars is estimated at 0.6 h +0.001 A, where A is the cross-sectional area of the building per
floor and h is the height of the building. Formulate the minimum cost design problem.
Solution
According to the graphical solution, the point P (14, 5000) is minimum point.
Referring to Exercises 2.1/4.83, we have already shown the point A = 5000 and h = 14 with
u1 =5.9 × 10− 4 , u2 =6.8 × 10− 4 satisfies the necessary and sufficient conditions. The effect of
constraint limit on cost function value is due to the Sensitivity Theorem; Δ=
f u1e1 + u2e2 where e1
and e2 are the small change of active constraints respectively.
5.53 ________________________________________________________________________________
Referring to the formulation in Exercises 2.3/4.85, we have
Minimize f = − π R 2 H , subject to g1 =2πRH − 900 ≤ 0; g 2 =5 − R ≤ 0;
g3 =−
R 20 ≤ 0; g 4 = − H ≤ 0; g5 = H − 20 ≤ 0 . The optimum solution obtained by the graphical
method is R∗ = 20, H ∗ = 7.16, f ∗ = − 9000 where g 1 and g 3 are active.
1. Check for necessary conditions. Since only g 1 and g 3 are active, the Lagrange multipliers are
all zero except for u 1 and u 3 . Therefore,
L = −π R 2 H + u1 ( 2π RH − 900 ) + u3 ( R − 20 )
The KKT necessary conditions are
∂L ∂R =−2π RH + 2π Hu1 + u3 − 0; ∂L ∂H =−π R 2 + 2π Ru1 =0 ;
gi ≤ 0, ui gi =0, ui ≥ 0 ; i =1 to 5
Substituting the optimum values R ∗ and H ∗ , we get u 1 = 10 > 0, u 3 = 449.9 > 0 (o.k.). All the other
conditions are also satisfied. Thus, the point obtained from graphical method satisfies all the necessary
conditions.
2. Check for sufficient condition ( ∗ ). Since the number of active constraints is equal to the number
of design variables, the point (R ∗ = 20, H ∗ = 7.16) is indeed an isolated local minimum point. The
sufficient condition is deemed satisfied at this point.
3. Effect of variations in constraint limits on cost function ( ∗ ∗ ). According to the Constraint
Variation Sensitivity Theorem 4.7, we have
∂f ∂e1 =− u1 =−10 and ∂f ∂e3 =− u3 =− 499.9
where e 1 and e 3 are a small variation in the R.H.S. of g 1 and g 3 respectively. Small variations in
R.H.S. of the other constraints have no effect on the cost. By using Taylor series expansion, we can
show that the change in cost function is ∆ f = − u1e1 − u3 e1 =−10 e1 − 449.9e3 .
___________________
( ∗ ) The argument used in 2. is applied to other problems in this section for checking sufficient condition.
( ∗ ∗ ) The argument used in 3. is applied to other problems in this section for studying the effect of
variations in constraint limits on cost function.
5.54 ________________________________________________________________________________
Referring to the formulation in Exercises 2.4/4.86, we have:
Minimize f =− 2π NR , subject to g1 = 0.5 − R ≤ 0; g 2 =π NR 2 − 2000 ≤ 0; g3 =− N ≤ 0. The
optimum solution obtained by the graphical method is R ∗ = 0.5, N ∗ = 2550, f ∗ = 800 where g 1 and
g 2 are active.
1. Check for necessary conditions. Since only g 1 and g 2 are active, set u 3 = 0.
( )
L = −2πNR + u1 (0.5 − R ) + u2 πNR 2 − 2000
The KKT necessary conditions are
∂L ∂R =−2π N − u1 + 2π N − u1 + 2π NRu2 =0;
∂L ∂N = −2π R + π R 2u2 = 0; gi ≤ 0, ui gi = 0, ui ≥ 0 ; i = 1 to 3
Substituting the optimum values, we obtain u 2 = 4 > 0, and u 1 = 16022 > 0 (o.k.). All the other
conditions are also satisfied. Therefore, the point obtained from graphical method satisfies the
necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. Effect of variations in constraint limits on cost function. Using the same argument as used in
Exercise 5.53, we can conclude that Δ f = − u1e1 − u2e2 =−16022e1 − 4e2
5.55 ________________________________________________________________________________
Referring to the formulation in Exercises 2.5/4.87, we have:
Minimize f = 200W + 100D, subject to g1 =W − 100 ≤ 0; g 2 =D − 200 ≤ 0; g3 =10,000 − WD ≤ 0;
g4 = D − 2W ≤ 0; g5 = W − 2 D ≤ 0; g6 = −W ≤ 0; g7 = − D ≤ 0. The optimum solution obtained by
the graphical method is W ∗ = 70.7, D ∗ = 141.4, f * = 28284 where g 3 and g 4 are active.
1. Check for necessary conditions. Since only g 3 and g 4 are active, set u1 = u2 = u5 = u6 = u7 = 0.
L = 200W + 100 D + u3 (10,000 − WD ) + u4 (D − 2W )
The KKT necessary conditions are:
∂L ∂W= 200 − u3 D − 2u4= 0;
∂L ∂D= 100 − u3 W + u4= 0;
gi ≤ 0, ui gi = 0, ui ≥ 0 ; i = 1 to 7
Substituting the optimum values, we have u 3 = 1.414 > 0, u 4 = 0 ≥ 0 (o.k.). All the other conditions
are also satisfied. Therefore, the point obtained from graphical method satisfies the necessary
conditions.
2. Check for sufficient condition. Hessian of the Lagrangian is
0 − u3 0 −1.414
H= =
− u3 0 −1.414 0
Since u 4 = 0, we only consider the gradient of g 3 .
− D −141.4
c (1, − 2 ) , c ≠ 0.
T
Ñg3 = −W = −70.7 ; Ñg3 d =
T
0 gives d =
Q = dT H d = 5.656c 2 > 0 for c ≠ 0 (o.k.)
Therefore, the point ( W ∗ = 70.7, D ∗ = 141.4) satisfies sufficient condition.
3. Effect of variations in constraint limits on cost function. Using the same argument as in Exercise
5.53, Δ f = − u3 e3 =−1.414 e3 . Since the Lagrange multiplier u 4 = 0, a small variation in R.H.S. of
g 4 has no effect on the cost function.
5.56 ________________________________________________________________________________
Referring to the formulation in Exercises 2.9/4.91, we have
Minimize f =π r 2 + 2π rh − 600 =0; subject to h1 = πr 2 h − 600 = 0; g1 =1 − h 2r ≤ 0;
g 2 =h 2r − 1.5 ≤ 0; g3 =h − 20 ≤ 0; g 4 =−h ≤ 0; g5 =−r ≤ 0 . The optimum solution obtained by
the graphical method is r ∗ = 4.57, h ∗ = 9.14, f ∗ = 328 where h 1 and g 1 are active.
1. Check for necessary conditions. Since the active constraints are h 1 and g 1 , we can set
u2 = u3 = u4 = u5 = 0.
( )
L =π r 2 + 2π rh + v 1 π r 2 h − 600 + u 1 (1 − h 2r )
The KKT necessary conditions are:
(
∂L ∂r = 2π r + 2π h + 2π rhv1 + u 1 h 2r 2 = 0 ;)
∂L ∂r = 2π r + π r 2v1 − u 1 2r = 0; h1 = 0, gi ≤ 0, ui gi = 0, ui ≥ 0 ; i = 1 to 5
Substituting the optimum values and solving for v 1 and u 1 , we get v 1 = −0.364365 , u 1 = 43.7562 > 0
(o.k.). All the other conditions are also satisfied. Therefore, the point ( r ∗ = 4.57, h ∗ = 9.14) satisfies
the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. Effect of variations in constraint limits on cost function. Using the same argument as used in
Exercise 5.53, Δ f = 0.3647b 1− 43.74e1 .
−v 1b 1− u 1e1 =
5.57 ________________________________________________________________________________
Referring to the formulation in Exercises 2.10/4.92, we have
Minimize f = 32 (b + 2h ) (15bh ) , subject to g1 =b − 10 ≤ 0; g 2 =h − 18 ≤ 0 . The optimum solution
obtained by the graphical method is b ∗ = 10, h ∗ = 18, f ∗ = 0.545 where g 1 and g 2 are active.
1. Check for necessary conditions. L = 32 (b + 2h ) (15bh ) + u1 (b − 10 ) + u2 (h − 18)
The KKT necessary conditions are:
∂L ∂b = (32 15)[bh − (b + 2h )h] (bh ) + u1 = 0;
2
( 32 15) 2bh − ( b + 2h ) b (=
bh ) + u2
2
=
∂L ∂h 0;
gi ≤ 0, ui gi = 0, ui ≥ 0 ; i = 1, 2
Substituting the optimum values, we obtain u 1 = 0.043 > 0, and u 2 = 0.0066 > 0 (o.k.). Thus, the
point (b ∗ = 10, h ∗ = 18) satisfies the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. Effect of variations in constraint limits on cost function. Using the same argument as used in
Exercise 5.53, Δ f = − u 1e1 − u 2e 2 = − 0.043e1 − 0.0066e 2 .
5.58 ________________________________________________________________________________
Referring to the formulation in Exercises 2.12/4.94, we have
=
Minimize f 200 p D 2 + 400 p DH , subject to
= h1 p D 2 H 4 −=
150 0 ; g1 = H + D 2 − 10 ≤ 0;
g2 =− H ≤ 0; g3 =− D ≤ 0 . The optimum solution obtained by the graphical method is D ∗ = 5.76,
H ∗ = 5.76, f ∗ = 62500, where h 1 is active.
1. Check for necessary conditions. Since only h 1 is active, set u 1 = u 2 = u 3 = 0.
L =200 p D 2 + 400 p DH + v1 ( p D 2 H 4 − 150 )
The KKT necessary conditions are: ∂L ∂D = 400p D + 400p H + p DH v1 2 = 0;
∂L ∂H= 400 pD + p D 2 v1 = 4 0; h=1 0, gi ≤ 0, ui g=
i 0, ui ≥ 0 ; i = 1, 3
Substituting the optimum values we obtain v 1 = − 277.6 . All other conditions are satisfied.
Therefore, the point obtained from graphical method satisfies the necessary conditions.
2. Check for sufficient condition. The Hessian of Lagrange function is
400p + pHv1 2 400p + pDv1 2 −1255 − 1255
Ñ2 L = =
400p + pDv1 2 0 −1255 0
πDH 2 52.1
c (1, − 2 ) , c ≠ 0.
T
Ñh 1= 2 = 26.05 ; Ñh1 d =
T
0 gives d =
πD 4
( )
Q = dT Ñ 2 L d = 3765c 2 > 0 if c ≠ 0
( ) ( ) (
L = 1 − P 1 + P 12 + 1 + 0.6P2 + u 1 60 − P1 − P2 )
The KKT necessary conditions are:
∂L ∂P1 =−1 + 2 P1 − u1 =0
∂L ∂P 2 = 0.6 + 2 P 2 − u1 = 0; gi = 0, ui gi = 0, ui ≥ 0 ; i = 1 to 3
Substituting the optimum value, we obtain u 1 = 59.8 > 0. Therefore, the necessary conditions are
satisfied.
2 0
2. Check for sufficient condition. The Hessian of Lagrangian is: Ñ 2 L =
0 2
Since Hessian of Lagrangian is positive definite, the sufficient condition is satisfied.
3. Effect of variations in constraint limits on cost function. Use the same argument as in
Exercise 5.53, Δf = −u1e1 = −59.8e1 .
5.59 ________________________________________________________________________________
Referring to the formulation in Exercises 2.14/4.96, we have
( ) ( )
Minimize f = 1 − P1 + P12 + 1 + 0.6 P2 + P22 ; subject to g1 = 60 − P1 − P2 ≤ 0;
g2 =− P1 ≤ 0; g3 =− P2 ≤ 0.
=
The optimum solution obtained by the graphical method =
is P1* 30 =
.4 , P2* 29.6 , f * 1790 where
g 1 is active.
3. The effect of variations in constraint limits on cost function. Use the same argument as in
Exercise 5.53, Δ f = − u1e1 =− 59.8e1.
5.60 ________________________________________________________________________________
Referring to the formulation in Exercises 2.23/5.38, we have
( )
Minimize f = 12.331 Ro2 − Ri2 ; subject to =
g1 ( 6.3662 ×106 ) Ro ( Ro4 − Ri4 ) − 2.5 ×104 ≤ 0;
(
g 2 = 4244.132 Ro2 + Ro Ri + Ri2 ) ( Ro4 − Ri4 ) − 9000 ≤ 0; g3 = Ro − 20 ≤ 0; g 4 = Ri − 20 ≤ 0;
1. Check for necessary conditions. This point satisfies the necessary conditions which have been
checked in Exercise 5.38.
2. Check for sufficient condition. Use the same argument in Exercise 5.53.
3. The effect of variations in constraint limits on cost function. Using the same argument used in
Exercise 5.53, Δ f = − 3.5596 × 10−3 e 1− 5.29e 3.
− u 1e 1− u 3e 3 =
5.61 ________________________________________________________________________________
Formulation is given in Exercise 2.24. Optimum solution and check of necessary and sufficient
conditions can be found in Exercise 5.39.
5.62 ________________________________________________________________________________
Optimum solution and check of necessary and sufficient conditions can be found in Exercise 5.41.
Referring to the formulation of Exercise 4.80, we have
Minimize f = 2.4662 ×105 R t , subject=
to g1 795.775 Rt − 2.5 × 108 ≤ 0 ;
g 2 =5 × 104 − 6.5113 × 1010 R 3t ≤ 0 ; g3 =R t − 50 < 0 ; g 4 =− R ≤ 0 ; g5 =−t ≤ 0
=
The optimum solution found by the graphical method is R∗ 0=
.0787, t ∗ 0.00157,
= f ∗ 30.56 kg;
where g 2 and g 3 are active.
1. Check for necessary conditions. Since only g 2 and g 3 are active, we can set u1 = u4 = u5 = 0 and
s2 = s3 = 0. The KKT necessary conditions are
∂L = ( )( )
∂R 2.4662 × 105 t + u2 −6.5113 × 1010 3R 2 t + u3 (1= t) 0 (1)
( ) ( )
∂L ∂t = 2.4662 × 105 R + u2 − 6.5113 × 1010 R 3 + u3 − R t 3 = 0 (2)
gi + s = 0, ui s=
2
i i 0, ui ≥ 0; =i 1 to 5 (3)
Substituting the optimum value into (1) and (2), we get
u2 = 3.056 × 10 −4 > 0, u3 = 0.3038 > 0 (o.k.).
(
All of the other constraints in (3) are also satisfied. Thus, the point R ∗ = 0.0787, t ∗ = 0.00157 )
satisfies the necessary conditions.
2. Check for sufficient condition. Since this is the case that the number of active constraints is equal
to the number of design variables, the point is indeed an isolated local minimum.
The Lagrange multipliers of the active constraints are u 2 = 3.056 ×10− 4 , u3 = 0.3038.
Therefore, Δ f = − 3.056 × 10− 4 e 2 − 0.3038 e 6 .
− u 2e 2 − u 6e 6 =
5.63 ________________________________________________________________________________
The formulation is given in Exercise 3.24. Optimum solution and check of necessary and sufficient
conditions can be found in Exercise 5.42.
1. Check for necessary conditions. Since only g 2 and g 3 are active, we can set u1 = u4 = u5 = 0, and s 2
and s 3 = 0.
( ) ( )
L= 1.2331 × 105 Ro2 − Ri2 + u2 5 × 104 − 1.62783 × 1010 Ro4 − Ri4 + u3 0.5 ( Ro + Ri ) ( Ro + Ri ) − 50
The KKT necessary conditions are
∂L = ( ) ( )( )
∂Ro 2.4662 × 105 Ro + u2 − 1.62783 × 1010 4 Ro3 + u3 − Ri ( Ro − R=
i)
2
0 (1)
∂L ∂Ri = ( ) ( )( )
− 2.4662 × 105 Ri + u2 1.62783 × 1010 4 Ri3 + u3 Ro ( Ro − Ri ) =
2
0 (2)
gi + si2= 0, ui s=
i 0, ui ≥ 0 ; i = 1 to 5 (3)
Substituting the optimum value into (1) and (2), we get
u2 = 3.056 × 10 −4 > 0, u3 = 0.3055 > 0 (o.k.).
point Ro∗ 0=
All other conditions in (3) are satisfied. Thus, the= .0795, Ri∗ 0.0779 satisfies the
necessary conditions.
2. Check for sufficient condition. Since this is the case that the number of active constraints is
equal to the number of design variables, the point is indeed a local minimum. Sufficient
condition is deemed satisfied at this point.
The Lagrange multipliers of active constraints are u 2 = 3.056 ×10− 4 , u3 = 0.3055. Therefore,
Δf = −3.056 × 10−4 e 2− 0.3038e 3 .
− u 2e 2 − u 4e 4 =
5.64 ________________________________________________________________________________
The formulation is given in Exercise 4.79. Optimum solution and check of necessary and sufficient
conditions can be found in Exercise 5.43.
2. Check for sufficient condition. Since this is the case that the number of active constraints is equal
to the number of design variables, the point is indeed local minimum point.
5.65 ________________________________________________________________________________
The formulation is given in Exercise 3.28. Optimum solution and check of necessary and sufficient
conditions can be found in Exercise 5.40.
1. Check for necessary conditions. Since only g 1 and g 2 are active, we can set u3 = u4 = u5 = 0 and
s1 = s2 = 0.
L = 50.077 Rt + 0.1885 ( R + t 2 ) + u1 25 − 25.038 ( R + t 2 ) + u2 ( 3.5 R t − 210 )
2 2
∂L ∂=R 50.077t + 0.377 ( R + t 2 ) − 2u1 ( 25.038 )( R + t 2 ) + u2 ( 3.5 t=) 0 (1)
∂L = (
∂t 50.077 R + 0.1885 ( R + t 2 ) + u1 ( 25.038 )( R + t 2 ) − u2 3.5 R t=
2
0 ) (2)
gi + si2= 0, ui s=
i 0, ui ≥ 0 ; i = 1 to 5 (3)
Substituting the optimum value into (1) and (2);
1.216434 − 1.9833 =
u1 + u 2 0, 50.267074 + 0.99165=
u1 − 60u 2 0
Solving for u1 and u2 , we get u1 = 0.0417 > 0 (o.k.), u2 = 4.080 × 10 −3 > 0 (o.k.). All the other
conditions in (3) are satisfied. Therefore, the point ( R ∗ = 1.0m, t ∗ = 0.0167m) satisfies all of the
necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
design variables, the point ( R ∗ = 1.0, t ∗ = 0.0167) is indeed a local minimum.
5.66 ________________________________________________________________________________
The formulation is given in Exercise 3.34*. Optimum solution and check of necessary and sufficient
conditions can be found in Exercise 5.45.
1. Check for necessary conditions. Since only g 1 and g 3 are active, we can set
u 2 = u 4 = u 5 = u 6 = u 7 = 0.
( ) (
L= 3.083 × 10−3 x12 1 − x22 + u1 5.093 × 107 x13 1 − x24 − 275 )
( )
+ u3 2.0 × 107 − 4.17246 × 104 x13 (1 − x2 )
2.5
The KKT necessary conditions are
∂L ∂= ( ) (
x1 6.166 × 10−3 x1 1 − x22 + u1 −3 5.093 × 107 x14 1 − x24 ) ( )
( )( )
+u3 − 4.17246 × 104 3 x12 (1 − x2 ) =
2.5
0 (1)
( )
∂L ∂x2 =−6.166 × 10−3 x12 x2 + u1 4 5.093 × 107 x23 x13 1 − x24 ( )
2
( )( )
+u3 − 4.17246 × 104 3 x12 (1 − x2 ) =
2.5
0 (2)
gi ≤ 0, ui gi = 0, ui ≥ 0 ; i = 1 to 7 (3)
−3
Substituting the optimum values into (1) and (2), respectively, we get u1 = 4.568 × 10 > 0,
u3 3.332 × 10− 8 > 0 (o.k.). All the other conditions in (3) are also satisfied. Therefore, the point
=
(x∗
1 )
= 103, x2∗ = 0.955 satisfies all of the necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
( )
design variables, the point x1∗ = 103, x2∗ = 0.955 is indeed a local minimum point.
The Lagrange multipliers of active constraints are u 1 = 4.568 ×10− 3 , u 3 = 3.332 ×10− 8 . Therefore,
Δf = − 4.568 × 10− 3 e1 − 3.332 × 10− 8 e 3 .
− u 1e 1− u 3e 3 =
5.67 ________________________________________________________________________________
The formulation is given in Exercise 3.35*. Optimum solution and check of necessary and sufficient
conditions can be found in Exercise 5.46.
1. Check for necessary conditions. Since only g1 and g 3 are active, we can set u2 = u4 = u5 = u6 = u7
= 0.
( ) ( ) (
L = 3.083 × 10−3 do2 − di2 + u1 5.093 × 107 do do2 − di2 − 275
)
+ u3 2.0 × 107 − ( 4.17246 × 104 ) do3 (1 − di do )
2.5
The KKT necessary conditions are
(
) ( ) ( )
2
∂L ∂d= o 6.166 × 10−3 do + u1 5.093 × 107 1 do4 − di4 − 4do do4 − di4
( )( )
− u3 4.17246 × 104 3do2 (1 − di do ) + 2.5 ( di do )(1 − di do ) =
2.5 1.5
0 (1)
( ) ( )( )
2
∂L ∂di =− 6.166 × 10−3 di + u1 5.093 × 107 do 4di3 do4 − di4
( )
+u3 4.17246 × 104 ( 2.5 ) d02 (1 − di do ) =
1.5
0 (2)
gi ≤ 0, ui gi = 0, ui ≥ 0 ; i = 1 to 7 (3)
Substituting the optimum values into (1) and (2) respectively, we get
u3 3.281 × 10−8 > 0 (o.k.).
u 1 = 4.657 × 10 −3 > 0,=
All the other conditions in (3) are also satisfied. Therefore, the point obtained from graphic method
satisfies all of the necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
( )
design variables, the point d o∗ = 103, d i∗ = 98.36 is indeed an isolated local minimum point. The
sufficient condition is deemed satisfied at this point.
5.68 ________________________________________________________________________________
The formulation is given in Exercise 3.36*. Optimum solution and check of necessary and sufficient
conditions can be found in Exercise 5.47.
g 4 = 50 − R ≤ 0; g5 = R − 200 ≤ 0; g 6 = 2 − t ≤ 0; g 7 = t − 40 ≤ 0
The optimum solution obtained by the graphical method is R ∗ = 50.3, t ∗ = 2.34, f ∗ = 2.9 where g 1
and g 3 are active.
1. Check for necessary conditions. Since only g 1 and g 3 are active, we can set
u=2 u=4 u=
5 u=
6 u=
7 0.
( )
L= 0.02466 Rt + u1 3.1831 × 106 ( 2 R + t ) 4 R 3t + Rt 3 ( )
( )
+u3 2.0 × 107 − 3.37972 × 105 ( R + 0.5t ) t 2.5
0.5
The KKT necessary conditions are
( ) ( )
L ∂R 0.02466t + u1 3.1831 × 106 2 4 R 3t + Rt 3 − ( 2 R + t ) 12 R 2 + t 3 ( ) ( 4R t + Rt )
2
∂= 3 3
( )
− u3 3.37972 × 105 ( 12 ) t 2.5 ( R + 0.5t )
0.5
=
0 (1)
( ) (
∂L ∂t 0.02466 R + u1 3.1831 × 106 1 4 R 3t + Rt 3 − ( 2 R + t ) 4 R 3 + 3Rt 2) ( ) ( 4R t + Rt )
2
= 3 3
( )
− u3 3.37972 × 105 ( 14 ) t 2.5 ( R + 0.5 t ) + 2.5t1.5 ( ) ( R + 0.5 t ) 0.5
=
0 (2)
gi ≤ 0, ui gi =0, ui ≥ 0 ; i = 1 to 7 (3)
−3
Substituting the optimum value into (1) and (2) respectively, we obtain u 1 = 4.643 × 10 > 0, u 3 =
3.240 × 10 −8 > 0 (o.k.). All the other conditions in (3) are also satisfied. Therefore, the point obtained
from graphical method satisfies all the necessary conditions.
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
( )
design variables, the point R ∗ = 50.3, t ∗ = 2.34 is indeed an isolated local minimum point. The
sufficient condition is deemed satisfied at this point.
5.69 ________________________________________________________________________________
(a) Referring to the formulation in Exercise 3.39 (3.23), we have
Minimize f = 0.2466Rt, subject= to g 1 7957.5 ( Rt ) − 250 ≤ 0; g 2 =×
5 104 − 0.26045 R3t ≤ 0;
g3 = R t − 50 ≤ 0; g 4 = 10 − R ≤ 0; g5 = R − 1000 ≤ 0; g6 = 5 − t ≤ 0; g7 = t − 200 ≤ 0
The optimum solution is obtained by the graphical method is R ∗ = 33.7, t ∗ = 5.0, f ∗ = 41.6 where
g 2 and g 6 are active.
1. Check for necessary conditions.
Since only g 2 and g 6 are active, we can set u 1 = u 3 = u 4 = u 5 = u 7 = 0.
=L 0.2466 Rt + u2 5 × 104 − 0.26045 R3t + u6 ( 5 − t )
The KKT necessary conditions are:
∂R 0.266t − u2 ( 0.78135 ) R=
∂L = 2
t 0; ( )
∂L ∂t 0.2466 R − u2 ( 0.26045 R 3=
= ) − u6 0;
gi ≤ 0, ui gi =0, ui ≥ 0 ; i =1 to 7
Substituting the optimum values, we obtain u 2 = 2.779 ×10− 4 > 0, u 6 = 5.540 > 0 (o.k.). All the
other conditions are also satisfied. Thus, the point (R ∗ = 33.7, t ∗ = 5.0) satisfies the necessary
conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function
Δf = − u2e2 − u6e6 =− 2.779 × 10− 4 e2 − 5.54e6
(b) Referring to the formulation in Exercise 3.42 (3.24), we have
( )
Minimize f = 0.1233 Ro2 − Ri2 ; subject = to g1 15915.5 ( Ro2 − Ri2 ) − 250 ≤ 0;
g 2 =5 × 105 − 0.06511( Ro4 − Ri4 ) ≤ 0; g3 =( Ro − Ri ) 2 ( Ro − Ri ) − 50 ≤ 0; g 4 = Ri − Ro + 5 ≤ 0;
g5 = Ro − Ri − 200 ≤ 0; g 6 = − 0.5 ( Ro + Ri ) + 10 ≤ 0; g=7 0.5 ( Ro + Ri ) − 1000 ≤ 0
The optimum solution obtained by the graphical method is Ro∗ = 36.0, Ri∗ = 31.0, f ∗ = 41.3 where g 2
and g 4 are active.
1. Check for necessary conditions.
Since only g 2 and g 4 are active, we can set u 1 = u 3 = u 5 = u 6 = u 7 = 0.
L = 0.1233 ( Ro2 − Ri2 ) + u2 5 × 105 − 0.06511( Ro4 − Ri4 ) + u4 ( Ri − Ro + 5 )
The KKT necessary conditions are:
( )
∂L ∂Ro = 0.2466 Ro − u2 0.026044 Ro3 − u4 = 0; ∂L ∂Ri =−0.2466 Ri + u2 ( 0.26044 Ri3 ) + u4 =0;
gi ≤ 0, ui gi =0, ui ≥ 0; i = 1 to 8
Substituting the optimum values, we get u 2 = 2.807 2.807 × 10 −4 > 0, u 4 = 5.467 > 0 (o.k.). All the
( )
other conditions are also satisfied. Thus, the point Ro∗ = 36.0, Ri∗ = 31.0 satisfies the necessary
conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function
Δf = − 2.807 × 10− 4 e2 − 5.467e4
− u2 e2 − u4 e4 =
5.70 ________________________________________________________________________________
(a) Referring to the formulation in Exercise 3.40 (3.23), we have
Minimize f = 0.2466Rt, subject= to g1 7957.7 ( Rt ) − 250 ≤ 0; g 2 =×
5 104 − 1.04181R 3t ≤ 0;
g3 =− R t − 50 ≤ 0; g 4 =
10 − R ≤ 0; g5 = R − 1000 ≤ 0; g 6 = 5 − t ≤ 0; g 7 = t − 200 ≤ 0
The optimum solution obtained by the graphical method is R ∗ = 21.3, t ∗ = 5.0, f ∗ = 26.0 where g 2
and g 6 are active.
1. Check for necessary condition.
Since only g 2 and g 6 are active, we can set u 1 = u 3 = u 4 = u 5 = u 7 = 0.
L = 0.2466Rt + u 2 (5 × 10 4 − 1.04181R 3t ) + u 6 (5 − t )
The KKT necessary conditions are:
( )
∂L ∂R = 0.2466t − u2 3.12543R 2t = 0;
∂L ∂t = 0.2466 R − u (1.04181R ) − u
2
3
6 = 0;
g i ≤ 0, ui g i = 0 , ui ≥ 0; i = 1 to 7
Substituting the optimum values, we obtain u 2 = 1.739 ×10− 4 > 0, u 6 = 3.491 > 0 (o.k.). All the other
conditions are also satisfied. Thus, the point (R * = 21.3, t * = 5.0) satisfies the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function
Δf = − u2 e2 − u6 e6 =−1.739 × 10− 4 e2 − 3.491e6
Substituting the optimum values, we get u 2 = 1.699 ×10− 4 > 0, u4 = 3.471 > 0 (o.k.). All the other
conditions are also satisfied. Thus, the point ( Ro∗ = 24.0 , Ri∗ = 19.0 ) satisfies the necessary
conditions.
2. Check for sufficient conditions. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function
Δf = −u2 e2 − u4 e4 = −1.699 × 10− 4 e2 − 3.471e4
5.71 ________________________________________________________________________________
(a) Referring to the formulation in Exercise 3.41 (3.23), we have
Minimize f = 0.2466Rt, subject to g 1 = 7957.7/(Rt) – 250 ≤ 0;
g 2 =5 × 104 − 0.52091R 3 t ≤ 0; g 3 =R t − 50 ≤ 0; g 4 =10 − R ≤ 0;
g 5 = R − 1000 ≤ 0; g 6 = 5 − t ≤ 0; g 7 = t − 200 ≤ 0;
The optimum solution obtained by the graphical method is R * = 27.0, t * = 5.0, f * = 33.0 where g 2
and g 6 are active.
1. Check for necessary conditions.
Since only g 2 and g 6 are active, we can set u 1 = u 3 = u 4 = u 5 = u 7 = 0.
L = 0.2466Rt + u 2 (5 × 10 4 − 0.52091R3t) + u 6 (5 – t)
The KKT necessary conditions are:
∂L ∂R = 0.2466t – u 2 (1.56273R3t) = 0; = ∂L ∂t 0.2466 R − u2 ( 0.52091R 3= ) − u6 0;
gi ≤ 0, ui gi =0, ui ≥ 0; i =1 to 7
Substituting the optimum values, we obtain u 2 = 2.165 × 10 −4 > 0, u 6 = 4.439 > 0 (o.k.). All the other
conditions are also satisfied. Thus, the point (R* = 27.0, t* = 5.0) satisfies the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function
Δf = −u2e2 − u6e6 = −2.065 × 10−4 e2 − 4.439e6 .
5.72 _______________________________________________________________________________
Referring to the formulation in Exercise 3.46, we have
Minimize f = 9.8125 × 10 −3 (A 1 + A 2 ),
subject to g 1 = (202.97A 1 +512.95A 2 )/( A 1 A 2 ) – 50 ≤ 0; g 2 = 103420/A 1 – 250 ≤ 0;
g 3 = A 1 – 5000 ≤ 0; g 4 = 40925/ A 2 – 250 ≤ 0; g 5 = A 2 – 5000 ≤ 0;
The optimum solution obtained by the graphical method is A 1∗ = 413.68, A ∗2 = 163.7, f * = 5.7 where
g 2 and g 4 are active.
1. Check for necessary conditions. Since only g 2 and g 4 are active, we can set u 1 = u 3 = u 5 = 0.
( ) (
L = 9.8125 ×10− 3 A1 + A2 + u2 (103420 A1 − 250 ) + u4 40925 A2 − 250 )
The KKT necessary conditions are:
( )
∂L ∂A1 = 9.8125 × 10 −3 − u2 103420 A12 = 0;
( )
∂L ∂A1 = 9.8125 × 10 −3 − u2 103420 A12 = 0;
g i ≤ 0, ui g i ≤ 0, ui ≥ 0 ; i =1 to 5
From the equations, we get u 2 = 1.6237 × 10−2 , u4 = 6.425 × 10 −3 > 0 (o.k.). All the conditions are
satisfied. Thus, the point (A 1∗ = 413.68, A ∗2 = 163.7) satisfies the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function
5.73 _______________________________________________________________________________
Referring to the formulation in Exercise 3.47, we have
Minimize f = 0.1233Rt, subject to g 1 = 16459.5/(Rt) – 250 ≤ 0 ;
g 2 = 1.034188 × 105 − 4.16726 R 3t ≤ 0; g3 = R t − 50 ≤ 0;
g 4 = 20 − R ≤ 0; g5 = R − 400 ≤ 0; g 6 = 2 − t ≤ 0; g 7 = t − 40 ≤ 0
The optimum solutions obtained by the graphical method are the points on the line segment between
"a" and "b". We shall check the point "a" where R* = 20. , t* = 3.3 together with g 1 and g 4 active.
1. Check for necessary conditions.
Since only g 1 and g 4 are active, we can set u 2 = u 3 = u 5 = u 6 = u 7 = 0.
L = 0.1233Rt + u 1 [16459.5/(Rt) – 250] + u 4 (20 – R)
The KKT necessary conditions are:
∂L= ∂R 0.1233t − u1 16459.5 R 2t =− u4 0;
L ∂t 0.123R − u1 16459.5 =
∂= Rt 2 0;
gi ≤ 0, ui gi = 0; ui ≥ 0 ; i = 1 to 7
Substituting the optimum values, we get u 1 = 0.03263 > 0, u 4 = 0 ≥ 0 (o.k.). All the other conditions
are also satisfied. Thus, the point (R* = 20, t* = 3.3) satisfies the necessary conditions.
2. Check for sufficient condition. We shall consider the general case where only g 1 is active. The
Hessian of Lagrangian is
u1 (16459.5 )( 2 ) u1 (16459.5 )
0.1233 +
R3t R2t 2
Ñ L=
2
u1 (16459.5 ) u1 (16459.5 )( 2 )
0.1233 +
R2t 2 Rt 3
16459.5 R t
2
c (1, − t R ) , c ≠ 0. Hence Q = dT Ñ 2 L d = 0. Thus,
T
Ñg1 = 2
; Ñg1T d = 0 gives d =
−16359.5 Rt
the sufficient condition is not satisfied.
3. The effect of variations in constraint limits on cost function.
Δf = − u1 e1 =0.03263 e1
5.74 _______________________________________________________________________________
Referring to the formulation in Exercise 3.48, we have
Minimize f = 1.57 × 10 −5 A(h2+5.625 ×10 5 )1/2,
1
subject to =
g1 ( 250 ) ( h 2
+ 5.625 × 10 ) (100 h + 0.2309 )
5 2
A − 250 ≤ 0;
1
( )
g 2 50000 h 2 + 5.625 × 10 5 2 (100 h + 0.2309 ) A − 250 ≤ 0 . The optimum solution obtained by the
=
graphical method is A* = 390, h* = 500, f * = 5.5 where g 1 and g 7 are active.
Check for necessary conditions. Since only g 1 and g 7 are active, we can set
u 2 = u 3 = u 4 = u 6 = u 8 = 0.
( ) ( )
1 1
L = 1.57 ×10 − 5 A h 2 + 5.625 × 10 5 2 + u1 ( 250 ) h 2 + 5.625 × 10 5 2 (100 h + 0.2309 ) A − 250
+ u 7 (500 − h )
The KKT necessary conditions are:
( ) ( )
1 1
∂L ∂A =1.57 × 10−5 h 2 + 5.625 × 10−5 2 − u1 ( 250 ) h 2 + 5.625 × 105 2 (100 h + 0.2309 ) A2 =0
( )
−1
= 1.57 × 10 − 5 Ah h 2 + 5.625 × 10 5
∂L ∂h 2
+ u1 ( 250 )
( ) ( ) ( )
−1 1
h h 2
+ 5 . 625 × 10 5 2
(100 h + 0 . 2309 ) A + h 2
+ 5 .625 × 10 5 2
−100 h 2 A − u7 =
0
g i ≤ 0, u i g i = 0, u i ≥ 0; i = 1 to 8
Substituting the optimum values, we obtain u 1 = 2.21610 × 10 −2 > 0, u 7 > 0, u 7 = 1.67 × 10 −3 (o.k.).
All other conditions are satisfied. Thus, the point (A* = 390, h* = 500) satisfies the necessary condition.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function
Δf = − u1e1 − u7 e7 = − 2.216 × 10−2 e1 − 1.67 × 10−3 e7
5.75________________________________________________________________________________
Referring to the formulation in Exercise 3.49, we have
Minimize f = 1.57 ×10−5 A ( 0.25s 2 + 106 ) ,
0.5
( 50 ) ( 0.25s 2 + 10 ) ( 4.2 × 10 A ) − ( 50 ) ≤ 0; g 5 =
1.5
=
g4 6 8
100 − A ≤ 0; g 6 =−
A 5000 ≤ 0;
g 7= 500 − s ≤ 0; g8 = s − 4000 ≤ 0 . The optimum solution obtained by the graphical method is A*
= 415, s* = 1480, f * = 8.1 where g 1 is active.
1. Check for necessary conditions.
The only active constraint is g 1 , so we can set u 2 = u 3 = u 4 = u 5 = u 6 = u 7 = u 8 = 0.
( ) ( )
1
+ u1 ( 250 ) 0.25s 2 + 10 6 ( 0.1 + 346.4 s ) A − 250
0.5
L=1.57 × 10 − 5 A 0.25s 2 + 10 6 2
The KKT necessary conditions are:
(
∂L ∂A= 1.57 × 10− 5 ( 0.25s 2 + 10 6 ) − u1 ( 250 ) 0.25s 2 + 106 ( 0.1 + 346.4 s ) A2 = )
0.5 0.5
0
( ) (
+ u1 ( 250 ) 0.25s 0.25s 2 + 106 )
− 0.5 − 0.5
s 1.57 × 10−5 A ( 0.25s ) 0.25s 2 + 106
∂L ∂=
( 0.1 + 346.4 s ) ( ) ( 346.4 s ) A =
0.5
A − 0.25s 2 + 106 2
0
g i ≤ 0, ui gi = 0, ui ≥ 0; i = 1 to 8
Substituting the optimum values, we obtain u 1 = 0.03252 > 0, u 1 = 0.03304 > 0 (o.k.). The
difference is acceptable since the optimum values are obtained from graphical method which has
only limited accuracy. For the following calculation, we assume u 1 = 0.0328. All the other
conditions are also satisfied. Thus, the point (A* = 415, s* = 1480) satisfies the necessary conditions.
2. Check for sufficient condition.
− 6 9.535 9.420 − 2.413 × 10− 3
∇ L 10 = 9.420 5.097 ; ∇g1 ( 250 )
2
−4
− 2.346 × 10
Ñg1T d = 0 gives d = c (1, − 10.29 ), c ≠ 0. Hence Q = dT ( Ñ 2 L=
) d 4.41× 10− 4 c2 > 0. Thus, the
sufficient condition is satisfied.
3. The effect of variations in constraint limits on cost function
Δf = − 0.0328 e1
− u1 e1 =
5.76________________________________________________________________________________
Referring to the formulation in Exercise 3.50, we have
( )
Minimize f = 7.85 × 10 − 3 2 2 A 1 + A 2 ,
subject=
to g1 30618.6 A + 17677.65 ( A +
1 1 )
2 A2 − 150 ≤= ( )
0; g 2 35355.3 A1 + 2 A2 − 150 ≤ 0;
g3 = 50 − A1 ≤ 0 ; g 4 =A1 − 5000 ≤ 0 ; g5 =
50 − A2 ≤ 0 ; g 6 =A2 − 5000 ≤ 0 .The optimum solution
=
obtained by the graphical method is A1* 300=
, A2* 50= , f * 7.0 where g1 and g 5 are active.
1. Check for necessary conditions. Since only g 5 are active, we can set u 2 = u 3 = u 4 = u 6 = 0.
( ) ( )
L = 7.85 × 10−3 2 2 A1 + A2 + u1 30618.6 A1 + 17677.65 A1 + 2 A2 − 150 + u5 ( 50 − A2 )
The KKT necessary conditions are:
( )
∂L ∂A1 = 7.85 × 10 −3 2 2 + u1 − 30618.6 A12 − 17677.65 A1 + 2 A2 = 0
2
(
)
∂L ∂A2= 7.85 × 10−3 + u1 −17677.65 2 ( )(
A1 + 2 A2 − u5= 0 )
2
gi ≤ 0, ui gi =0 , ui =0; i = 1 to 6
Substituting the optimum values, we obtain u1 = 0.0473 > 0, u5 =
0 ≥ 0 (o.k.) . All the other
=
conditions in (3) are also satisfied. Thus, the point =
A1* 300,( )
A2* 50. satisfies the necessary
conditions.
2. Check for sufficient condition
1.541 × 10− 4 9.322 × 10− 6
Ñ L=
2
−6
9.322 × 10 1.318 × 10− 5
(
− 204.1 A2 − 117.9 A + 2 A 2
) − 3.126 × 10−3
(150 )
(150 )
1 1 2
Ñg1 = −3
( )( ) −1.213 × 10
2
−117.9 2 A1 + 2 A2
Ñg1T d =0 gives d =c (1, − 2.58 ) , c ≠ 0. Hence Q =
T
dT Ñ2 L d = ( )
1.937 × 10− 4 c 2 > 0,
if c ≠ 0. Thus, sufficient condition is satisfied.
3. The effect of variations in constraint limits on cost function
∆f = − u1 e1 =− 0.0473 e1 .
5.77________________________________________________________________________________
Referring to the formulation in Exercise 3.51, we have
Minimize f = 153.7R t,
4.045 × 106 5.257 × 10 ( 2 R + t ) 1.649 × 10 ( 2 R + t )
3 10
=
subject to g 1 + + − 1 ≤ 0;
R 3 t + Rt 3 4 R 3 t + Rt 3 4 ( )
2
R 3
t + Rt 3
4
g 2 = 70 − 2 R + t ≤ 0; g3 = 2 R t − 91 ≤ 0; g=
4 4.4794 × 107 R 3t + Rt 3 4 − 20 ≤ 0; ( )
g5 = R − 0.5t − 250 ≤ 0 ; g 6 = 35 − R + 0.5t ≤ 0 ; g 7 = t − 40 ≤ 0; g8 = 1 − t ≤ 0 .
The optimum solution obtained by the graphical method is R* = 130, t* =2.86, f * = 57000 where g 1
and g 3 are active.
L = 153.7R t + u 1 3 + + − 1 + u3 − 91
R t + Rt 4 R t + Rt 4 ( R t + Rt 4 ) t
3 3 3 2
3 3
The KKT necessary conditions are:
∂L
= 153.7t + u1 [
( )
− 4.045× 106 3R 2t + t 3 4 5.257× 10 3 ( 2 ) 5.257 × 103 ( 2 R + t ) 3R 2t + t 3 4
+ −
( )
∂R ( ) ( )
2 2
R 3t + Rt 3 4 R 3t + Rt 3 4 R 3t + Rt 3 4
+ −
2
(
1.649 × 1010 ( 2 ) 1.649 × 10 ( 2 R + t ) R t + Rt 4 3R t + t 4
10 3 3 3
] + u3 ( 2 t ) =
0
)( ) (1)
(R 3t + Rt 3 4 ) R 3t + Rt 3 4 (
2
)
∂L
= 153.7 R + u1[
−4.045 × 106 3R 2t + t 3 4
+
(
5.257 × 103
−
)
5.257 × 103 ( 2 R + t ) R 3t + 3Rt 2 4 ( )
∂t R 3t + Rt 3 4
2
( )
R 3t + Rt 3 4 ( )
R 3t + Rt 3 4 ( )
1.649 × 1010 1.649 × 1010 ( 2 R + t )( 2 ) ( R t + Rt 4 )( R
3 3 3
+ 3 Rt 2 4)
+ − ]+u ( −2R t ) = 0
2
(2)
( R t + Rt 4 ) ( R t + Rt 4 )
2 4 3
3 3 3 3
gi ≤ 0, ui gi = 0, ui ≥ 0; i = 1 to 8 (3)
Substituting the optimum values into (1) and (2), we get u1 = 2.817 × 10 > 0, u 3 = 294.07 > 0 4
(o.k.). All the other conditions are also satisfied. Therefore, the point R * = 130, t * = 2.86 satisfies ( )
the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function.
∆f = − u1e1 − u3e3 =− 2.817 × 104 e1 − 294.07e3 .
5.78________________________________________________________________________________
Referring to the formulation in Exercise 3.52, we have
1.42603 × 108 d o
( = )
Minimize f = 6.126 d o2 − di2 , subject to g1 − 1.65 × 104 ≤ 0;
d o − di
4 4
( )
=g2
(
40743.7 d o2 + d o di + di2 ) − 5000 ≤=
0; g
3.719 × 106
− 10 ≤ 0 ;
(d − d ) 4
o i
4 3
(d 4
o − di4 )
( d + d ) − 60 ≤ 0 ; (d − di ) − 2 ≤ 0;
g4 =
o i
g5 =
o
g 6 = 0.5 − d o + di ( ) 2 ≤ 0;
(d − d )
o i
2
g 7 =d o − 50 ≤ 0 ; g8 =5 − d o ≤ 0 ; g9 =di − 45 ≤ 0 ; g10 =4 − di ≤ 0.
The optimum solution obtained by the graphical method is d o* = 41.6, d *i = 40.2, f ∗ = 680 where g 3
and g 4 are active.
1. Check for necessary conditions.
Since only g 3 and g 4 are active, we can set u 1 = u 2 = u 5 = u 6 = u 7 = u 8 = u 9 = u 10 = 0.
3.719 × 106 ( d + di )
L = 6.126 ( d o2 − di2 ) + u3 − 10 + u4 o − 60
( d o − di ) ( d o − di )
4 4
The KKT necessary conditions are:
−3.719 × 106 4 d 3
∂L
= 12.252 d o + u3
( ) o − 10 + u ( do − di ) − ( do= + di )
0
∂d o
( d o − di ) ( )
2 4 2
4 4
d − d
o i
3.719 × 106 4 d 3
∂L
= −12.252di + u3 ( ) i
− 10 + u ( d o − di ) + ( d o + di ) = 0
∂di
(
) ( d o − di )
2 4 2
d o4 − di4
gi ≤ 0, ui gi = 0 , ui ≥ 0; i = 1 to 10
Substituting the optimum values, we get u 3 = 35.71 > 0, u 4 = 6.067 > 0 (o.k.). All other conditions
( )
are satisfied. Thus, the point d o* = 41.6, d i* = 40.2 satisfies the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations in constraint limits on cost function.
∆f = − u3e3 − u4e4 =− 35.71e3 − 6.067e4 .
5.79________________________________________________________________________________
Referring to the formulation in Exercise 3.53, we have
Minimize f = 5.027t ( d o − t ) ,
1.688 × 109 4.098 × 107 do 1.435 × 1017 do
=
subject to g1 + + −1 ≤ 0
t ( do − t ) do + ( do − 2t ) do − ( do − 2t )
4 4 4 2
2
d − ( d − 2t )
4 4
o o
2.466 × 1013 do4 − ( do − 2t ) − 100 ≤ 0 ;
4
g= do t − 9 ≤ 0; g=
2 3
g 4 = 250 − do ≤ 0; g5 = do − 1500 ≤ 0; g6 = 5 − t ≤ 0 ;
g7 =
t − 100 ≤ 0 ;
=
The optimum solution obtained by the graphical method =
is do* 1310, t ∗ 14.2, f ∗ = 92500 where
g 2 and g 3 are active.
( )
L = 5.027t ( do − t ) + u2 [ do t − 92] + u3 2.466 × 1013 do4 − ( do − 2t ) − 100
4
The KKT necessary conditions are:
( )( )( )
2
∂L ∂d o = 5.027 + u2 t − u3 4 2.466 × 1013 d o3 − ( d o − 2t ) d o4 − ( d o − 2t ) = 0
3 4
( )
( ) ( )
∂L ∂t= 5.027 + ( d o − 2t ) + u2 −d o t 2 − u3 8 2.466 × 1013 ( d o − 2t ) d o4 − ( d o − 2t ) 2 = 0
3 4
gi ≤ 0, ui gi = 0, ui ≥ 0; i = 1 to 7
Substituting the optimum values, we get u 2 = 5.08 ×10 2 > 0 , u 3 = 4.624 ×10 2 > 0 (o.k.). All the other
conditions are also satisfied. Thus, the point satisfies the necessary conditions.
2. Check for sufficient condition. Use the same argument as in Exercise 5.53.
3. The effect of variations of constraint limits on cost function.
∆f = − u1e1 − u2e2 =− 5.082 × 102 e2 − 4.624 × 102 e3 .
5.80________________________________________________________________________________
The formulation is given in Exercise 3.54.
Optimum solution and check of necessary and sufficient conditions can be found in Exercise 5.48.
( )( ) ( ) ( )
1
g 2 =2.0 × 104 H 2 + 4800 2
H − 1.816774 × 106 D 4 H 2 + 4800 ≤ 0;
g3 = H − 500 ≤ 0; g 4 = 50 − H ≤ 0; g5 = D − 50 ≤ 0; g 6 = 0.5 − D ≤ 0 .
=
The optimum solution obtained by the graphical method is H ∗ 50,
= D∗ 3.42,
= f ∗ 6.6 , where g 2
and g 4 are active.
1. Check for necessary conditions. Since only g 2 and g 4 are active, we can set u1 = u3 = u5 = u6 = 0
and s2 = s4 = 0 .
( 6.59734 × 10 ) D ( H )
1
−3
L= 2 2
+ 4800 2
+
( )( ) ( ) ( )
1
u2 2.0 × 104 H 2 + 4800 2 H − 1.816774 × 106 D 4 H 2 + 4800 + u4 ( 50 − H )
The KKT necessary conditions are
( ) ( ) ( )
1
=∂L ∂D 0.0131947 D H 2 + 4800 −7.267096 × 106 D3 = H 2 + 4800 0
2+ u (1)
2
( ) ( ) ( )( )
1 1
∂L
= ∂H 6.59734 × 10−3 D 2 H H 2 + 4800 2 + u2 − 2.0 × 104 H 2 + 4800 2 H 2
2
( )( ) ( ) ( )
1
+ 2.0 × 104 H 2 + 4800 2 + 3.633548 × 106 D 4 H H 2 + 4800 − u4 = 0 (2)
gi + si2= 0, ui s=
i 0, ui ≥ 0 ; i = 1 to 6 (3)
−5 −2
Substituting the optimum value into (1) and (2), we get u2 = 9.68 × 10 > 0,=
u4 4.68 × 10 >0 (o.k.)
2. Check for sufficient condition. Since the number of active constraints is equal to the number of
( )
design variables, the point H ∗ = 50, D ∗ = 3.42 is indeed an isolated local minimum point. The
sufficient condition is deemed satisfied at this point.
9.68 × 10−5 , u4 =
The Lagrange multipliers of active constraints are u2 = 4.68 × 10−2.
Therefore, ∆ f =− u2 e2 − u4 e4 =− 9.68 × 10 −5 e2 − 4.68 × 10 −2 e4 .