Gomory’s Cutting Plane Method
PRESENTER
RAJESH PIRYANI
SOUTH ASIAN UNIVERSITY
Outline
1. Why Integer Programming
2. Introduction to All Integer Linear Programming Problem (AILP) and Mixed Integer Linear
Programming Problem (MILP)
3. Common Approach for solving AILP
4. Introduction to Gomory’s Cutting Plane Method
5. Derivation of Gomory’s Cutting Plane Method
6. Gomory’s Cutting Plane Method Algorithms
7. Explaination of Gomory’s Cutting Plane Method Algorithm with Example
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 2
Why Integer Programming
Production Problem
◦ Items being produced may be in complete units
◦ E.g. TV Sets of 21” and 29”
◦ Therefore fractional number of item have no meaning
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 3
IPP Expression
PROBLEM DEFINITION
𝑀𝑎𝑥 𝑧 = 𝑗=1
𝑛
𝑐𝑗 𝑥𝑗
subject to
𝑗=1
𝑛
𝑎𝑖𝑗 𝑥𝑗 = 𝑏𝑖 (𝑖 = 1, … , 𝑚)
𝑥𝑗 ≥ 0 (j=1,…,n)
and
𝑥𝑗 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 𝑓𝑜𝑟 𝑗1∁ 𝑗
where j={1,2, … ,n}
DEFINITION
All Integer LPP (AILP):- If all variable take
integer values only. (if 𝒋 𝟏 = 𝒋)
(slack & surplus variable take integer value)
Mixed Integer LPP (MILP):- If some but not
all variable of the problem are constrained
Integer values.
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 4
IPP Example
EXAMPLE OF AILP
𝑀𝑎𝑥 𝑧 = 4𝑥1 + 3𝑥2
subject to
𝑥1 + 𝑥2 ≤ 8
2𝑥1 + 𝑥2 ≤ 10
𝑥1, 𝑥2 ≥ 0
and
𝑥1 𝑎𝑛𝑑 𝑥2 𝑖𝑛𝑡𝑒𝑔𝑒𝑟
𝑥1 and 𝑥2 are non-negative integer
slack variable
𝑥3 = 8 − 𝑥1 − 𝑥2 &
𝑥4 = 10 − 2𝑥1 − 𝑥2
are also non-negative integer
if we consider 2nd constraints is given as:
2𝑥1 + 𝑥2 ≤ 10;
𝑥4 = 10 − 2𝑥1 − 𝑥2
Then this problem no more AILP. But MILP
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 5
Common Approach (Rounding off)
PROBLEM
𝑀𝑎𝑥 𝑧 = 21𝑥1 + 11𝑥2
subject to
7𝑥1 + 4𝑥2 ≤ 13
𝑥1, 𝑥2 ≥ 0
and
𝑥1 𝑎𝑛𝑑 𝑥2 𝑖𝑛𝑡𝑒𝑔𝑒𝑟
The Feasible Set of discrete points
0,0 , 0,1 , 1,0 , 1,1 , 0,2 , 0,3 .
Lies inside feasible region, can be visualize in
figure
Optimal Soln. of ILP 𝑥1
∗
= 0, 𝑥2
∗
= 3, 𝑧∗
= 33
Optimal Soln. of LLP (𝑥1
∗
= 13/7, 𝑥2
∗
= 0, 𝑧∗
= 39)
Rounding LLP Soln. (𝑥1
∗
= 2, 𝑥2
∗
= 0, 𝑧∗
= 42),
two obj. fn are not close in any meaningful sense
Rounding off is not correct approach to solve ILP’s5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 6
Common Approach (Convex Hull)
PROBLEM
𝑀𝑎𝑥 𝑧 = 21𝑥1 + 11𝑥2
subject to
7𝑥1 + 4𝑥2 ≤ 13
𝑥1, 𝑥2 ≥ 0
and
𝑥1 𝑎𝑛𝑑 𝑥2 𝑖𝑛𝑡𝑒𝑔𝑒𝑟
The Feasible Set of the given ILP is non convex, its convex hull is a
polytope whose corner points meet the integer requirements.
0,0 , 0,1 , 1,0 , 1,1 , 0,2 , 0,3 .
Lies inside feasible region, can be visualize in figure
Optimal Soln. of ILP 𝑥1
∗
= 0, 𝑥2
∗
= 3, 𝑧∗
= 33
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 7
Common Approach (Convex Hull)
PROBLEM (ILP EQUIVALENT TO SOLVING LPP)
𝑀𝑎𝑥 𝑧 = 𝑗=1
𝑛
𝑐𝑗 𝑥𝑗
subject to
(𝑥1, … , 𝑥 𝑛) ∈ 𝑆,
Where S is the polytope
𝑗=1
𝑛
𝑎𝑖𝑗 𝑥𝑗 = 𝑏𝑖(𝑖 = 1, … , 𝑚)
𝑥𝑗 ≥ 0 (j=1,…,n)
and
𝑥𝑗 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 𝑓𝑜𝑟 𝑗 ∈ 𝐽1∁ 𝐽 = {1, … , 𝑛}.
Optimal Soln. of ILP 𝑥1
∗
= 0, 𝑥2
∗
= 3, 𝑧∗
= 33
This method is perfectly valid except that there are
certain practical difficulties in getting the convex
hull. When Euclidean space is more than two or
three
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 8
Gomory’s Cutting Plane method for AILP
PROBLEM (ILP EQUIVALENT TO SOLVING LPP)
𝑀𝑎𝑥 𝑧 = 𝑐 𝑇
𝑥
subject to
𝐴𝑥 = 𝑏,
𝑥 ≥ 0
𝑥 𝑖𝑛𝑡𝑒𝑔𝑒𝑟
𝐴, 𝑏 𝑎𝑛𝑑 𝑐 are integer,
The objective function is automatically constrained to be integer.
Let
(𝑳𝑷) 𝟏→ 𝑨𝒔𝒔𝒐𝒄𝒊𝒂𝒕𝒆𝒅 𝑳𝑷𝑷 𝒇𝒐𝒓 𝑨𝑰𝑳𝑷
𝒙(𝟏)
→ 𝑶𝒑𝒕𝒊𝒎𝒂𝒍 𝑺𝒐𝒍𝒖𝒕𝒊𝒐𝒏
(if all constrained are integer then it is optimal
solution.
Else according to Gomory,
A new constrained 𝒑 𝑻
𝒙 ≤ 𝒅 append to new
(𝑳𝑷) 𝟏 to get a new (𝑳𝑷) 𝟐
The basic purpose of the cut constrained
◦ Delete a part of the feasible region 𝑺 𝟏
◦ Don’t delete the points which have integer
coordinates
Finitely many cut constrained will be needed to
solve the given AILP.
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 9
Gomory’s Cutting Plane method for AILP
DERIVATION OF THE GOMORY’S CUT
CONSTRAINT
𝑀𝑎𝑥 𝑧 = 𝑐 𝑇
𝑥
subject to
𝐴𝑥 = 𝑏,
𝑥 ≥ 0 (Eq. 1)
𝑨 = 𝑩: 𝑹 , 𝒙 = 𝒄𝒐𝒍 𝒙 𝑩, 𝒙 𝑹 , 𝒄 = 𝒄𝒐𝒍(𝒄 𝑩 , 𝒄 𝑹)
𝐴𝑥 = 𝑏
𝐵: 𝑅
𝑥 𝐵
𝑥 𝑅
= 𝑏
𝐵𝑥 𝐵 + 𝑅𝑥 𝑅 = 𝑏
𝑥 𝐵 = 𝐵−1
𝑏 − 𝐵−1
𝑅𝑥 𝑅
𝒙 𝑩 𝒊
= 𝒚𝒊𝟎 − 𝒋∈𝑹 𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓(𝒊 = 𝟏, … , 𝒎) (Eq.2)
𝑧 = 𝑐 𝑇
𝑥
= 𝑐 𝐵
𝑇
𝑥 𝐵 + 𝑐 𝑅
𝑇
𝑥 𝑅
= 𝑐 𝐵
𝑇
(𝐵−1
𝑏 − 𝐵−1
𝑥 𝑅) + 𝑐 𝑅
𝑇
𝑥 𝑅
= 𝑐 𝐵
𝑇
𝐵−1 𝑏 − (𝑐 𝐵
𝑇
𝐵−1 𝑅 − 𝑐 𝑅
𝑇
)𝑥 𝑅
Which can be written as
𝒙 𝑩 𝟎
= 𝒚 𝟎𝟎 − 𝒋∈𝑹 𝒚 𝟎𝒋 𝒙𝒋 (Eq. 3)
where
𝒙 𝑩 𝟎
= 𝒛, 𝒚 𝟎𝟎 = 𝒄 𝑩
𝑻
𝑩−𝟏 𝒃 & 𝒚 𝟎𝒋 = 𝒛𝒋 − 𝒄𝒋
𝒙 𝑩𝒊
= 𝒚𝒊𝟎 −
𝒋∈𝑹
𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓 𝒊 = 𝟎, 𝟏, … , 𝒎 (𝑬𝒒. 𝟒)
Where 𝒊 = 𝟎 refers to objective function and 𝒊 =
𝟏, … , 𝒎 refers to the m constraints.
𝒚 𝟎𝟎 → 𝒄𝒖𝒓𝒓𝒆𝒏𝒕 𝒐𝒃𝒋. 𝒇𝒖𝒏𝒄𝒕𝒊𝒐𝒏
𝒚𝒊𝟎 𝒊 = 𝟏, … , 𝒎 → 𝒄𝒖𝒓𝒓𝒆𝒏𝒕 𝒃. 𝒇. 𝒔.
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 10
Gomory’s Cutting Plane method for AILP
DERIVATION OF THE GOMORY’S CUT
CONSTRAINT
𝑨𝑰𝑳𝑷 𝑹𝒆𝒑𝒓𝒔𝒆𝒏𝒕𝒂𝒕𝒊𝒐𝒏 𝑀𝑎𝑥 𝑧 = 𝑐 𝑇
𝑥
subject to
𝐴𝑥 = 𝑏,
𝑥 ≥ 0, 𝑥 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 (Eq. 0)
𝑨𝒔𝒔𝒐𝒄𝒊𝒂𝒕𝒆𝒅 𝑳𝑷𝑷
𝑀𝑎𝑥 𝑧 = 𝑐 𝑇
𝑥
subject to
𝐴𝑥 = 𝑏, 𝑥 ≥ 0 (Eq. 1)
𝒙 𝑩 𝒊
= 𝒚𝒊𝟎 −
𝒋∈𝑹
𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓 𝒊 = 𝟎, 𝟏, … , 𝒎 (𝑬𝒒. 𝟒)
This holds for any feasible solution of LPP (Eq. 1) and (Eq. 0)
If for any real number a
Fractional part 𝒇 𝒂 = 𝒂 − 𝒂
[𝒂] → 𝒈𝒓𝒆𝒂𝒕𝒆𝒔𝒕 𝒊𝒏𝒕𝒆𝒈𝒆𝒓 𝒇𝒖𝒏𝒄𝒕𝒊𝒐𝒏
𝟎 ≤ 𝒇 𝒂 < 𝟏
For 𝒂 = −𝟏 𝒇 𝒂 = 𝟎
But 𝒂 = −𝟏. 𝟔,
𝒇 𝒂 = −𝟏. 𝟔 − −𝟏. 𝟔 = −𝟏. 𝟔 − −𝟐 = 𝟎. 𝟒
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 11
Gomory’s Cutting Plane method for AILP
𝒙 𝑩 𝒊
= 𝒚𝒊𝟎 −
𝒋∈𝑹
𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓 𝒊 = 𝟎, 𝟏, … , 𝒎 (𝑬𝒒. 𝟒)
𝒋∈𝑹
𝒚𝒊𝒋 𝒙𝒋 +
𝒋∈𝑹
𝒚𝒊𝒋 − 𝒚𝒊𝒋 𝒙𝒋 + 𝒙 𝑩 𝒊
= 𝒚𝒊𝟎 + (𝒚𝒊𝟎 − [𝒚𝒊𝟎])
i.e.
𝒋∈𝑹
[𝒚𝒊𝒋] 𝒙𝒋 + 𝒙 𝑩 𝒊
− 𝒚𝒊𝟎 = 𝒚𝒊𝟎 − 𝒚𝒊𝟎 −
𝒋∈𝑹
𝒚𝒊𝒋 − 𝒚𝒊𝒋 𝒙𝒋
i.e.
𝒋∈𝑹
[𝒚𝒊𝒋] 𝒙𝒋 + 𝒙 𝑩 𝒊
− 𝒚𝒊𝟎 = 𝒇𝒊𝟎 −
𝒋∈𝑹
𝒇𝒊𝒋 𝒙𝒋 (𝑬𝒒. 𝟓)
(Eq. 5) holds for all feasible points of points LPP (Eq. 0) and for the given AILP.
Therefore the R.H.S must also be integer.
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 12
Gomory’s Cutting Plane method for AILP
𝑓𝑖0 −
𝑗∈𝑅
𝑓𝑖𝑗 𝑥𝑗
𝑖 = 0 included because for the AILP, the objective function is also constrained to be integer.
𝑁𝑜𝑤 𝑓𝑖𝑗 ≥ 0 𝑎𝑛𝑑 𝑥𝑗 ≥ 0 𝑓𝑜𝑟 𝑗 ∈ 𝑅. 𝑇ℎ𝑒𝑟𝑒𝑓𝑜𝑟𝑒
𝑗∈𝑅 𝑓𝑖𝑗 𝑥𝑗 ≥ 0 (Eq. 6)
𝑓𝑖0 < 1 𝑎𝑛𝑑 𝐸𝑞. 6 𝑔𝑖𝑣𝑒𝑠
𝑓𝑖0 − 𝑗∈𝑅 𝑓𝑖𝑗 𝑥𝑗 < 1 is an integer
𝒇𝒊𝟎 − 𝒋∈𝑹 𝒇𝒊𝒋 𝒙𝒋 ≤ 𝟎 (Eq. 7)
The inequality (Eq. 7) is satisfied by every integer feasible point of the given AILP.
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 13
Gomory’s Cutting Plane method for AILP
If current b.f.s. 𝒙 𝑩 is not an integer. It doesn’t meet the requirement of AILP.
In that case, inequality is not satisfied.
“ It certainly deletes a part of the feasible region of the associated LLP ( at least the current
b.f.s. 𝒙 𝑩 and may be more points) but does not delete any feasible point with integer co-
ordinates. Hence it is valid cut constraint and it is called Gomory’s cut constraint”
−𝑓𝑖0= 𝑠𝑖 −
𝑗∈𝑅
𝑓𝑖𝑗 𝑥𝑗
Append this to associated LPP, (𝐿𝑃)1 to get the new LPP (𝐿𝑃)2 Therefore we solve
(𝐿𝑃)2 𝑎𝑛𝑑 𝑟𝑒𝑝𝑒𝑎𝑡 𝑡ℎ𝑒 𝑝𝑟𝑜𝑐𝑒𝑑𝑢𝑟𝑒.
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 14
Stepwise Description
Step 1: Solve the associated LLP, say (𝑳𝑷) 𝟏,by the simplex method. Set 𝒌 = 𝟏
Step 2:
◦ If the optimal solution obtained at Step 1 is integer
◦ Stop
◦ Otherwise go to Step3
Step 3: For any updated constraint 𝒊 whose 𝒚𝒊𝟎 value is fractional (including 𝒊 = 𝟎, i.e. obj. fun.)
◦ Generate Gomory’s cut constraint as given at (6.13).
◦ Select the value of 𝒊, 𝟎 ≤ 𝒊 ≤ 𝒎 for which 𝒇𝒊𝟎 value is maximum.
◦ Theoretically we can choose any i for which 𝒇𝒊𝟎 > 𝟎 but the maximum of 𝒇𝒊𝟎 is chosen with the hope that it may give a
deeper cut
Step 4: Append the Gomory’s cut constraint derived at Step 3 above the (𝑳𝑷) 𝒌 to get the new LPP
(𝑳𝑷) 𝒌+𝟏 .
◦ Solve by the dual simplex method and return to Step2
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 15
Theorem
“The number of Gomory’s cut constraints needed to solve any
instance of all integer linear programming (AILP) problem is
always finite”
As the no. of cut constraints needed is always finite, we are solving
only finitely many LPP to get an optimal solution of the given AILP.
But unfortunately, even for a problem of “average” size, the no. of
cut constraints needed may be ‘too many’ as AILP belongs to the
class of Hard Problem.
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 16
Example
CONSIDER THE INTEGER LPP
𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2
subject to
2𝑥1 + 2𝑥2 ≤ 9
3𝑥1 + 𝑥2 ≤ 11
𝑥1, 𝑥2 ≥ 0
𝑥1, 𝑥2integer
THE GIVEN ILP IS EQUIVALENT TO
𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4
subject to
2𝑥1 + 2𝑥2 + 𝑥3 = 9
3𝑥1 + 𝑥2 + 𝑥4 = 11
𝑥1, 𝑥2, 𝑥3, 𝑥4 ≥ 0
all integer
𝑥3 = 9 − 2𝑥1 − 2𝑥2 and
𝑥4 = 11 − 3𝑥1 − 𝑥2
𝑥1, 𝑥2 𝑎𝑟𝑒 𝑖𝑛𝑡𝑒𝑔𝑒𝑟, 𝑠𝑜 𝑥3, 𝑥4 𝑎𝑟𝑒 𝑎𝑙𝑠𝑜 𝑖𝑛𝑡𝑒𝑔𝑒𝑟
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 17
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒
𝒛 0 -5 -2 0 0
𝒙 𝟑 9 2 2 1 0
𝒙 𝟒 11 3 1 0 1
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒
𝒛 18.33 0 -0.33 0 1.67
𝒙 𝟑 1.67 0 1.33 1 -0.67
𝒙 𝟏 3.67 1 0.33 0 0.33
Example
FIRST ITERATION (LP1)
𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4
subject to
2𝑥1 + 2𝑥2 + 𝑥3 = 9
3𝑥1 + 𝑥2 + 𝑥4 = 11
𝑥1, 𝑥2, 𝑥3, 𝑥4 ≥ 0
all integer
𝑥3 = 9 − 2𝑥1 − 2𝑥2 and
𝑥4 = 11 − 3𝑥1 − 𝑥2
𝑥1, 𝑥2 𝑎𝑟𝑒 𝑖𝑛𝑡𝑒𝑔𝑒𝑟, 𝑠𝑜 𝑥3, 𝑥4 𝑎𝑟𝑒 𝑎𝑙𝑠𝑜 𝑖𝑛𝑡𝑒𝑔𝑒𝑟
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒
𝒛 18.75 0 0 0.25 1.5
𝒙 𝟐 1.25 0 1 0.75 -0.5
𝒙 𝟏 3.25 1 0 -0.25 0.5
(𝑧𝑗−𝑐𝑗)
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 18
Geometrical Representation
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 19
Geometrical Representation
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 20
Finding Gomory’s Cut Constraint
FINDING GOMORY’S CUT
Gomory cut constraint by choosing value of i for which
𝑓𝑖0 𝑖𝑠 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑚𝑜𝑠𝑡. In table we can see
𝒇 𝟎𝟎 𝒊𝒔 𝒎𝒐𝒔𝒕 𝒑𝒐𝒔𝒊𝒕𝒊𝒗𝒆
𝒇𝒊𝟎 − 𝒋∈𝑹 𝒇𝒊𝒋 𝒙𝒋 ≤ 𝟎
𝑓00 − 𝑓03 𝑥3 − 𝑓04 𝑥4 ≤ 0
0.75 − 0.25𝑥3 − 0.5𝑥4 ≤ 0
0.75 − 0.25𝑥3 − 0.5𝑥4 + 𝑠1 = 0
−𝟎. 𝟕𝟓 = 𝒔 𝟏 − 𝟎. 𝟐𝟓𝒙 𝟑 − 𝟎. 𝟓𝒙 𝟒
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒
𝒛 18.75 0 0 0.25 1.5
𝒙 𝟐 1.25 0 1 0.75 -0.5
𝒙 𝟏 3.25 1 0 -0.25 0.5
New Constrained in 𝒙 𝟏 𝒂𝒏𝒅 𝒙 𝟐 𝑓𝑜𝑟𝑚
𝑥3 = 9 − 2𝑥1 − 2𝑥2
𝑥4 = 11 − 3𝑥1 − 𝑥2
0.25𝑥3 + 0.5𝑥4 ≥ 0.75
0.25 9 − 2𝑥1 − 2𝑥2 + 0.5(11 − 3𝑥1 − 𝑥2) ≥ 0.75
𝟐𝒙 𝟏 + 𝒙 𝟐 ≤ 𝟕
(𝑧𝑗−𝑐𝑗) ≥ 0
𝑓00
𝑓10
𝑓20
𝟎 ≤ 𝒇 𝒂 < 𝟏
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 21
Change in Geometry due to cut
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 22
Change in Geometry due to cut
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 23
Change in Geometry due to cut
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 24
Second Iteration (LP2)
DUAL SIMPLEX METHOD
𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4 + 0𝑠1
subject to
2𝑥1 + 2𝑥2 + 𝑥3 = 9
3𝑥1 + 𝑥2 + 𝑥4 = 11
−0.25𝑥3 − 0.5𝑥4 + 𝑠1 = −0.75
𝑥1, 𝑥2, 𝑥3, 𝑥4, 𝑠1 ≥ 0
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏
𝒛 18.75 0 0 0.25 1.5 0
𝒙 𝟐 1.25 0 1 0.75 -0.5 0
𝒙 𝟏 3.25 1 0 -0.25 0.5 0
𝒔 𝟏 -0.75 0 0 -0.25 -0.5 1
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏
𝒛 18 0 0 0 1 1
𝒙 𝟐 -1 0 1 0 -2 3
𝒙 𝟏 4 1 0 0 1 -1
𝒙 𝟑 3 0 0 1 2 4
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏
𝒛 17.5 0 0.5 0 0 2.5
𝒙 𝟒 0.5 0 -0.5 0 1 -1.5
𝒙 𝟏 3.5 1 0.5 0 0 0.5
𝒙 𝟑 2 0 1 1 0 -1
By taking
constraint
directly in the
last Tableau
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 25
Finding Second Cut
FINDING GOMORY’S CUT
Gomory cut constraint by choosing value of i for which
𝑓𝑖0 𝑖𝑠 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑚𝑜𝑠𝑡. In table we can see
𝒇 𝟎𝟎 = 𝒇 𝟏𝟎 = 𝒇 𝟐𝟎 = 𝟎. 𝟓 𝒊𝒔 𝒎𝒐𝒔𝒕 𝒑𝒐𝒔𝒊𝒕𝒊𝒗𝒆
So w can generate cut through 𝒛 𝒐𝒓 𝒙 𝟒 𝒐𝒓 𝒙 𝟏 we choose
𝒊 = 𝟎 𝒂𝒏𝒅 𝒅𝒆𝒓𝒊𝒗𝒆 𝒄𝒐𝒏𝒔𝒕𝒓𝒂𝒊𝒏𝒕
𝒇𝒊𝟎 − 𝒋∈𝑹 𝒇𝒊𝒋 𝒙𝒋 ≤ 𝟎
0.5 − 0.5𝑥2 − 0.5𝑠1 ≤ 0
0.5 − 0.5𝑥2 − 0.5𝑠1 + 𝑠2 = 0
−0.5 = 𝑠2 − 0.5𝑥2 − 0.5𝑠1
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏
𝒛 17.5 0 0.5 0 0 2.5
𝒙 𝟒 0.5 0 -0.5 0 1 -1.5
𝒙 𝟏 3.5 1 0.5 0 0 0.5
𝒙 𝟑 2 0 1 1 0 -1
New Constrained in 𝒙 𝟏 𝒂𝒏𝒅 𝒙 𝟐 𝑓𝑜𝑟𝑚
𝑥3 = 9 − 2𝑥1 − 2𝑥2
𝑥4 = 11 − 3𝑥1 − 𝑥2
𝟐𝒙 𝟏 + 𝒙 𝟐 ≤ 𝟕
𝒔 𝟏 = 𝟕 − 𝟐𝒙 𝟏 − 𝒙 𝟐
0.5𝑥2 + 0.5𝑠1 ≥ 0.5
0.5𝑥2 + 0.5(𝟕 − 𝟐𝒙 𝟏 − 𝒙 𝟐) ≥ 0.5
𝒙 𝟏 ≤ 𝟑
(𝑧𝑗−𝑐𝑗) ≥ 0
𝑓00
𝑓10
𝑓20
𝑓30
𝟎 ≤ 𝒇 𝒂 < 𝟏
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 26
Change in Geometry due to cut
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 27
Change in Geometry due to cut
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 28
Change in Geometry due to cut
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 29
Third Iteration (LP)3
DUAL SIMPLEX METHOD
𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4 + 0𝑠1
subject to
2𝑥1 + 2𝑥2 + 𝑥3 = 9
3𝑥1 + 𝑥2 + 𝑥4 = 11
−0.25𝑥3 − 0.5𝑥4 + 𝑠1 = −0.75
−0.5 = 𝑠2 − 0.5𝑥2 − 0.5𝑠1
𝑥1, 𝑥2, 𝑥3, 𝑥4, 𝑠1 ≥ 0
Optimal Solution: (𝒙 𝟏
∗
= 𝟑, 𝒙 𝟐
∗
= 𝟏, 𝒛∗ = 𝟏𝟕)
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒔 𝟐
𝒛 17.5 0 0.5 0 0 2.5 0
𝒙 𝟒 0.5 0 -0.5 0 1 -1.5 0
𝒙 𝟏 3.5 1 0.5 0 0 0.5 0
𝒙 𝟑 2 0 1 1 0 -1 0
𝒔 𝟐 -0.5 0 -0.5 0 0 -0.5 1
𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒔 𝟐
𝒛 17 0 0 0 0 2 1
𝒙 𝟒 1 0 0 0 1 -1 -1
𝒙 𝟏 3 1 0 0 0 0 1
𝒙 𝟑 1 0 0 1 0 -2 2
𝒔 𝟐 1 0 1 0 0 1 -2
By taking
constraint
directly in the
last Tableau
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 30
Optimal point Geometrical
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 31
References
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 32
5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 33

More Related Content

PPT
Assignment Problem
PPTX
Integer Linear Programming
PPTX
Goal Programming
PPTX
Transportation problems
PPTX
Modified distribution method (modi method)
PPT
Simplex Method
PPTX
graphical method
PDF
LPP, Duality and Game Theory
Assignment Problem
Integer Linear Programming
Goal Programming
Transportation problems
Modified distribution method (modi method)
Simplex Method
graphical method
LPP, Duality and Game Theory

What's hot (20)

PPTX
Big m method
PDF
Chapter 4 Simplex Method ppt
PDF
Duality in Linear Programming Problem
PPT
Graphical Method
PDF
Unbalanced Transportation Problem
PDF
Integer programming
PPTX
Big-M Method Presentation
PPTX
Transportation Problem In Linear Programming
DOCX
Transportation model
PPTX
Assignment problem
PPT
Operation research complete note
PPTX
Linear Programming
DOC
Decision theory Problems
PDF
3. linear programming senstivity analysis
PPT
simplex method
PPTX
Duality in Linear Programming
PPTX
Traveling salesman problem
PPTX
Simplex method concept,
PPTX
primal and dual problem
PDF
Unit.5. transportation and assignment problems
Big m method
Chapter 4 Simplex Method ppt
Duality in Linear Programming Problem
Graphical Method
Unbalanced Transportation Problem
Integer programming
Big-M Method Presentation
Transportation Problem In Linear Programming
Transportation model
Assignment problem
Operation research complete note
Linear Programming
Decision theory Problems
3. linear programming senstivity analysis
simplex method
Duality in Linear Programming
Traveling salesman problem
Simplex method concept,
primal and dual problem
Unit.5. transportation and assignment problems
Ad

Viewers also liked (20)

PDF
Integer Programming, Gomory
PDF
Integer programming
PPTX
ITP UNS SEMESTER 2 Integer programming
PPTX
Network Problem CPM & PERT
PDF
Integer programming branch and bound
PDF
5eme chap 10
PDF
Tqm metrics
PDF
A software approach to mathematical programming
PPT
Lp and ip programming cp 9
PPT
Gurobi python
PPT
ippseminar
PPTX
Global optimization
PPTX
EKMA4413 - Riset Operasi - Modul 3
PPTX
EKMA4413 - Riset Operasi - Modul 7
PPTX
EKMA4413 - Riset Operasi - Modul 8
PPTX
EKMA4413 - Riset Operasi - Modul 9
PPTX
EKMA4413 - Riset Operasi - Modul 2
PPTX
tourism industry analysis in 2014
PPTX
EKMA4413 - Riset Operasi - Modul 6
PPTX
Thomas Cook service marketing
Integer Programming, Gomory
Integer programming
ITP UNS SEMESTER 2 Integer programming
Network Problem CPM & PERT
Integer programming branch and bound
5eme chap 10
Tqm metrics
A software approach to mathematical programming
Lp and ip programming cp 9
Gurobi python
ippseminar
Global optimization
EKMA4413 - Riset Operasi - Modul 3
EKMA4413 - Riset Operasi - Modul 7
EKMA4413 - Riset Operasi - Modul 8
EKMA4413 - Riset Operasi - Modul 9
EKMA4413 - Riset Operasi - Modul 2
tourism industry analysis in 2014
EKMA4413 - Riset Operasi - Modul 6
Thomas Cook service marketing
Ad

Similar to Gomory's cutting plane method (20)

PDF
Variational Autoencoder from scratch.pdf
PPT
Polygon clipping
PDF
M.Sc_.-IV_ComputerGraphics_PolygonClipping_Bhupendra_K_Pandya.pdf
PDF
fuzzy logic
PDF
Introduction to Algorithm Design and Analysis.pdf
PPTX
On the Configuration-LP of the Restricted Assignment Problem
PDF
GraphBLAS: A linear algebraic approach for high-performance graph queries
PPTX
Issta13 workshop on debugging
PPTX
Grds international conference on pure and applied science (5)
PPTX
Linear Programming- Leacture-16-lp1.pptx
PDF
"SSumM: Sparse Summarization of Massive Graphs", KDD 2020
PPTX
12-Lec - Repetition For Loop.pptx
PPTX
PREDICTION MODELS BASED ON MAX-STEMS Episode Two: Combinatorial Approach
PPTX
Asymptotic Analysis in Data Structures and Analysis
PDF
Directed Optimization on Pareto Frontier
PDF
6 CSE551 PavelGreedy5_v3 - Tagged.pdf it
PDF
Greedy Algorithms in Algorithms and Design
PDF
Sampling method : MCMC
PPTX
Wenying Yan Heuristics for Truck Scheduling at Cross Docking Terminals
PDF
newmicrosoftofficepowerpointpresentation-150826055944-lva1-app6891.pdf
Variational Autoencoder from scratch.pdf
Polygon clipping
M.Sc_.-IV_ComputerGraphics_PolygonClipping_Bhupendra_K_Pandya.pdf
fuzzy logic
Introduction to Algorithm Design and Analysis.pdf
On the Configuration-LP of the Restricted Assignment Problem
GraphBLAS: A linear algebraic approach for high-performance graph queries
Issta13 workshop on debugging
Grds international conference on pure and applied science (5)
Linear Programming- Leacture-16-lp1.pptx
"SSumM: Sparse Summarization of Massive Graphs", KDD 2020
12-Lec - Repetition For Loop.pptx
PREDICTION MODELS BASED ON MAX-STEMS Episode Two: Combinatorial Approach
Asymptotic Analysis in Data Structures and Analysis
Directed Optimization on Pareto Frontier
6 CSE551 PavelGreedy5_v3 - Tagged.pdf it
Greedy Algorithms in Algorithms and Design
Sampling method : MCMC
Wenying Yan Heuristics for Truck Scheduling at Cross Docking Terminals
newmicrosoftofficepowerpointpresentation-150826055944-lva1-app6891.pdf

More from Rajesh Piryani (10)

PDF
Introduction to sentiment analysis
PDF
Monte carlo simulation
PPSX
Online Advertisements and the AdWords Problem
PDF
PPTX
(Project) Student grading system
PDF
Optics ordering points to identify the clustering structure
PDF
Agile software development
PDF
(Paper Presentation) DSDV
PDF
(Paper Presentation) ZIGZAG: An Efficient Peer-to-Peer Scheme for Media Strea...
PDF
Address Binding Scheme
Introduction to sentiment analysis
Monte carlo simulation
Online Advertisements and the AdWords Problem
(Project) Student grading system
Optics ordering points to identify the clustering structure
Agile software development
(Paper Presentation) DSDV
(Paper Presentation) ZIGZAG: An Efficient Peer-to-Peer Scheme for Media Strea...
Address Binding Scheme

Recently uploaded (20)

PDF
UEFA_Carbon_Footprint_Calculator_Methology_2.0.pdf
PPTX
CN_Unite_1 AI&DS ENGGERING SPPU PUNE UNIVERSITY
PPTX
Graph Data Structures with Types, Traversals, Connectivity, and Real-Life App...
PDF
Design of Material Handling Equipment Lecture Note
PPTX
AUTOMOTIVE ENGINE MANAGEMENT (MECHATRONICS).pptx
PPTX
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
PDF
MLpara ingenieira CIVIL, meca Y AMBIENTAL
PDF
LOW POWER CLASS AB SI POWER AMPLIFIER FOR WIRELESS MEDICAL SENSOR NETWORK
PDF
Applications of Equal_Area_Criterion.pdf
PDF
Exploratory_Data_Analysis_Fundamentals.pdf
PDF
Unit1 - AIML Chapter 1 concept and ethics
PPTX
CyberSecurity Mobile and Wireless Devices
PDF
20250617 - IR - Global Guide for HR - 51 pages.pdf
PDF
Computer System Architecture 3rd Edition-M Morris Mano.pdf
PDF
Introduction to Power System StabilityPS
PPTX
tack Data Structure with Array and Linked List Implementation, Push and Pop O...
PPTX
Module 8- Technological and Communication Skills.pptx
PPTX
PRASUNET_20240614003_231416_0000[1].pptx
PDF
First part_B-Image Processing - 1 of 2).pdf
PPTX
Software Engineering and software moduleing
UEFA_Carbon_Footprint_Calculator_Methology_2.0.pdf
CN_Unite_1 AI&DS ENGGERING SPPU PUNE UNIVERSITY
Graph Data Structures with Types, Traversals, Connectivity, and Real-Life App...
Design of Material Handling Equipment Lecture Note
AUTOMOTIVE ENGINE MANAGEMENT (MECHATRONICS).pptx
Sorting and Hashing in Data Structures with Algorithms, Techniques, Implement...
MLpara ingenieira CIVIL, meca Y AMBIENTAL
LOW POWER CLASS AB SI POWER AMPLIFIER FOR WIRELESS MEDICAL SENSOR NETWORK
Applications of Equal_Area_Criterion.pdf
Exploratory_Data_Analysis_Fundamentals.pdf
Unit1 - AIML Chapter 1 concept and ethics
CyberSecurity Mobile and Wireless Devices
20250617 - IR - Global Guide for HR - 51 pages.pdf
Computer System Architecture 3rd Edition-M Morris Mano.pdf
Introduction to Power System StabilityPS
tack Data Structure with Array and Linked List Implementation, Push and Pop O...
Module 8- Technological and Communication Skills.pptx
PRASUNET_20240614003_231416_0000[1].pptx
First part_B-Image Processing - 1 of 2).pdf
Software Engineering and software moduleing

Gomory's cutting plane method

  • 1. Gomory’s Cutting Plane Method PRESENTER RAJESH PIRYANI SOUTH ASIAN UNIVERSITY
  • 2. Outline 1. Why Integer Programming 2. Introduction to All Integer Linear Programming Problem (AILP) and Mixed Integer Linear Programming Problem (MILP) 3. Common Approach for solving AILP 4. Introduction to Gomory’s Cutting Plane Method 5. Derivation of Gomory’s Cutting Plane Method 6. Gomory’s Cutting Plane Method Algorithms 7. Explaination of Gomory’s Cutting Plane Method Algorithm with Example 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 2
  • 3. Why Integer Programming Production Problem ◦ Items being produced may be in complete units ◦ E.g. TV Sets of 21” and 29” ◦ Therefore fractional number of item have no meaning 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 3
  • 4. IPP Expression PROBLEM DEFINITION 𝑀𝑎𝑥 𝑧 = 𝑗=1 𝑛 𝑐𝑗 𝑥𝑗 subject to 𝑗=1 𝑛 𝑎𝑖𝑗 𝑥𝑗 = 𝑏𝑖 (𝑖 = 1, … , 𝑚) 𝑥𝑗 ≥ 0 (j=1,…,n) and 𝑥𝑗 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 𝑓𝑜𝑟 𝑗1∁ 𝑗 where j={1,2, … ,n} DEFINITION All Integer LPP (AILP):- If all variable take integer values only. (if 𝒋 𝟏 = 𝒋) (slack & surplus variable take integer value) Mixed Integer LPP (MILP):- If some but not all variable of the problem are constrained Integer values. 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 4
  • 5. IPP Example EXAMPLE OF AILP 𝑀𝑎𝑥 𝑧 = 4𝑥1 + 3𝑥2 subject to 𝑥1 + 𝑥2 ≤ 8 2𝑥1 + 𝑥2 ≤ 10 𝑥1, 𝑥2 ≥ 0 and 𝑥1 𝑎𝑛𝑑 𝑥2 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 𝑥1 and 𝑥2 are non-negative integer slack variable 𝑥3 = 8 − 𝑥1 − 𝑥2 & 𝑥4 = 10 − 2𝑥1 − 𝑥2 are also non-negative integer if we consider 2nd constraints is given as: 2𝑥1 + 𝑥2 ≤ 10; 𝑥4 = 10 − 2𝑥1 − 𝑥2 Then this problem no more AILP. But MILP 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 5
  • 6. Common Approach (Rounding off) PROBLEM 𝑀𝑎𝑥 𝑧 = 21𝑥1 + 11𝑥2 subject to 7𝑥1 + 4𝑥2 ≤ 13 𝑥1, 𝑥2 ≥ 0 and 𝑥1 𝑎𝑛𝑑 𝑥2 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 The Feasible Set of discrete points 0,0 , 0,1 , 1,0 , 1,1 , 0,2 , 0,3 . Lies inside feasible region, can be visualize in figure Optimal Soln. of ILP 𝑥1 ∗ = 0, 𝑥2 ∗ = 3, 𝑧∗ = 33 Optimal Soln. of LLP (𝑥1 ∗ = 13/7, 𝑥2 ∗ = 0, 𝑧∗ = 39) Rounding LLP Soln. (𝑥1 ∗ = 2, 𝑥2 ∗ = 0, 𝑧∗ = 42), two obj. fn are not close in any meaningful sense Rounding off is not correct approach to solve ILP’s5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 6
  • 7. Common Approach (Convex Hull) PROBLEM 𝑀𝑎𝑥 𝑧 = 21𝑥1 + 11𝑥2 subject to 7𝑥1 + 4𝑥2 ≤ 13 𝑥1, 𝑥2 ≥ 0 and 𝑥1 𝑎𝑛𝑑 𝑥2 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 The Feasible Set of the given ILP is non convex, its convex hull is a polytope whose corner points meet the integer requirements. 0,0 , 0,1 , 1,0 , 1,1 , 0,2 , 0,3 . Lies inside feasible region, can be visualize in figure Optimal Soln. of ILP 𝑥1 ∗ = 0, 𝑥2 ∗ = 3, 𝑧∗ = 33 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 7
  • 8. Common Approach (Convex Hull) PROBLEM (ILP EQUIVALENT TO SOLVING LPP) 𝑀𝑎𝑥 𝑧 = 𝑗=1 𝑛 𝑐𝑗 𝑥𝑗 subject to (𝑥1, … , 𝑥 𝑛) ∈ 𝑆, Where S is the polytope 𝑗=1 𝑛 𝑎𝑖𝑗 𝑥𝑗 = 𝑏𝑖(𝑖 = 1, … , 𝑚) 𝑥𝑗 ≥ 0 (j=1,…,n) and 𝑥𝑗 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 𝑓𝑜𝑟 𝑗 ∈ 𝐽1∁ 𝐽 = {1, … , 𝑛}. Optimal Soln. of ILP 𝑥1 ∗ = 0, 𝑥2 ∗ = 3, 𝑧∗ = 33 This method is perfectly valid except that there are certain practical difficulties in getting the convex hull. When Euclidean space is more than two or three 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 8
  • 9. Gomory’s Cutting Plane method for AILP PROBLEM (ILP EQUIVALENT TO SOLVING LPP) 𝑀𝑎𝑥 𝑧 = 𝑐 𝑇 𝑥 subject to 𝐴𝑥 = 𝑏, 𝑥 ≥ 0 𝑥 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 𝐴, 𝑏 𝑎𝑛𝑑 𝑐 are integer, The objective function is automatically constrained to be integer. Let (𝑳𝑷) 𝟏→ 𝑨𝒔𝒔𝒐𝒄𝒊𝒂𝒕𝒆𝒅 𝑳𝑷𝑷 𝒇𝒐𝒓 𝑨𝑰𝑳𝑷 𝒙(𝟏) → 𝑶𝒑𝒕𝒊𝒎𝒂𝒍 𝑺𝒐𝒍𝒖𝒕𝒊𝒐𝒏 (if all constrained are integer then it is optimal solution. Else according to Gomory, A new constrained 𝒑 𝑻 𝒙 ≤ 𝒅 append to new (𝑳𝑷) 𝟏 to get a new (𝑳𝑷) 𝟐 The basic purpose of the cut constrained ◦ Delete a part of the feasible region 𝑺 𝟏 ◦ Don’t delete the points which have integer coordinates Finitely many cut constrained will be needed to solve the given AILP. 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 9
  • 10. Gomory’s Cutting Plane method for AILP DERIVATION OF THE GOMORY’S CUT CONSTRAINT 𝑀𝑎𝑥 𝑧 = 𝑐 𝑇 𝑥 subject to 𝐴𝑥 = 𝑏, 𝑥 ≥ 0 (Eq. 1) 𝑨 = 𝑩: 𝑹 , 𝒙 = 𝒄𝒐𝒍 𝒙 𝑩, 𝒙 𝑹 , 𝒄 = 𝒄𝒐𝒍(𝒄 𝑩 , 𝒄 𝑹) 𝐴𝑥 = 𝑏 𝐵: 𝑅 𝑥 𝐵 𝑥 𝑅 = 𝑏 𝐵𝑥 𝐵 + 𝑅𝑥 𝑅 = 𝑏 𝑥 𝐵 = 𝐵−1 𝑏 − 𝐵−1 𝑅𝑥 𝑅 𝒙 𝑩 𝒊 = 𝒚𝒊𝟎 − 𝒋∈𝑹 𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓(𝒊 = 𝟏, … , 𝒎) (Eq.2) 𝑧 = 𝑐 𝑇 𝑥 = 𝑐 𝐵 𝑇 𝑥 𝐵 + 𝑐 𝑅 𝑇 𝑥 𝑅 = 𝑐 𝐵 𝑇 (𝐵−1 𝑏 − 𝐵−1 𝑥 𝑅) + 𝑐 𝑅 𝑇 𝑥 𝑅 = 𝑐 𝐵 𝑇 𝐵−1 𝑏 − (𝑐 𝐵 𝑇 𝐵−1 𝑅 − 𝑐 𝑅 𝑇 )𝑥 𝑅 Which can be written as 𝒙 𝑩 𝟎 = 𝒚 𝟎𝟎 − 𝒋∈𝑹 𝒚 𝟎𝒋 𝒙𝒋 (Eq. 3) where 𝒙 𝑩 𝟎 = 𝒛, 𝒚 𝟎𝟎 = 𝒄 𝑩 𝑻 𝑩−𝟏 𝒃 & 𝒚 𝟎𝒋 = 𝒛𝒋 − 𝒄𝒋 𝒙 𝑩𝒊 = 𝒚𝒊𝟎 − 𝒋∈𝑹 𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓 𝒊 = 𝟎, 𝟏, … , 𝒎 (𝑬𝒒. 𝟒) Where 𝒊 = 𝟎 refers to objective function and 𝒊 = 𝟏, … , 𝒎 refers to the m constraints. 𝒚 𝟎𝟎 → 𝒄𝒖𝒓𝒓𝒆𝒏𝒕 𝒐𝒃𝒋. 𝒇𝒖𝒏𝒄𝒕𝒊𝒐𝒏 𝒚𝒊𝟎 𝒊 = 𝟏, … , 𝒎 → 𝒄𝒖𝒓𝒓𝒆𝒏𝒕 𝒃. 𝒇. 𝒔. 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 10
  • 11. Gomory’s Cutting Plane method for AILP DERIVATION OF THE GOMORY’S CUT CONSTRAINT 𝑨𝑰𝑳𝑷 𝑹𝒆𝒑𝒓𝒔𝒆𝒏𝒕𝒂𝒕𝒊𝒐𝒏 𝑀𝑎𝑥 𝑧 = 𝑐 𝑇 𝑥 subject to 𝐴𝑥 = 𝑏, 𝑥 ≥ 0, 𝑥 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 (Eq. 0) 𝑨𝒔𝒔𝒐𝒄𝒊𝒂𝒕𝒆𝒅 𝑳𝑷𝑷 𝑀𝑎𝑥 𝑧 = 𝑐 𝑇 𝑥 subject to 𝐴𝑥 = 𝑏, 𝑥 ≥ 0 (Eq. 1) 𝒙 𝑩 𝒊 = 𝒚𝒊𝟎 − 𝒋∈𝑹 𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓 𝒊 = 𝟎, 𝟏, … , 𝒎 (𝑬𝒒. 𝟒) This holds for any feasible solution of LPP (Eq. 1) and (Eq. 0) If for any real number a Fractional part 𝒇 𝒂 = 𝒂 − 𝒂 [𝒂] → 𝒈𝒓𝒆𝒂𝒕𝒆𝒔𝒕 𝒊𝒏𝒕𝒆𝒈𝒆𝒓 𝒇𝒖𝒏𝒄𝒕𝒊𝒐𝒏 𝟎 ≤ 𝒇 𝒂 < 𝟏 For 𝒂 = −𝟏 𝒇 𝒂 = 𝟎 But 𝒂 = −𝟏. 𝟔, 𝒇 𝒂 = −𝟏. 𝟔 − −𝟏. 𝟔 = −𝟏. 𝟔 − −𝟐 = 𝟎. 𝟒 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 11
  • 12. Gomory’s Cutting Plane method for AILP 𝒙 𝑩 𝒊 = 𝒚𝒊𝟎 − 𝒋∈𝑹 𝒚𝒊𝒋 𝒙𝒋 𝒇𝒐𝒓 𝒊 = 𝟎, 𝟏, … , 𝒎 (𝑬𝒒. 𝟒) 𝒋∈𝑹 𝒚𝒊𝒋 𝒙𝒋 + 𝒋∈𝑹 𝒚𝒊𝒋 − 𝒚𝒊𝒋 𝒙𝒋 + 𝒙 𝑩 𝒊 = 𝒚𝒊𝟎 + (𝒚𝒊𝟎 − [𝒚𝒊𝟎]) i.e. 𝒋∈𝑹 [𝒚𝒊𝒋] 𝒙𝒋 + 𝒙 𝑩 𝒊 − 𝒚𝒊𝟎 = 𝒚𝒊𝟎 − 𝒚𝒊𝟎 − 𝒋∈𝑹 𝒚𝒊𝒋 − 𝒚𝒊𝒋 𝒙𝒋 i.e. 𝒋∈𝑹 [𝒚𝒊𝒋] 𝒙𝒋 + 𝒙 𝑩 𝒊 − 𝒚𝒊𝟎 = 𝒇𝒊𝟎 − 𝒋∈𝑹 𝒇𝒊𝒋 𝒙𝒋 (𝑬𝒒. 𝟓) (Eq. 5) holds for all feasible points of points LPP (Eq. 0) and for the given AILP. Therefore the R.H.S must also be integer. 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 12
  • 13. Gomory’s Cutting Plane method for AILP 𝑓𝑖0 − 𝑗∈𝑅 𝑓𝑖𝑗 𝑥𝑗 𝑖 = 0 included because for the AILP, the objective function is also constrained to be integer. 𝑁𝑜𝑤 𝑓𝑖𝑗 ≥ 0 𝑎𝑛𝑑 𝑥𝑗 ≥ 0 𝑓𝑜𝑟 𝑗 ∈ 𝑅. 𝑇ℎ𝑒𝑟𝑒𝑓𝑜𝑟𝑒 𝑗∈𝑅 𝑓𝑖𝑗 𝑥𝑗 ≥ 0 (Eq. 6) 𝑓𝑖0 < 1 𝑎𝑛𝑑 𝐸𝑞. 6 𝑔𝑖𝑣𝑒𝑠 𝑓𝑖0 − 𝑗∈𝑅 𝑓𝑖𝑗 𝑥𝑗 < 1 is an integer 𝒇𝒊𝟎 − 𝒋∈𝑹 𝒇𝒊𝒋 𝒙𝒋 ≤ 𝟎 (Eq. 7) The inequality (Eq. 7) is satisfied by every integer feasible point of the given AILP. 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 13
  • 14. Gomory’s Cutting Plane method for AILP If current b.f.s. 𝒙 𝑩 is not an integer. It doesn’t meet the requirement of AILP. In that case, inequality is not satisfied. “ It certainly deletes a part of the feasible region of the associated LLP ( at least the current b.f.s. 𝒙 𝑩 and may be more points) but does not delete any feasible point with integer co- ordinates. Hence it is valid cut constraint and it is called Gomory’s cut constraint” −𝑓𝑖0= 𝑠𝑖 − 𝑗∈𝑅 𝑓𝑖𝑗 𝑥𝑗 Append this to associated LPP, (𝐿𝑃)1 to get the new LPP (𝐿𝑃)2 Therefore we solve (𝐿𝑃)2 𝑎𝑛𝑑 𝑟𝑒𝑝𝑒𝑎𝑡 𝑡ℎ𝑒 𝑝𝑟𝑜𝑐𝑒𝑑𝑢𝑟𝑒. 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 14
  • 15. Stepwise Description Step 1: Solve the associated LLP, say (𝑳𝑷) 𝟏,by the simplex method. Set 𝒌 = 𝟏 Step 2: ◦ If the optimal solution obtained at Step 1 is integer ◦ Stop ◦ Otherwise go to Step3 Step 3: For any updated constraint 𝒊 whose 𝒚𝒊𝟎 value is fractional (including 𝒊 = 𝟎, i.e. obj. fun.) ◦ Generate Gomory’s cut constraint as given at (6.13). ◦ Select the value of 𝒊, 𝟎 ≤ 𝒊 ≤ 𝒎 for which 𝒇𝒊𝟎 value is maximum. ◦ Theoretically we can choose any i for which 𝒇𝒊𝟎 > 𝟎 but the maximum of 𝒇𝒊𝟎 is chosen with the hope that it may give a deeper cut Step 4: Append the Gomory’s cut constraint derived at Step 3 above the (𝑳𝑷) 𝒌 to get the new LPP (𝑳𝑷) 𝒌+𝟏 . ◦ Solve by the dual simplex method and return to Step2 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 15
  • 16. Theorem “The number of Gomory’s cut constraints needed to solve any instance of all integer linear programming (AILP) problem is always finite” As the no. of cut constraints needed is always finite, we are solving only finitely many LPP to get an optimal solution of the given AILP. But unfortunately, even for a problem of “average” size, the no. of cut constraints needed may be ‘too many’ as AILP belongs to the class of Hard Problem. 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 16
  • 17. Example CONSIDER THE INTEGER LPP 𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 subject to 2𝑥1 + 2𝑥2 ≤ 9 3𝑥1 + 𝑥2 ≤ 11 𝑥1, 𝑥2 ≥ 0 𝑥1, 𝑥2integer THE GIVEN ILP IS EQUIVALENT TO 𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4 subject to 2𝑥1 + 2𝑥2 + 𝑥3 = 9 3𝑥1 + 𝑥2 + 𝑥4 = 11 𝑥1, 𝑥2, 𝑥3, 𝑥4 ≥ 0 all integer 𝑥3 = 9 − 2𝑥1 − 2𝑥2 and 𝑥4 = 11 − 3𝑥1 − 𝑥2 𝑥1, 𝑥2 𝑎𝑟𝑒 𝑖𝑛𝑡𝑒𝑔𝑒𝑟, 𝑠𝑜 𝑥3, 𝑥4 𝑎𝑟𝑒 𝑎𝑙𝑠𝑜 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 17
  • 18. 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒛 0 -5 -2 0 0 𝒙 𝟑 9 2 2 1 0 𝒙 𝟒 11 3 1 0 1 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒛 18.33 0 -0.33 0 1.67 𝒙 𝟑 1.67 0 1.33 1 -0.67 𝒙 𝟏 3.67 1 0.33 0 0.33 Example FIRST ITERATION (LP1) 𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4 subject to 2𝑥1 + 2𝑥2 + 𝑥3 = 9 3𝑥1 + 𝑥2 + 𝑥4 = 11 𝑥1, 𝑥2, 𝑥3, 𝑥4 ≥ 0 all integer 𝑥3 = 9 − 2𝑥1 − 2𝑥2 and 𝑥4 = 11 − 3𝑥1 − 𝑥2 𝑥1, 𝑥2 𝑎𝑟𝑒 𝑖𝑛𝑡𝑒𝑔𝑒𝑟, 𝑠𝑜 𝑥3, 𝑥4 𝑎𝑟𝑒 𝑎𝑙𝑠𝑜 𝑖𝑛𝑡𝑒𝑔𝑒𝑟 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒛 18.75 0 0 0.25 1.5 𝒙 𝟐 1.25 0 1 0.75 -0.5 𝒙 𝟏 3.25 1 0 -0.25 0.5 (𝑧𝑗−𝑐𝑗) 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 18
  • 21. Finding Gomory’s Cut Constraint FINDING GOMORY’S CUT Gomory cut constraint by choosing value of i for which 𝑓𝑖0 𝑖𝑠 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑚𝑜𝑠𝑡. In table we can see 𝒇 𝟎𝟎 𝒊𝒔 𝒎𝒐𝒔𝒕 𝒑𝒐𝒔𝒊𝒕𝒊𝒗𝒆 𝒇𝒊𝟎 − 𝒋∈𝑹 𝒇𝒊𝒋 𝒙𝒋 ≤ 𝟎 𝑓00 − 𝑓03 𝑥3 − 𝑓04 𝑥4 ≤ 0 0.75 − 0.25𝑥3 − 0.5𝑥4 ≤ 0 0.75 − 0.25𝑥3 − 0.5𝑥4 + 𝑠1 = 0 −𝟎. 𝟕𝟓 = 𝒔 𝟏 − 𝟎. 𝟐𝟓𝒙 𝟑 − 𝟎. 𝟓𝒙 𝟒 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒛 18.75 0 0 0.25 1.5 𝒙 𝟐 1.25 0 1 0.75 -0.5 𝒙 𝟏 3.25 1 0 -0.25 0.5 New Constrained in 𝒙 𝟏 𝒂𝒏𝒅 𝒙 𝟐 𝑓𝑜𝑟𝑚 𝑥3 = 9 − 2𝑥1 − 2𝑥2 𝑥4 = 11 − 3𝑥1 − 𝑥2 0.25𝑥3 + 0.5𝑥4 ≥ 0.75 0.25 9 − 2𝑥1 − 2𝑥2 + 0.5(11 − 3𝑥1 − 𝑥2) ≥ 0.75 𝟐𝒙 𝟏 + 𝒙 𝟐 ≤ 𝟕 (𝑧𝑗−𝑐𝑗) ≥ 0 𝑓00 𝑓10 𝑓20 𝟎 ≤ 𝒇 𝒂 < 𝟏 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 21
  • 22. Change in Geometry due to cut 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 22
  • 23. Change in Geometry due to cut 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 23
  • 24. Change in Geometry due to cut 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 24
  • 25. Second Iteration (LP2) DUAL SIMPLEX METHOD 𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4 + 0𝑠1 subject to 2𝑥1 + 2𝑥2 + 𝑥3 = 9 3𝑥1 + 𝑥2 + 𝑥4 = 11 −0.25𝑥3 − 0.5𝑥4 + 𝑠1 = −0.75 𝑥1, 𝑥2, 𝑥3, 𝑥4, 𝑠1 ≥ 0 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒛 18.75 0 0 0.25 1.5 0 𝒙 𝟐 1.25 0 1 0.75 -0.5 0 𝒙 𝟏 3.25 1 0 -0.25 0.5 0 𝒔 𝟏 -0.75 0 0 -0.25 -0.5 1 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒛 18 0 0 0 1 1 𝒙 𝟐 -1 0 1 0 -2 3 𝒙 𝟏 4 1 0 0 1 -1 𝒙 𝟑 3 0 0 1 2 4 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒛 17.5 0 0.5 0 0 2.5 𝒙 𝟒 0.5 0 -0.5 0 1 -1.5 𝒙 𝟏 3.5 1 0.5 0 0 0.5 𝒙 𝟑 2 0 1 1 0 -1 By taking constraint directly in the last Tableau 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 25
  • 26. Finding Second Cut FINDING GOMORY’S CUT Gomory cut constraint by choosing value of i for which 𝑓𝑖0 𝑖𝑠 𝑝𝑜𝑠𝑖𝑡𝑖𝑣𝑒 𝑚𝑜𝑠𝑡. In table we can see 𝒇 𝟎𝟎 = 𝒇 𝟏𝟎 = 𝒇 𝟐𝟎 = 𝟎. 𝟓 𝒊𝒔 𝒎𝒐𝒔𝒕 𝒑𝒐𝒔𝒊𝒕𝒊𝒗𝒆 So w can generate cut through 𝒛 𝒐𝒓 𝒙 𝟒 𝒐𝒓 𝒙 𝟏 we choose 𝒊 = 𝟎 𝒂𝒏𝒅 𝒅𝒆𝒓𝒊𝒗𝒆 𝒄𝒐𝒏𝒔𝒕𝒓𝒂𝒊𝒏𝒕 𝒇𝒊𝟎 − 𝒋∈𝑹 𝒇𝒊𝒋 𝒙𝒋 ≤ 𝟎 0.5 − 0.5𝑥2 − 0.5𝑠1 ≤ 0 0.5 − 0.5𝑥2 − 0.5𝑠1 + 𝑠2 = 0 −0.5 = 𝑠2 − 0.5𝑥2 − 0.5𝑠1 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒛 17.5 0 0.5 0 0 2.5 𝒙 𝟒 0.5 0 -0.5 0 1 -1.5 𝒙 𝟏 3.5 1 0.5 0 0 0.5 𝒙 𝟑 2 0 1 1 0 -1 New Constrained in 𝒙 𝟏 𝒂𝒏𝒅 𝒙 𝟐 𝑓𝑜𝑟𝑚 𝑥3 = 9 − 2𝑥1 − 2𝑥2 𝑥4 = 11 − 3𝑥1 − 𝑥2 𝟐𝒙 𝟏 + 𝒙 𝟐 ≤ 𝟕 𝒔 𝟏 = 𝟕 − 𝟐𝒙 𝟏 − 𝒙 𝟐 0.5𝑥2 + 0.5𝑠1 ≥ 0.5 0.5𝑥2 + 0.5(𝟕 − 𝟐𝒙 𝟏 − 𝒙 𝟐) ≥ 0.5 𝒙 𝟏 ≤ 𝟑 (𝑧𝑗−𝑐𝑗) ≥ 0 𝑓00 𝑓10 𝑓20 𝑓30 𝟎 ≤ 𝒇 𝒂 < 𝟏 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 26
  • 27. Change in Geometry due to cut 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 27
  • 28. Change in Geometry due to cut 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 28
  • 29. Change in Geometry due to cut 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 29
  • 30. Third Iteration (LP)3 DUAL SIMPLEX METHOD 𝑀𝑎𝑥 𝑧 = 5𝑥1 + 2𝑥2 + 0𝑥3 + 0𝑥4 + 0𝑠1 subject to 2𝑥1 + 2𝑥2 + 𝑥3 = 9 3𝑥1 + 𝑥2 + 𝑥4 = 11 −0.25𝑥3 − 0.5𝑥4 + 𝑠1 = −0.75 −0.5 = 𝑠2 − 0.5𝑥2 − 0.5𝑠1 𝑥1, 𝑥2, 𝑥3, 𝑥4, 𝑠1 ≥ 0 Optimal Solution: (𝒙 𝟏 ∗ = 𝟑, 𝒙 𝟐 ∗ = 𝟏, 𝒛∗ = 𝟏𝟕) 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒔 𝟐 𝒛 17.5 0 0.5 0 0 2.5 0 𝒙 𝟒 0.5 0 -0.5 0 1 -1.5 0 𝒙 𝟏 3.5 1 0.5 0 0 0.5 0 𝒙 𝟑 2 0 1 1 0 -1 0 𝒔 𝟐 -0.5 0 -0.5 0 0 -0.5 1 𝒙 𝟏 𝒙 𝟐 𝒙 𝟑 𝒙 𝟒 𝒔 𝟏 𝒔 𝟐 𝒛 17 0 0 0 0 2 1 𝒙 𝟒 1 0 0 0 1 -1 -1 𝒙 𝟏 3 1 0 0 0 0 1 𝒙 𝟑 1 0 0 1 0 -2 2 𝒔 𝟐 1 0 1 0 0 1 -2 By taking constraint directly in the last Tableau 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 30
  • 31. Optimal point Geometrical 5/8/2015 HTTPS://SITES.GOOGLE.COM/SITE/PIRYANIRAJESH/ 31