68
Forty Years of Corner Polyhedra

Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Embed Size (px)

Citation preview

Page 1: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Forty Years of Corner Polyhedra

Page 2: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Two Types of I.P.

• All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman

• Some Variables (x,t) Integer, some continuous, data continuous. Example: Scheduling,Economies of scale.

• Corner Polyhedra relevant to both

Page 3: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Corner Polyhedra Origins Stock Cutting

• Computing Lots of Knapsacks

• Periodicity observed

• Gomory-Gilmore 1966 "The Theory and Computation of Knapsack Functions“

Page 4: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

1 1

1 1

Integer Programming Equations

Corner Polyhedr

(Mod 1)

at basis B

on Relaxation

Variables x Integer

Non-negativity Relaxed on x

Bx Nt b

Ix B Nt B b

B Nt B b

Equations

Page 5: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,
Page 6: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

V

L.P., I.P and Corner Polyhedron

Page 7: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Another View - T-Space

2 4 6 8 10t1

1

2

3

4

5

6

t2

Page 8: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Cutting Planes for Corner Polyhedra are Cutting Planes for

General I.P.

Page 9: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Valid, Minimal, Facet

Page 10: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

T-Space View

2 4 6 8 10t1

1

2

3

4

5

6

t2

FMV

Page 11: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Cutting Planes for Corner Polyhedra

1 1

1 1

i

(Mod 1)

{ } and

a solution

Valid Cutting Plane; non-negative scalar ( )

( ) 1

subaadditive, normalized

i g

i i gi

i

i i g i ii

B Nt B b

B N v B b v

t v v

v

if t v v then t v

Page 12: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Structure Theorem- 1969

o

( ) / ( )

is a facet of the corner polyhedron

produced by G if and only if it is a basic feasible

solution of this list of equations and inequalities

(g)+ (g-g ) 1 (all g)

(g)+ (g') ( ') (all g

G M I M B

g g

, g')

Page 13: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Typical Structured Facescomputed using Balinski program

Page 14: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Size Problem :Shooting Geometry

2 4 6 8 10t1

1

2

3

4

5

6

t2

Page 15: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Size Problem -Shooting Theorem

0

the Facet solving the L.P.

min v

(g)+ (g -g) 1 (all g)

(g)+ (g') ( ') (all g, g')

Is the Facet first hit by the random direction v

g g

Page 16: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Concentration of HitsEllis Johnson and Lisa Evans

Page 17: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Much More to be Learned

Page 18: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

ComparingInteger Programs and Corner

Polyhedron• General Integer Programs – Complex, no obvious

structure• Corner Polyhedra – Highly structured, but

complexity increases rapidly with group size.• Next Step: Making this supply of cutting planes

available for non-integer data and continuous variables. Gomory-Johnson 1970

Page 19: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Cutting Planes for Type Two

• Example: Gomory Mixed Integer Cut

• Variables ti Integer

• Variables t+, t- Non-Integer

• Valid subadditive function

Page 20: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,
Page 21: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Typical Structured Faces

Page 22: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Interpolating to get cutting plane function on the real line

2 4 6 8 100

0.2

0.4

0.6

0.8

1

Page 23: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Interpolating

2 4 6 8 100

0.5

1

1.5

2

2.5

3

Page 24: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Interpolating

2 4 6 8 100

1

2

3

4

Page 25: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Gomory-Johnson Theorem

If (x) has only two slopes and satisfies

the minimality condition (x)+ (1-x)=1

then it is a facet.

Page 26: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Integer Variables Example 2

0.2 0.4 0.6 0.8 1

0.2

0.4

0.6

0.8

1

Page 27: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Integer Based Cuts

• A great variety of cutting planes generated from Integer Theory

• But more developed cutting planes weaker than the Gomory Mixed Integer Cut for their continuous variables

Page 28: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,
Page 29: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Comparing

0.2 0.4 0.6 0.8 1

0.2

0.4

0.6

0.8

1

Page 30: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,
Page 31: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

( ) Gomory Mixed Integer Cut

Integer Variables

x

-2 -1.5 -1 -0.5 0.5 1 1.5 2

0.5

1

1.5

2

2.5

3

Page 32: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Integer Cuts lead to Cuts for the Continuous Variables

-2 -1.5 -1 -0.5 0.5 1 1.5 2

0.5

1

1.5

2

2.5

3

Page 33: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

-2 -1.5 -1 -0.5 0.5 1 1.5 2

0.5

1

1.5

2

2.5

3

( )x

Gomory Mixed Integer CutContinuous Variables

Page 34: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

New Direction

• Reverse the present Direction

• Create facets for continous variables

• Turn them into facets for the integer problem

• Montreal January 2007, Georgia Tech August 2007

Page 35: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

-2 -1.5 -1 -0.5 0.5 1 1.5 2

0.5

1

1.5

2

2.5

3

Start With Continuous x

Page 36: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

-2 -1.5 -1 -0.5 0.5 1 1.5 2

0.5

1

1.5

2

2.5

3

Create Integer Cut: Shifting and Intersecting

Page 37: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Shifting and Intersecting

i

i i

i

Cutting Plane; non-negative scalar ( )

( ) 1

If a t is integer, v can be changed by

an integer . So (v ) min ( )

shifting + intersecting

i

i i g i ii

i

v

if t v v then t v

v v

Page 38: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

One Dimension Continuous Problem

1 1

All t continuous

Theorem: The Gomory Mixed Integer cut is the only

(Mod 1)

cutting plane that is a facet for both the pure integer and the

pure continuous one di

B Nt B b

mensional problems.

Page 39: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Direction

• Move on to More Dimensions

Page 40: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Helper Theorem

Theorem If is a facet of the continous problem, then (kv)=k (v).

This will enable us to create 2-dimensional facets for the continuous problem.

Page 41: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Creating 2D facets

-1.5 -1 -0.5 0.5 1 1.5 2

-1.5

-1

-0.5

0.5

1

1.5

Page 42: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

The triopoly figure

0 1 2

-0.5

0

0.5

00.250.50.751

-0.5

0

0.5

Page 43: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

This corresponds to

-2 -1.5 -1 -0.5 0.5 1 1.5 2

0.5

1

1.5

2

2.5

3

Page 44: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

The periodic figure

-2 -1.5 -1 -0.5 0.5 1 1.5 2

0.5

1

1.5

2

2.5

3

Page 45: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Two Dimensional Periodic Figure

-1

0

1

2

XXX

-1

0

1

2

YYY

00.250.50.751ZZZ

-1

0

1

2

YYY

00.250.50.751ZZZ

Page 46: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

One Periodic Unit

Page 47: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Creating Another Facet

-1 1 2 3

-1.5

-1

-0.5

0.5

1

1.5

Page 48: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

The Periodic Figure - Another Facet

Page 49: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

More

Page 50: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

But there are four sided figures too

Corneujois and Margot have given a complete characterization of the two dimensional cutting planes for the pure continuous problem.

Page 51: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

All of the three sided polygons create Facets

• For the continuous problem

• For the Integer Problem

• For the General problem

• Two Dimensional analog of Gomory Mixed Integer Cut

Page 52: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

xi Integer ti Continuous

1 1

2 2

x 0.34, 1.12 -0.11, 1.01 1.10+

-0.35, 0.44 0.70, -0.44 0.14

Bx+Nt=b

t

x t

Page 53: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Basis B

1 1

1 1

2 2 2

1 0 0.75, 0.15 0.6

0 1 0,35, 0.55 0.8

Ix B N B b

x t

x t

Page 54: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Corner Polyhedron Equations

1

2 2

1 1

0.75, 0.15 0.6

0.35, 0.55 0.8

t

t

B Nt B b

Page 55: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

T-SpaceGomory Mixed Integer Cuts

1 2 3 4t1

1

2

3

4

t2

Page 56: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

T- Space – some 2D Cuts Added

1 2 3 4t1

1

2

3

4

t2

Page 57: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Summary

• Corner Polyhedra are very structured

• The structure can be exploited to create the 2D facets analogous to the Gomory Mixed Integer Cut

• There is much more to learn about Corner Polyhedra and it is learnable

Page 58: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Challenges

• Generalize cuts from 2D to n dimensions

• Work with families of cutting planes (like stock cutting)

• Introduce data fuzziness to exploit large facets and ignore small ones

• Clarify issues about functions that are not piecewise linear.

Page 59: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

END

Page 60: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Backup Slides

Page 61: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Thoughts About Integer Programming

University of Montreal, January 26, 2007 40th Birthday Celebration of the

Department of Computer Science and Operations Research

Page 62: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Corner Polyhedra and

2-Dimensional Cuttimg Planes

George Nemhauser Symposium

June 26-27 2007

Page 63: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

11 1 1

2 2 2 2

3 3 3 3

4 4 4 4

i

fc n f

c n f fv

c n f f

c n f f

Mod(1) B-1N has exactly Det(B) distinct

Columns vi

Page 64: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

One Periodic Unit

Page 65: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Why π(x) Produces the Inequality• It is subadditive π(x) + π(y) π(x+y) on the

unit interval (Mod 1)

• It has π(x) =1 at the goal point x=f0

Page 66: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Origin of Continuous Variables Procedure

0 0i

i

i

If for some t then ( / )( )

For large apply ; the result is (( / )) ( ) 1

( ) ) 1

( ) 0 ( ) 0.

i i i i i ii

i i i i i

i i

i i

c t c c k k t c

k c k k t

s c t

where s c s c for x and s x s x for x

Page 67: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

Shifting

Page 68: Forty Years of Corner Polyhedra. Two Types of I.P. All Variables (x,t) and data (B,N) integer. Example: Traveling Salesman Some Variables (x,t) Integer,

References• “Some Polyhedra Related to Combinatorial Problems,”

Journal of Linear Algebra and Its Applications, Vol. 2, No. 4, October 1969, pp.451-558

• “Some Continuous Functions Related to Corner Polyhedra, Part I” with Ellis L. Johnson, Mathematical Programming, Vol. 3, No. 1, North-Holland, August, 1972, pp. 23-85.

• “Some Continuous Functions Related to Corner Polyhedra, Part II” with Ellis L. Johnson, Mathematical Programming, Vol. 3, No. 3, North-Holland, December 1972, pp. 359-389.

• “T-space and Cutting Planes” Paper, with Ellis L. Johnson, Mathematical Programming, Ser. B 96: Springer-Verlag, pp 341-375 (2003).