48
Optimization under uncertainty Antonio J. Conejo The Ohio State University 2014

Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

  • Upload
    others

  • View
    8

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Optimization under uncertainty

Antonio J. Conejo

The Ohio State University

2014

Page 2: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Contents

• Stochastic programming (SP)

• Robust optimization (RO)

• Power system applications

A. J. Conejo, The Ohio State University 2October 2, 2014

Page 3: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Stochastic Programming (SP)

October 2, 2014 A. J. Conejo, The Ohio State University 3

Page 4: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

SP

• References

• Two-stage stochastic programming

• Decision framework

• Decision tree

• Scenario formulation

• Node formulation

• EVPI

• VSS

A. J. Conejo, The Ohio State University 4October 2, 2014

Page 5: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

SP References

— J. R. Birge and F. Louveaux. “Introduction to StochasticProgramming”. Springer, New York, 1997.

— J. L. Higle. Tutorials in Operations Research, INFORMS 2005.Chapter 2: “Stochastic Programming: Optimization WhenUncertainty Matters”. INFORMS, Hanover, Maryland, 2005.

— A. J. Conejo, M. Carrión, J. M. Morales, “Decision MakingUnder Uncertainty in Electricity Markets”, Springer, New York.2010, Chapters 2,3 and 4.

A. J. Conejo, The Ohio State University 5October 2, 2014

Page 6: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Two-stage SP

0,,

0,, subject to

,,O minimize

yxg

yxh

yxf x,y

Expectation CVaR

A. J. Conejo, The Ohio State University 6

Stochasticvector

October 2, 2014

Page 7: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Decision framework

— Decisions x are made (here & now)

— Stochastic vector λ realizes in a scenario λi

— Given x, decisions yi(x,λ) are made for each realization of λ, λi (wait & see)

A. J. Conejo, The Ohio State University 7October 2, 2014

Page 8: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Decision tree

A. J. Conejo, The Ohio State University 8

Scenario 1

Scenario i

Scenario n

1st stage decisionshere & now

2nd stage decisionswait & see

Recourse

October 2, 2014

Page 9: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Scenario formulation

low

average

high

33

22

1

1

Realization

Probability

A. J. Conejo, The Ohio State University 9October 2, 2014

Page 10: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Scenario formulation

321

3

1

,,,,,

3,2,1 0,,

3,2,1 0,, subject to

,, minimizeS

321321

xxx

iyxg

iyxh

yxfZ

iii

iii

iii

i

iyyyxxx

A. J. Conejo, The Ohio State University 10

Here & NowNon-anticipativity

Expectation

October 2, 2014

Page 11: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Non-anticipativity constraints

321 xxx

A. J. Conejo, The Ohio State University 11

Decisions cannot depend on the unknown future!

October 2, 2014

Page 12: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Node formulation

3,2,1 0,,

3,2,1 0,, subject to

,, minimize3

1

,,, 321

iyxg

iyxh

yxfZ

ii

ii

ii

i

i

S

yyyx

Non-anticipativity constraints are implicit!

A. J. Conejo, The Ohio State University 12

Just one x

October 2, 2014

Page 13: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

EVPI

Expected

Value of the

Perfect

Information

Measure of the value of “perfect” information

A. J. Conejo, The Ohio State University 13October 2, 2014

Page 14: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

EVPI

3,2,1 0,,

3,2,1 0,, subject to

,, minimize3

1

,,,,, 321321

iyxg

iyxf

yxfZ

iii

iii

iii

i

i

P

yyyxxx

No non-anticipativity constraints:

we perfectly foresee the future

A. J. Conejo, The Ohio State University 14October 2, 2014

Page 15: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

EVPI

PS ZZ EVPI

EVPI is non-negative

A. J. Conejo, The Ohio State University 15October 2, 2014

Page 16: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

VSS(only expectation)

Value of the

Stochastic

Solution

Measure of the relevance (gain) of using astochastic approach

A. J. Conejo, The Ohio State University 16October 2, 2014

Page 17: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

VSS

D

avg

avg

avg

x

,y,xg

,y,xh

,y,xf

Solution

subject to

maximize yx,

A. J. Conejo, The Ohio State University 17

Average!

October 2, 2014

Page 18: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

VSS

A. J. Conejo, The Ohio State University 18

3,2,1 0,,

3,2,1 0,, subject to

,, minimize3

1

,, 321

iyxg

iyxh

yxfZ

ii

D

ii

D

ii

D

i

i

D

yyy

This problem decomposes by scenario

October 2, 2014

Page 19: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

VSS

3

1

,,i

ii

D

i

D yxfZ

A. J. Conejo, The Ohio State University 19

We evaluate the “deterministic” solution

in all scenarios

October 2, 2014

Page 20: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

VSS

SD ZZ VSS

VSS is non-negative

A. J. Conejo, The Ohio State University 20October 2, 2014

Page 21: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Robust Optimization

October 2, 2014 A. J. Conejo, The Ohio State University 21

Page 22: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Outline

• Why Robust Optimization (RO)?

• RO without recourse

• RO with recourse

• Scheduling energy and reserve

A. J. Conejo, The Ohio State University 22October 2, 2014

Page 23: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Why RO?

A. J. Conejo, The Ohio State University 23October 2, 2014

Page 24: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

References

— Bertsimas D., Brown D.B., Caramanis C. Theory andapplications of robust optimization. SIAM Rev., vol. 53, pp.464–501, 2011.

— Bertsimas D., Sym M., Robust discrete optimization andnetwork flows, Math. Program, Ser. B, vol. 98, no. 13, pp. 49–71, 2003.

— Bertsimas D., Litvinov E., Sun X. A., Zhao J., Zheng T. Adaptiverobust optimization for the security constrained unitcommitment problem. IEEE Transactions on Power Systems, inpress, 2012.

A. J. Conejo, The Ohio State University 24October 2, 2014

Page 25: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

RO without recourse

A. J. Conejo, The Ohio State University 25

Uncertainty set

October 2, 2014

Page 26: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

RO without recourse

A. J. Conejo, The Ohio State University 26October 2, 2014

Page 27: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

RO without recourse

Deterministic problem Robust counterpart

LP Larger LP

MILP Larger MILP

NLP Larger NLP

A. J. Conejo, The Ohio State University 27

Under certain conditions over the robust set:

October 2, 2014

Page 28: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

RO with recourse

• Make scheduling decisions (min)

• Uncertainty realizes (max)

• Make operation (recourse) decisions (min)

A. J. Conejo, The Ohio State University 28October 2, 2014

Page 29: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

RO with recourse

A. J. Conejo, The Ohio State University 29October 2, 2014

Page 30: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

RO with recourse: Example

A. J. Conejo, The Ohio State University 30October 2, 2014

Page 31: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

RO with recourse

• Make scheduling decisions “x” with a prognosis of the future

• The uncertainty “w” realizes

• Make operation (recourse) decisions “y”

A. J. Conejo, The Ohio State University 31October 2, 2014

Page 32: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Power system applications

A. J. Conejo, The Ohio State University 32October 2, 2014

Page 33: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

ISO

• ISO market clearing: large-scale, stochastic?

Maximize Expected Social Welfare

subject to:

Market equilibrium

Producer constraints

Consumer constraints

A. J. Conejo, The Ohio State University 33October 2, 2014

Page 34: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Producer

• Offering by non-strategic producers: stochastic

Maximize Expected Profit

subject to:

Producer constraints

A. J. Conejo, The Ohio State University 34October 2, 2014

Page 35: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Stochastic producer

• Offering by non-dispatchable producers: stochastic

Maximize Expected Profit

subject to:

Producer constraints

A. J. Conejo, The Ohio State University 35October 2, 2014

Page 36: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Producer

• Futures market involvement (forward contracts and options)

Maximize Expected Profit

subject to:

Producer constraints

Contracting constraints

A. J. Conejo, The Ohio State University 36October 2, 2014

Page 37: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Producer

• Insurances

If selling through forward contracts and the production units fail… an insurance is advisable

A. J. Conejo, The Ohio State University 37October 2, 2014

Page 38: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Consumer

• Consumer energy procurement

Maximize Expected Cost

subject to:

Consumer constraints

Contracting constraints

A. J. Conejo, The Ohio State University 38October 2, 2014

Page 39: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Producer• Capacity investment by non-dispatchable producers

A. J. Conejo, The Ohio State University 39

UPPER LEVELMaximize Profit from Wind Generation

LOWER LEVELMaximize SW

MARKET CLEARING 1

MARKET CLEARING 2

MARKET CLEARING N

INVESTMENT DECISIONS

LMPs

Different load and wind conditions!

October 2, 2014

Page 40: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

TSO

• Transmission capacity investment

A. J. Conejo, The Ohio State University 40October 2, 2014

Page 41: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

TSO• Transmission capacity investment

A. J. Conejo, The Ohio State University 41

Social Welfare Maximization(Market Clearing)

Trade Maximization

subject toLines built

Upper-Level

Lower-Level

October 2, 2014

Page 42: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

ISO

• Transmission maintenance

A. J. Conejo, The Ohio State University 42

Social Welfare Maximization(Market Clearing)

Security Maximization

subject to Lines in maintenance

Upper-Level

Lower-Level

October 2, 2014

Page 43: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Conclusions

(Electrical) Energy problems are important!

A. J. Conejo, The Ohio State University 43October 2, 2014

Page 44: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

Conclusions

How many coal plants are currently being built in planet Earth?

A. J. Conejo, The Ohio State University 44October 2, 2014

Page 45: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

ConclusionsIf renewables are considered:

– No such thing in the past (just demand uncertainty)

– No such thing in models for industry (production facilities are generally deterministic)

• Major uncertainty: stochastic production facilities

A. J. Conejo, The Ohio State University 45October 2, 2014

Page 46: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

ConclusionsIf renewables are considered:

– Spatial correlations (i) among production facilities, (ii) among demands, and (iii) among demands and production facilities.

– Temporal correlations for demands and production facilities

• Complex uncertainty:multiple dependencies

A. J. Conejo, The Ohio State University 46October 2, 2014

Page 47: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

ConclusionsIf renewables are considered:

– No two-stage stochastic models

– No adaptive robust optimization

• Multi-stage modeling is a must: future investment cost in stochastic sources is highly uncertain: the technology is not mature

A. J. Conejo, The Ohio State University 47October 2, 2014

Page 48: Optimization under uncertaintyegon.cheme.cmu.edu/ewo/docs/EWO_Seminar_10_02_2014.pdfOptimization under uncertainty Antonio J. Conejo The Ohio State University 2014 Contents •Stochastic

A. J. Conejo, The Ohio State University 48October 2, 2014