84
Online Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada ME, Johns Hopkins

Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

  • Upload
    dokiet

  • View
    218

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Online Optimization for Power Networks

Changhong Zhao Lingwen Gan Steven Low

EE, CMS, Caltech

January 2016

Enrique Mallada

ME, Johns Hopkins

Page 2: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Key message

Large network of DERs n  Real-time optimization at scale

Online optimization (feedback control) n  Network solves hard problems in real time for

free n  Exploit it for our optimization/control n  Naturally adapts to evolving network

conditions

Examples n  Slow timescale: OPF n  Fast timescale: frequency control

Page 3: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Optimal power flow n  DistFlow model and ACOPF n  Online algorithm n  Analysis and simulations

Load-side frequency control n  Dynamic model & design approach n  Distributed online algorithm n  Analysis and simulations n  Details

Main references (frequency control): Zhao, Topcu, Li, L, TAC 2014 Mallada, Zhao, L, Allerton 2014 Zhao et al: CDC 2014, CISS 2015, PSCC 2016

Page 4: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Bus injection model

Power flow equations

sj = yjkH

k:j~k∑ Vj

2−VjVk

H( )+ yjj Vj2

for all j

sj = tr YjHVV H( ) for all j Yj = Y Hejej

T

OPF = QCQP è SDP relaxation

Page 5: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Branch flow model

j k

sj

zij = yij−1

directed graph G

vi

ℓ ij,Sij( )

Sij := Pij, Qij( )si := pi, qi( )

vi := Vi2 , ℓ ij := Iij

2

Page 6: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Branch flow model

2

set. This bound suggests that any local minimum is almost asgood as any strictly feasible point.

We present in Section VI several refinements and extensionsto the basic gradient algorithm. For example, due to theimplicit power flow solution (1b), the gradient computationin (1a) requires inverting a certain Jacobian matrix. This isinefficient for large networks in terms of both computationaleffort and communication requirement. We describe how toexploit the tree topology of the network to iteratively computethe gradient in (1a) without the need for matrix inversion. Tofurther reduce the computational effort, we describe how to uselinearized power flow equations to derive approximate gradi-ents that avoids both matrix inversion and iterative calculation.These two methods greatly reduce the computational effort ineach iteration of (1a), but does not directly address commu-nication requirement. In [19] these algorithms are extendedto their distributed versions that require communication onlybetween neighboring buses.

While we discuss our algorithms mostly in the contextof a single-phase network for simplicity of exposition, mostdistribution systems are multiphase unbalanced [24], [10],[21]. We provide a sketch on how these algorithms can beextended to multiphase unbalanced radial networks.

Finally we present in Section VII numerical experiments on22 test networks with 42 buses to 1,990 buses. They suggestthat while semidefinite relaxation of OPF [25], [26] is ableto compute globally optimal solutions, it takes a much longertime. In comparison, the algorithm developed in this papertakes a much shorter time and is able to obtain a close-to-optimal solution. Specifically, for all our test networks, thedifference in objective values is below 10

�5 between thesetwo methods but the speedup is over 70x for large networks.It is therefore promising to further develop the algorithms inthis paper for real-time applications.

We conclude in Section VIII that it seems promising tofurther develop the algorithms in this paper for real-timeapplications. A key challenge to overcome is to minimize themeasurement and communication requirements so that thesealgorithms can be implemented in real time by a large networkof distributed energy resources, building on the ideas in [19].

II. PROBLEM FORMULATION

A. Model

Consider a distribution network modeled as a directed (andconnected) tree graph (N+, E) where N+

:= {0}[N , N :=

{1, . . . , n}, and E ✓ N+⇥N+. We will refer to each i 2 N+

as a “bus” or “node” and each (i, j) 2 E as a “line” or “link”.Let m := |E| = n be the number of lines in E. Let bus 0be the root of the tree. For convenience only, we assume thegraph is oriented such that each line (i, j) 2 E points awayfrom the root. We may use (i, j) or j ! k interchangeablyto denote a line. For each (i, j) 2 E, let zij := rij + ixij

were rij > 0 and xij > 0 are the line resistance and reactancerespectively.

For each bus i 2 N+, let Vi be the complex voltage atbus i and vi = |Vi|2 the square of its magnitude, e.g., if thevoltage is Vi = 1.05\120� per unit, then vi = 1.052. Bus 0 is

the slack or substation bus and we assume as customary thatV0

= 1\0� pu. Let si = pi + iqi be the net complex powerinjection at bus i with pi and qi as the real and reactive powerinjections respectively. Let Pi denote the unique path from bus0 to bus i. Since the network is radial (has a tree topology),the path Pi is well-defined.

For each line (i, j) 2 E, let Iij be the complex currentand `ij = |Iij |2 its squared magnitude, e.g., if the current isIij = 0.5\10�, then `ij = 0.52. Let Sij = Pij + iQij be thesending-end complex power from buses i to j with Pij andQij as the real and reactive power respectively.

We will mainly be using branch flow models in real domain,so we will abuse notation to use si to denote either the complexnumber pi + iqi or the real pair (pi, qi) depending on thecontext; similarly for other variables zij , Vi, Sij , Iij . Some ofthe notations are summarized in Figure 1.

0 i j

Pi

si

Sij, lij

Fig. 1. Some of the notations.

Let x := (pi, qi, i 2 N) 2 R2n denote the buse injections1

and y := (p0

, q0

, vi, i 2 N ;Pij , Qij , `ij , (i, j) 2 E) 2R3m+n+2. These variables, together with v

0

, satisfy the powerflow equations:

X

k: j!k

Pjk = Pij � rij`ij + pj , j 2 N+ (2a)

X

k: j!k

Qjk = Qij � xij`ij + qj , j 2 N+ (2b)

vi � vj = 2(rijPij + xijQij) � |zij |2`ij , i ! j (2c)vi`ij = P 2

ij + Q2

ij , i ! j (2d)

where i in (2a) and (2b) is the unique bus between bus 0and bus j. Note that the number 2(m + n + 1) = 4n + 2

of equations is the same as the number of variables in y. Theequations (2), called the DistFlow equations, are first proposedin [1], [2] and are valid only for radial networks (see [14] forthe generalization to mesh networks). Discrete devices liketap-changers and circuit breakers are not modeled.

1Even though x is also used to denote line reactances, the meaning shouldbe clear from the context.

x := p,q,v,P, Q, ℓ( ) = s,v,S, ℓ( )

linea

r

quadratic

DistFlow equations (radial nk) Baran & Wu, 1989

Page 7: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Branch flow model Branch flow model Bus injection model

(V, s)∈C2(n+1)

Sjkj→k∑ = Sij − zij ij( )

i→ j∑ + sj

vi − vj = 2 Re zijHSij( )− zij

2 ij

vi ij = Sij2

x := (s,v,S,ℓ)∈ R3(m+n+1)

DistFlow equations (radial nk) Baran & Wu, 1989

sj = yjkH

k: j~k∑ Vj

2−VjVk

H( )

Page 8: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Branch flow model Branch flow model Bus injection model

(V, s)∈C2(n+1)

Sjkj→k∑ = Sij − zij ij( )

i→ j∑ + sj

vi − vj = 2 Re zijHSij( )− zij

2 ij

vi ij = Sij2

+ cycle condition on

x := (s,v,S,ℓ)∈ R3(m+n+1)

sj = yjkH

k: j~k∑ Vj

2−VjVk

H( )

Page 9: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Cycle condition

A relaxed solution satisfies the cycle condition if

incidence matrix; depends on topology

∃θ s.t. Bθ = β(x) mod 2π

x

x := (S,,v, s)

β jk (x) :=∠ vj − z jkHSjk( )

Page 10: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Branch flow model Branch flow model Bus injection model

sj = yjkH

k: j~k∑ Vj

2−VjVk

H( )

(V, s)∈C2(n+1)

Sjkj→k∑ = Sij − zij ij( )

i→ j∑ + sj

vi − vj = 2 Re zijHSij( )− zij

2 ij

vi ij = Sij2

+ cycle condition on

[Farivar & Low 2013 TPS Bose et al 2012 Allerton]

Theorem: BIM = BFM

x := (s,v,S,ℓ)∈ R3(m+n+1)

Page 11: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Branch flow model

•  BFM and BIM are equivalent (nonlinear bijection)

•  … but some results are easier to formulate or prove in one than the other

•  BFM is much more numerically stable

•  BFM is useful for radial networks •  Extremely efficient computation (BFS) •  Much better linearization •  Compact extension to multiphase unbalanced nk

Page 12: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Branch flow model Branch flow model Bus injection model

sj = yjkH

k: j~k∑ Vj

2−VjVk

H( )

(V, s)∈C2(n+1)

Sjkj→k∑ = Sij − zij ij( )

i→ j∑ + sj

vi − vj = 2 Re zijHSij( )− zij

2 ij

vi ij = Sij2

+ cycle condition on

x := (s,v,S,ℓ)∈ R3(m+n+1)

Page 13: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

SOCP relaxation Branch flow model Bus injection model

Sjkj→k∑ = Sij − zij ij( )

i→ j∑ + sj

vi − vj = 2 Re zijHSij( )− zij

2 ij

vi ij ≥ Sij2

sj = yjkH

k: j~k∑ Vj

2−VjVk

H( )

(V, s)∈C2(n+1)

x := (s,v,S,ℓ)∈ R3(m+n+1)

Page 14: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

SOCP relaxation of OPF

OPF: minx∈X

f x( )

SOCP: minx∈X+

f x( )

Page 15: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Sufficient conds for exact relaxation IEEE TRANS. ON CONTROL OF NETWORK SYSTEMS, 2014 2

type condition model reference remarkA power injections BIM, BFM [25], [26], [27], [28], [29]

[30], [16], [17]B voltage magnitudes BFM [31], [32], [33], [34] allows general injection regionC voltage angles BIM [35], [36] makes use of branch power flows

TABLE I: Sufficient conditions for radial (tree) networks.

network condition reference remarkwith phase shifters type A, B, C [17, Part II], [37] equivalent to radial networks

direct current type A [17, Part I], [19], [38] assumes nonnegative voltagestype B [39], [40] assumes nonnegative voltages

TABLE II: Sufficient conditions for mesh networks

when the cost function is convex then exactness of the SOCPrelaxation implies uniqueness of the optimal solution forradial networks. Again the equivalence of BIM and BFMimplies that any of the three types of sufficient conditionsguarantees that, for radial networks, there is a unique optimalsolution and it can be computed by solving an SOCP. Sincethe SDP and chordal relaxations are equivalent to the SOCPrelaxation for radial networks [23], [24], these results applyto all three types of relaxations. Empirical evidences suggestsome of these conditions are likely satisfied in practice. Thisis important as most power distribution systems are radial.

These conditions are insufficient for general mesh net-works because they cannot guarantee that an optimal solutionof a relaxation satisfies the cycle condition discussed in [24].In Section IV we show that these conditions are howeversufficient for mesh networks that have tunable phase shiftersat strategic locations. They are also sufficient for directcurrent (dc) mesh networks where all variables are in thereal rather than complex domain.

Counterexamples are known where SDP relaxation is notexact, especially for AC mesh networks [41], [42]. Weconclude in Section V with a discussion on three recentapproaches for global optimization of OPF when the semidef-inite relaxations discussed in this tutorial fail.

All proofs are omitted and can be found in the originalpapers or the arXiv version of this tutorial.

II. OPF AND ITS RELAXATIONS

We adopt the notations and definitions from Part I of thispaper. In this section we summarize the OPF problems andtheir relaxations developed there; see [24] for details.

We use in this paper a strong sense of “exactness” thatrequires that the optimal solution sets of the OPF problemand its relaxation be equivalent. This implies that an optimalsolution of the nonconvex OPF problem can be recoveredfrom every optimal solution of its relaxation. This is impor-tant because it ensures any algorithm that solves an exact

relaxation always produces a globally optimal solution tothe OPF problem. Indeed interior point methods for solvingsemidefinite programs tend to produce a solution matrix witha maximum rank [43], so can miss a rank-1 solution if therelaxation has non-rank-1 solutions as well. It can be difficultto recover an optimal solution of OPF from such a non-rank-1 solution, and our definition of exactness avoids thiscomplication. It is however more stringent than necessaryunder the sufficient conditions of this tutorial; see SectionII-C.

A. Bus injection modelThe BIM adopts an undirected graph G 1 and can be

formulated in terms of just the complex voltage vectorV 2 Cn+1. The feasible set is described by the followingconstraints:

s j Âk:( j,k)2E

yHjk Vj(V H

j �V Hk ) s j, j 2 N+ (1a)

v j |Vj|2 v j, j 2 N+ (1b)

where s j,s j,v j,v j, possibly ±•± i•, are given bounds onpower injections and voltage magnitudes. Note that the vectorV includes V0 which is assumed given (v0 = v0 and \V0 = 0�)unless otherwise specified. The problem of interest is:OPF:

minV2Cn+1

C(V ) s.t. V satisfies (1) (2)

For relaxations consider the partial matrix WG defined onthe network graph G that satisfies

s j Âk:( j,k)2E

yHjk�[WG] j j � [WG] jk

� s j, j 2 N+ (3a)

v j [WG] j j v j, j 2 N+ (3b)

1We will use “bus” and “node” interchangeably and “line” and “link”interchangeably.

Tutorial: Convex relaxation of OPF, IEEE Trans. Control of Network Systems, 2014

For mesh networks, see recent works of Andy Sun, Pascal van Hentenryck on relaxation of cycle condition

Page 16: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Sufficient conds for exact relaxation IEEE TRANS. ON CONTROL OF NETWORK SYSTEMS, 2014 2

type condition model reference remarkA power injections BIM, BFM [25], [26], [27], [28], [29]

[30], [16], [17]B voltage magnitudes BFM [31], [32], [33], [34] allows general injection regionC voltage angles BIM [35], [36] makes use of branch power flows

TABLE I: Sufficient conditions for radial (tree) networks.

network condition reference remarkwith phase shifters type A, B, C [17, Part II], [37] equivalent to radial networks

direct current type A [17, Part I], [19], [38] assumes nonnegative voltagestype B [39], [40] assumes nonnegative voltages

TABLE II: Sufficient conditions for mesh networks

when the cost function is convex then exactness of the SOCPrelaxation implies uniqueness of the optimal solution forradial networks. Again the equivalence of BIM and BFMimplies that any of the three types of sufficient conditionsguarantees that, for radial networks, there is a unique optimalsolution and it can be computed by solving an SOCP. Sincethe SDP and chordal relaxations are equivalent to the SOCPrelaxation for radial networks [23], [24], these results applyto all three types of relaxations. Empirical evidences suggestsome of these conditions are likely satisfied in practice. Thisis important as most power distribution systems are radial.

These conditions are insufficient for general mesh net-works because they cannot guarantee that an optimal solutionof a relaxation satisfies the cycle condition discussed in [24].In Section IV we show that these conditions are howeversufficient for mesh networks that have tunable phase shiftersat strategic locations. They are also sufficient for directcurrent (dc) mesh networks where all variables are in thereal rather than complex domain.

Counterexamples are known where SDP relaxation is notexact, especially for AC mesh networks [41], [42]. Weconclude in Section V with a discussion on three recentapproaches for global optimization of OPF when the semidef-inite relaxations discussed in this tutorial fail.

All proofs are omitted and can be found in the originalpapers or the arXiv version of this tutorial.

II. OPF AND ITS RELAXATIONS

We adopt the notations and definitions from Part I of thispaper. In this section we summarize the OPF problems andtheir relaxations developed there; see [24] for details.

We use in this paper a strong sense of “exactness” thatrequires that the optimal solution sets of the OPF problemand its relaxation be equivalent. This implies that an optimalsolution of the nonconvex OPF problem can be recoveredfrom every optimal solution of its relaxation. This is impor-tant because it ensures any algorithm that solves an exact

relaxation always produces a globally optimal solution tothe OPF problem. Indeed interior point methods for solvingsemidefinite programs tend to produce a solution matrix witha maximum rank [43], so can miss a rank-1 solution if therelaxation has non-rank-1 solutions as well. It can be difficultto recover an optimal solution of OPF from such a non-rank-1 solution, and our definition of exactness avoids thiscomplication. It is however more stringent than necessaryunder the sufficient conditions of this tutorial; see SectionII-C.

A. Bus injection modelThe BIM adopts an undirected graph G 1 and can be

formulated in terms of just the complex voltage vectorV 2 Cn+1. The feasible set is described by the followingconstraints:

s j Âk:( j,k)2E

yHjk Vj(V H

j �V Hk ) s j, j 2 N+ (1a)

v j |Vj|2 v j, j 2 N+ (1b)

where s j,s j,v j,v j, possibly ±•± i•, are given bounds onpower injections and voltage magnitudes. Note that the vectorV includes V0 which is assumed given (v0 = v0 and \V0 = 0�)unless otherwise specified. The problem of interest is:OPF:

minV2Cn+1

C(V ) s.t. V satisfies (1) (2)

For relaxations consider the partial matrix WG defined onthe network graph G that satisfies

s j Âk:( j,k)2E

yHjk�[WG] j j � [WG] jk

� s j, j 2 N+ (3a)

v j [WG] j j v j, j 2 N+ (3b)

1We will use “bus” and “node” interchangeably and “line” and “link”interchangeably.

Tutorial: Convex relaxation of OPF, IEEE Trans. Control of Network Systems, 2014

For mesh networks, see recent works of Andy Sun, Pascal van Hentenryck on relaxation of cycle condition

Page 17: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

SOCP relaxation of OPF

OPF: minx∈X

f x( )

SOCP: minx∈X+

f x( )

But all these algorithms are offline … … unsuitable for real-time optimization of network of distributed energy resources

Page 18: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

OPF

3

B. Optimal power flow (OPF)The OPF problem that we seek to solve is:

min

nX

i=0

aip2

i + bipi (3a)

over x := (pi, qi, i 2 N)

y := (p0

, q0

, vi, i 2 N ;Pij , Qij , `ij , (i, j) 2 E)

s.t. (2)vi vi vi, i 2 N (3b)pi pi pi, q

i qi qi, i 2 N (3c)

The objective function (3a) is assumed to be separable,quadratic, and purely a function of real power injections p.Equation (3b) represents the voltage constraints, and (3c)represents the power injection constraints. If there is no boundon an injection xj then we set xj = �1 or/and xj = 1. Onthe other hand if an injection xj is fixed (e.g. a constant-powerload) then we set xj = xj to the specified value.

OPF as defined (3) is a simplified version that ignores otherimportant constraints such as line limits, security constraints,stability constraints, and chance constraints. Some of these(e.g., including shunt elements or line limits on `ij) can beincorporated without much change to the results in this paper.

III. SOLUTION STRATEGY

We are motivated by the need to optimize the operationof a large network of distributed energy resources in thefuture, such as distributed wind and solar generations, electricvehicles, smart buildings, smart appliances, storage devices,and power electronics. We model these controllable devicesby injections x := (pi, qi, i 2 N).2 We will develop a gradientprojection algorithm that iteratively solves an approximateversion of the OPF problem (3) as follows: at each iterationt,

1) the algorithm applies the current iterate x(t) to thenetwork;

2) the network automatically computes the dependent vari-ables y(t) according to the power flow equations (2);

3) the algorithm computes x(t + 1) based on (x(t), y(t))using a gradient projection algorithm; goto 1 until con-verge.

Hence we explicitly exploit the law of physics, modeled bypower flow equations (2), to carry out part of the gradientprojection algorithm to solve approximately our OPF problem.The key advantage of this approach is that, by applyingintermediate iterates (x(t), y(t)) to the network at each t, itcan be used in real time for continuous feedback control totrack evolving network conditions. This is in stark contrast tomost traditional OPF algorithms where intermediate iterates(x(t), y(t)) do not satisfy power flow equations and thereforecannot be implemented until the algorithms have converged.We will comment on the communication requirements toimplement this strategy in Section VI.

We now describe the approximate OPF problem that wesolve, in two steps.

2An injection that is constant and not controllable is modeled by settingp

i

= p

i

and/or qi

= q

i

.

A. Injection optimization

We first transform (3) into one where the optimizationvariable is only x. To this end, let

X := { (pi, qi) | pi pi pi, q

i qi qi, i 2 N } (4)

Write the power flow equations (2), in terms of a continuouslydifferentiable function F : X ! R2(m+n+1), as:

F (x, y) = 0 (5)

We make the following assumption throughout the paper:A1: Given any x 2 X (and v

0

), there is a unique y that solvesthe power flow equation (5) and satisfies the voltageconstraints (3b). Moreover the Jacobian matrix @yF (x, y)at (x, y) is nonsingular.

A1 is widely believed to hold in practice for radial networksand a rigorous proof for some special cases are provided in[9].

Equation (5) hence defines implicitly a function y = y(x)over X:

p0

:= p0

(x), q0

:= q0

(x);

vi := vi(x), i 2 N

Pij := Pij(x), Qij := Qij(x), `ij = `ij(x), i ! j

such that F (x, y(x)) = 0. Then the OPF problem (3) can bewritten in terms of x:

min a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi) (6a)

over x := (pi, qi, i 2 N) 2 X (6b)s.t. vi vi(x) vi, i 2 N (6c)

where X is defined in (4). While (6) is equivalent to (3),(6) has much fewer optimization variables and is thereforepotentially more efficient to compute. Note however that while(3b) is linear in vi, (6c) is generally nonlinear nonlinear in x.

B. Modified OPF

The nonlinear voltage constraints (6c) couple the variablesx = (pi, qi, i 2 N). To further simplify the feasible set tofacilitate a distributed algorithm (see [19]) where each bus iupdates its own (pi, qi) locally, we replace the hard constraints(6c) by a log-barrier function in the objective that prevents thevoltages from violating (6c):

L(x;µ) := a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi)

� µnX

i=1

ln(vi(x) � vi) � µnX

i=1

ln(vi � vi(x))

(7)

where µ = (µ, µ) > 0 componentwise. Since

lim

t#vi

�µ ln(t � vi) = 1, lim

t"vi

�µ ln(vi � t) = 1, i 2 N

F(x, y) = 0 BFM

controllable devices

uncontrollable state

Page 19: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

OPF

3

B. Optimal power flow (OPF)The OPF problem that we seek to solve is:

min

nX

i=0

aip2

i + bipi (3a)

over x := (pi, qi, i 2 N)

y := (p0

, q0

, vi, i 2 N ;Pij , Qij , `ij , (i, j) 2 E)

s.t. (2)vi vi vi, i 2 N (3b)pi pi pi, q

i qi qi, i 2 N (3c)

The objective function (3a) is assumed to be separable,quadratic, and purely a function of real power injections p.Equation (3b) represents the voltage constraints, and (3c)represents the power injection constraints. If there is no boundon an injection xj then we set xj = �1 or/and xj = 1. Onthe other hand if an injection xj is fixed (e.g. a constant-powerload) then we set xj = xj to the specified value.

OPF as defined (3) is a simplified version that ignores otherimportant constraints such as line limits, security constraints,stability constraints, and chance constraints. Some of these(e.g., including shunt elements or line limits on `ij) can beincorporated without much change to the results in this paper.

III. SOLUTION STRATEGY

We are motivated by the need to optimize the operationof a large network of distributed energy resources in thefuture, such as distributed wind and solar generations, electricvehicles, smart buildings, smart appliances, storage devices,and power electronics. We model these controllable devicesby injections x := (pi, qi, i 2 N).2 We will develop a gradientprojection algorithm that iteratively solves an approximateversion of the OPF problem (3) as follows: at each iterationt,

1) the algorithm applies the current iterate x(t) to thenetwork;

2) the network automatically computes the dependent vari-ables y(t) according to the power flow equations (2);

3) the algorithm computes x(t + 1) based on (x(t), y(t))using a gradient projection algorithm; goto 1 until con-verge.

Hence we explicitly exploit the law of physics, modeled bypower flow equations (2), to carry out part of the gradientprojection algorithm to solve approximately our OPF problem.The key advantage of this approach is that, by applyingintermediate iterates (x(t), y(t)) to the network at each t, itcan be used in real time for continuous feedback control totrack evolving network conditions. This is in stark contrast tomost traditional OPF algorithms where intermediate iterates(x(t), y(t)) do not satisfy power flow equations and thereforecannot be implemented until the algorithms have converged.We will comment on the communication requirements toimplement this strategy in Section VI.

We now describe the approximate OPF problem that wesolve, in two steps.

2An injection that is constant and not controllable is modeled by settingp

i

= p

i

and/or qi

= q

i

.

A. Injection optimization

We first transform (3) into one where the optimizationvariable is only x. To this end, let

X := { (pi, qi) | pi pi pi, q

i qi qi, i 2 N } (4)

Write the power flow equations (2), in terms of a continuouslydifferentiable function F : X ! R2(m+n+1), as:

F (x, y) = 0 (5)

We make the following assumption throughout the paper:A1: Given any x 2 X (and v

0

), there is a unique y that solvesthe power flow equation (5) and satisfies the voltageconstraints (3b). Moreover the Jacobian matrix @yF (x, y)at (x, y) is nonsingular.

A1 is widely believed to hold in practice for radial networksand a rigorous proof for some special cases are provided in[9].

Equation (5) hence defines implicitly a function y = y(x)over X:

p0

:= p0

(x), q0

:= q0

(x);

vi := vi(x), i 2 N

Pij := Pij(x), Qij := Qij(x), `ij = `ij(x), i ! j

such that F (x, y(x)) = 0. Then the OPF problem (3) can bewritten in terms of x:

min a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi) (6a)

over x := (pi, qi, i 2 N) 2 X (6b)s.t. vi vi(x) vi, i 2 N (6c)

where X is defined in (4). While (6) is equivalent to (3),(6) has much fewer optimization variables and is thereforepotentially more efficient to compute. Note however that while(3b) is linear in vi, (6c) is generally nonlinear nonlinear in x.

B. Modified OPF

The nonlinear voltage constraints (6c) couple the variablesx = (pi, qi, i 2 N). To further simplify the feasible set tofacilitate a distributed algorithm (see [19]) where each bus iupdates its own (pi, qi) locally, we replace the hard constraints(6c) by a log-barrier function in the objective that prevents thevoltages from violating (6c):

L(x;µ) := a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi)

� µnX

i=1

ln(vi(x) � vi) � µnX

i=1

ln(vi � vi(x))

(7)

where µ = (µ, µ) > 0 componentwise. Since

lim

t#vi

�µ ln(t � vi) = 1, lim

t"vi

�µ ln(vi � t) = 1, i 2 N

F(x, y) = 0 BFM (DistFlow, radial network)

Assume: ∂F∂y

≠ 0 ⇒ y(x) over X

controllable devices

x ∈ X := x ≤ x ≤ x{ }

Page 20: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Eliminate y from OPF

3

B. Optimal power flow (OPF)The OPF problem that we seek to solve is:

min

nX

i=0

aip2

i + bipi (3a)

over x := (pi, qi, i 2 N)

y := (p0

, q0

, vi, i 2 N ;Pij , Qij , `ij , (i, j) 2 E)

s.t. (2)vi vi vi, i 2 N (3b)pi pi pi, q

i qi qi, i 2 N (3c)

The objective function (3a) is assumed to be separable,quadratic, and purely a function of real power injections p.Equation (3b) represents the voltage constraints, and (3c)represents the power injection constraints. If there is no boundon an injection xj then we set xj = �1 or/and xj = 1. Onthe other hand if an injection xj is fixed (e.g. a constant-powerload) then we set xj = xj to the specified value.

OPF as defined (3) is a simplified version that ignores otherimportant constraints such as line limits, security constraints,stability constraints, and chance constraints. Some of these(e.g., including shunt elements or line limits on `ij) can beincorporated without much change to the results in this paper.

III. SOLUTION STRATEGY

We are motivated by the need to optimize the operationof a large network of distributed energy resources in thefuture, such as distributed wind and solar generations, electricvehicles, smart buildings, smart appliances, storage devices,and power electronics. We model these controllable devicesby injections x := (pi, qi, i 2 N).2 We will develop a gradientprojection algorithm that iteratively solves an approximateversion of the OPF problem (3) as follows: at each iterationt,

1) the algorithm applies the current iterate x(t) to thenetwork;

2) the network automatically computes the dependent vari-ables y(t) according to the power flow equations (2);

3) the algorithm computes x(t + 1) based on (x(t), y(t))using a gradient projection algorithm; goto 1 until con-verge.

Hence we explicitly exploit the law of physics, modeled bypower flow equations (2), to carry out part of the gradientprojection algorithm to solve approximately our OPF problem.The key advantage of this approach is that, by applyingintermediate iterates (x(t), y(t)) to the network at each t, itcan be used in real time for continuous feedback control totrack evolving network conditions. This is in stark contrast tomost traditional OPF algorithms where intermediate iterates(x(t), y(t)) do not satisfy power flow equations and thereforecannot be implemented until the algorithms have converged.We will comment on the communication requirements toimplement this strategy in Section VI.

We now describe the approximate OPF problem that wesolve, in two steps.

2An injection that is constant and not controllable is modeled by settingp

i

= p

i

and/or qi

= q

i

.

A. Injection optimization

We first transform (3) into one where the optimizationvariable is only x. To this end, let

X := { (pi, qi) | pi pi pi, q

i qi qi, i 2 N } (4)

Write the power flow equations (2), in terms of a continuouslydifferentiable function F : X ! R2(m+n+1), as:

F (x, y) = 0 (5)

We make the following assumption throughout the paper:A1: Given any x 2 X (and v

0

), there is a unique y that solvesthe power flow equation (5) and satisfies the voltageconstraints (3b). Moreover the Jacobian matrix @yF (x, y)at (x, y) is nonsingular.

A1 is widely believed to hold in practice for radial networksand a rigorous proof for some special cases are provided in[9].

Equation (5) hence defines implicitly a function y = y(x)over X:

p0

:= p0

(x), q0

:= q0

(x);

vi := vi(x), i 2 N

Pij := Pij(x), Qij := Qij(x), `ij = `ij(x), i ! j

such that F (x, y(x)) = 0. Then the OPF problem (3) can bewritten in terms of x:

min a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi) (6a)

over x := (pi, qi, i 2 N) 2 X (6b)s.t. vi vi(x) vi, i 2 N (6c)

where X is defined in (4). While (6) is equivalent to (3),(6) has much fewer optimization variables and is thereforepotentially more efficient to compute. Note however that while(3b) is linear in vi, (6c) is generally nonlinear nonlinear in x.

B. Modified OPF

The nonlinear voltage constraints (6c) couple the variablesx = (pi, qi, i 2 N). To further simplify the feasible set tofacilitate a distributed algorithm (see [19]) where each bus iupdates its own (pi, qi) locally, we replace the hard constraints(6c) by a log-barrier function in the objective that prevents thevoltages from violating (6c):

L(x;µ) := a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi)

� µnX

i=1

ln(vi(x) � vi) � µnX

i=1

ln(vi � vi(x))

(7)

where µ = (µ, µ) > 0 componentwise. Since

lim

t#vi

�µ ln(t � vi) = 1, lim

t"vi

�µ ln(vi � t) = 1, i 2 N

x ∈ X := x ≤ x ≤ x{ }

Page 21: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Online (real-time) perspective

Network: power flow solver y(t) : F(x(t), y(t)) = 0

DER : gradient updatex(t+1) = G(x(t), y(t))

control x(t)

measurement, communication

y(t)

Page 22: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Approximate OPF

3

B. Optimal power flow (OPF)The OPF problem that we seek to solve is:

min

nX

i=0

aip2

i + bipi (3a)

over x := (pi, qi, i 2 N)

y := (p0

, q0

, vi, i 2 N ;Pij , Qij , `ij , (i, j) 2 E)

s.t. (2)vi vi vi, i 2 N (3b)pi pi pi, q

i qi qi, i 2 N (3c)

The objective function (3a) is assumed to be separable,quadratic, and purely a function of real power injections p.Equation (3b) represents the voltage constraints, and (3c)represents the power injection constraints. If there is no boundon an injection xj then we set xj = �1 or/and xj = 1. Onthe other hand if an injection xj is fixed (e.g. a constant-powerload) then we set xj = xj to the specified value.

OPF as defined (3) is a simplified version that ignores otherimportant constraints such as line limits, security constraints,stability constraints, and chance constraints. Some of these(e.g., including shunt elements or line limits on `ij) can beincorporated without much change to the results in this paper.

III. SOLUTION STRATEGY

We are motivated by the need to optimize the operationof a large network of distributed energy resources in thefuture, such as distributed wind and solar generations, electricvehicles, smart buildings, smart appliances, storage devices,and power electronics. We model these controllable devicesby injections x := (pi, qi, i 2 N).2 We will develop a gradientprojection algorithm that iteratively solves an approximateversion of the OPF problem (3) as follows: at each iterationt,

1) the algorithm applies the current iterate x(t) to thenetwork;

2) the network automatically computes the dependent vari-ables y(t) according to the power flow equations (2);

3) the algorithm computes x(t + 1) based on (x(t), y(t))using a gradient projection algorithm; goto 1 until con-verge.

Hence we explicitly exploit the law of physics, modeled bypower flow equations (2), to carry out part of the gradientprojection algorithm to solve approximately our OPF problem.The key advantage of this approach is that, by applyingintermediate iterates (x(t), y(t)) to the network at each t, itcan be used in real time for continuous feedback control totrack evolving network conditions. This is in stark contrast tomost traditional OPF algorithms where intermediate iterates(x(t), y(t)) do not satisfy power flow equations and thereforecannot be implemented until the algorithms have converged.We will comment on the communication requirements toimplement this strategy in Section VI.

We now describe the approximate OPF problem that wesolve, in two steps.

2An injection that is constant and not controllable is modeled by settingp

i

= p

i

and/or qi

= q

i

.

A. Injection optimization

We first transform (3) into one where the optimizationvariable is only x. To this end, let

X := { (pi, qi) | pi pi pi, q

i qi qi, i 2 N } (4)

Write the power flow equations (2), in terms of a continuouslydifferentiable function F : X ! R2(m+n+1), as:

F (x, y) = 0 (5)

We make the following assumption throughout the paper:A1: Given any x 2 X (and v

0

), there is a unique y that solvesthe power flow equation (5) and satisfies the voltageconstraints (3b). Moreover the Jacobian matrix @yF (x, y)at (x, y) is nonsingular.

A1 is widely believed to hold in practice for radial networksand a rigorous proof for some special cases are provided in[9].

Equation (5) hence defines implicitly a function y = y(x)over X:

p0

:= p0

(x), q0

:= q0

(x);

vi := vi(x), i 2 N

Pij := Pij(x), Qij := Qij(x), `ij = `ij(x), i ! j

such that F (x, y(x)) = 0. Then the OPF problem (3) can bewritten in terms of x:

min a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi) (6a)

over x := (pi, qi, i 2 N) 2 X (6b)s.t. vi vi(x) vi, i 2 N (6c)

where X is defined in (4). While (6) is equivalent to (3),(6) has much fewer optimization variables and is thereforepotentially more efficient to compute. Note however that while(3b) is linear in vi, (6c) is generally nonlinear nonlinear in x.

B. Modified OPF

The nonlinear voltage constraints (6c) couple the variablesx = (pi, qi, i 2 N). To further simplify the feasible set tofacilitate a distributed algorithm (see [19]) where each bus iupdates its own (pi, qi) locally, we replace the hard constraints(6c) by a log-barrier function in the objective that prevents thevoltages from violating (6c):

L(x;µ) := a0

p20

(x) + b0

p0

(x) +nX

i=1

(aip2

i + bipi)

� µnX

i=1

ln(vi(x) � vi) � µnX

i=1

ln(vi � vi(x))

(7)

where µ = (µ, µ) > 0 componentwise. Since

lim

t#vi

�µ ln(t � vi) = 1, lim

t"vi

�µ ln(vi � t) = 1, i 2 N

x ∈ X := x ≤ x ≤ x{ }

Recap •  Reduce to x only •  Add barrier function on v(x)

min L(x, y(x); µ)over x ∈ X := x ≤ x ≤ x{ }L: nonconvex

add log barrier function to objective

Page 23: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Online gradient algorithm min L(x, y(x); µ)over x ∈ X := x ≤ x ≤ x{ }

x(t +1) = x(t)−η ∂L∂x

(t)#

$%&

'(Xy(t) = y(x(t))

gradient projection algorithm:

•  Explicitly exploits network to carry out part of algorithm •  Naturally tracks changing network conditions

active control

law of physics

Page 24: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Online gradient algorithm min L(x, y(x); µ)over x ∈ X := x ≤ x ≤ x{ }

x(t +1) = x(t)−η ∂L∂x

(t)#

$%&

'(Xy(t) = y(x(t))

gradient projection algorithm:

active control

law of physics

Results 1.  Local optimality 2.  Global optimality 3.  Suboptimality bound [Gan & Low 2016 JSAC]

Page 25: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Local optimality n  x(t) converges to set of local optima n  if #local optima is finite, x(t) converges

Page 26: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Global optimality

A := x ∈ X : v(x) ≤ akv + bk v{ }

Assume: p0 (x) convex over X vk (x) concave over X

Theorem

If all local optima are in A then

n  x(t) converges to the set of global optima

n  x(t) itself converges a global optimum

Page 27: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Global optimality

A := x ∈ X : v(x) ≤ akv + bk v{ }

Assume: p0 (x) convex over X vk (x) concave over X

Theorem

n 

n  If SOCP is exact over X, then assumption holds

can choose ak,bk( ) s.t. A→ original feasible set

Page 28: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Suboptimality gap

n  Informally, a local minimum is almost as good as any strictly interior feasible point

≈ 0L x*( ) − L x( ) ≤ ρ

local optimum

any original feasible pt

slightly away from boundary

Page 29: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Simulations

11

TABLE IOBJECTIVE VALUES AND CPU TIMES OF CVX AND IPM

# bus CVX IPM error speedupobj time(s) obj time(s)42 10.4585 6.5267 10.4585 0.2679 -0.0e-7 24.3656 34.8989 7.1077 34.8989 0.3924 +0.2e-7 18.11111 0.0751 11.3793 0.0751 0.8529 +5.4e-6 13.34190 0.1394 20.2745 0.1394 1.9968 +3.3e-6 10.15290 0.2817 23.8817 0.2817 4.3564 +1.1e-7 5.48390 0.4292 29.8620 0.4292 2.9405 +5.4e-7 10.16490 0.5526 36.3591 0.5526 3.0072 +2.9e-7 12.09590 0.7035 43.6932 0.7035 4.4655 +2.4e-7 9.78690 0.8546 51.9830 0.8546 3.2247 +0.7e-7 16.12790 0.9975 62.3654 0.9975 2.6228 +0.7e-7 23.78890 1.1685 67.7256 1.1685 2.0507 +0.8e-7 33.03990 1.3930 74.8522 1.3930 2.7747 +1.0e-7 26.98

1091 1.5869 83.2236 1.5869 1.0869 +1.2e-7 76.571190 1.8123 92.4484 1.8123 1.2121 +1.4e-7 76.271290 2.0134 101.0380 2.0134 1.3525 +1.6e-7 74.701390 2.2007 111.0839 2.2007 1.4883 +1.7e-7 74.641490 2.4523 122.1819 2.4523 1.6372 +1.9e-7 74.831590 2.6477 157.8238 2.6477 1.8021 +2.0e-7 87.581690 2.8441 147.6862 2.8441 1.9166 +2.1e-7 77.061790 3.0495 152.6081 3.0495 2.0603 +2.1e-7 74.071890 3.8555 160.4689 3.8555 2.1963 +1.9e-7 73.061990 4.1424 171.8137 4.1424 2.3586 +1.9e-7 72.84

VIII. CONCLUSIONS

We have proposed an online algorithm for solving OPFon radial networks where the controllable devices continu-ously interact with the network that implicitly computes apower flow solution given a control action. Collectively thecontrollable devices and the network implement a gradientprojection algorithm for the OPF problem in real time. Thekey feature that enables this approach is that the intermediateiterates always satisfy power flow equations and operationalconstraints. We have proved the convergence and optimalityof the proposed algorithm and have bounded the suboptimalitygap of any local minimum.

To greatly reduce the gradient computation in each iteration,we have derive approximate gradient based on linearizedpower flow equations. We have also outlined how these algo-rithms can be extended to multiphase unbalanced networks.Finally the evaluation of our algorithm on test networks,ranging from 42-bus to 1990-bus, shows more than 70xspeedup over a semidefinite relaxation method with negligibledifference in objective values.

It is therefore promising to further develop the algorithmsin this paper for real-time applications. A key challenge toovercome is to minimize the measurement and communicationrequirements so that these algorithms can be implemented inreal time by a large network of distributed energy resources,building on the ideas in [19].

REFERENCES

[1] M. E. Baran and F. F. Wu. Optimal Capacitor Placement on radialdistribution systems. IEEE Transactions on Power Delivery, 4(1):725–734, 1989.

[2] M. E. Baran and F. F. Wu. Optimal Sizing of Capacitors Placed on ARadial Distribution System. IEEE Trans. Power Delivery, 4(1):735–743,1989.

[3] D. P. Bertsekas and J. N. Tsitsiklis. Parallel and distributed computation.Old Tappan, NJ (USA); Prentice Hall Inc., 1989.

[4] S. Bolognani, R. Carli, G. Cavraro, and S. Zampieri. A distributedfeedback control strategy for optimal reactive power flow with voltageconstraints. arXiv, 2013.

[5] M. B. Cain, R. P. O’Neill, and A. Castillo. History of optimal powerflow and formulations. Federal Energy Regulatory Commission, 2012.

[6] J. Carpentier. Contribution to the economic dispatch problem. Bulletinde la Societe Francoise des Electriciens, 3(8):431–447, 1962. In French.

[7] A. Castillo and R. P. O’Neill. Computational performance of solutiontechniques applied to the ACOPF (OPF Paper 5). Technical report, USFERC, March 2013.

[8] A. Castillo and R. P. O’Neill. Survey of approaches to solving theACOPF. Technical report, US FERC Technical report, 2013.

[9] H.-D. Chiang and M. E. Baran. On the existence and uniqueness ofload flow solution for radial distribution power networks. IEEE Trans.Circuits and Systems, 37(3):410–416, March 1990.

[10] E. Dall’Anese, H. Zhu, and G. B. Giannakis. Distributed optimal powerflow for smart microgrids. IEEE Trans. on Smart Grid, 4(3):1464–1475,September 2013.

[11] H. Dommel and W. Tinney. Optimal power flow solutions. IEEETransactions on Power Apparatus and Systems, PAS-87(10):1866–1876,1968.

[12] M. Farivar, L. Chen, and S. H. Low. Equilibrium and dynamics of localvoltage control in distribution systems. In Proc. IEEE CDC, December2013.

[13] M. Farivar, C. R. Clarke, S. H. Low, and K. M. Chandy. Inverter VARcontrol for distribution systems with renewables. In IEEE SmartGrid-Comm, pages 457–462, 2011.

[14] M. Farivar and S. H. Low. Branch flow model: relaxations andconvexification (parts I, II). IEEE Transactions on Power Systems,28(3):2554–2572, 2013.

[15] M. Farivar, R. Neal, C. Clarke, and S. Low. Optimal inverter var controlin distribution systems with high PV penetration. In PES GeneralMeeting, pages 1–7, 2012.

[16] S. Frank, I. Steponavice, and S. Rebennack. Optimal power flow: abibliographic survey i. Energy Systems, 3(3):221–258, 2012.

[17] S. Frank, I. Steponavice, and S. Rebennack. Optimal power flow: abibliographic survey, II: nondeterministic and hybrid methods. EnergySystems, 3:259–289, September 2013.

[18] L. Gan. A distributed algorithm for solving the optimal load controlproblem in multiphase radial networks. http://www.its.caltech.edu/⇠lgan/, August 2014.

[19] L. Gan. Distributed Load Control in Multiphase Radial Networks. PhDthesis, Caltech, 2015.

[20] L. Gan, N. Li, U. Topcu, and S. H. Low. Exact convex relaxation ofoptimal power flow in radial networks. IEEE Transactions on AutomaticControl, 60(1):72–87, January 2015.

[21] L. Gan and S. H. Low. Convex relaxations and linear approximationfor optimal power flow in multiphase radial networks. In Proc. of the18th Power Systems Computation Conference (PSCC), Wroclaw, Poland,August 2014.

[22] M. Grant, S. Boyd, and Y. Ye. Cvx: Matlab software for disciplinedconvex programming. online at http://cvxr.com/cvx/, 2008.

[23] M. Huneault and F. D. Galiana. A survey of the optimal power flowliterature. IEEE Transactions on Power Systems, 6(2):762–770, 1991.

[24] W. H. Kersting. Distribution systems modeling and analysis. CRC,2002.

[25] S. H. Low. Convex relaxation of optimal power flow, I: formulations andrelaxations. IEEE Trans. on Control of Network Systems, 1(1):15–27,March 2014.

[26] S. H. Low. Convex relaxation of optimal power flow, II: exactness. IEEETrans. on Control of Network Systems, 1(2):177–189, June 2014.

[27] J. A. Momoh. Electric Power System Applications of Optimization.Power Engineering. Markel Dekker Inc.: New York, USA, 2001.

[28] J. A. Momoh, M. E. El-Hawary, and R. Adapa. A review of selectedoptimal power flow literature to 1993. Part I: Nonlinear and quadraticprogramming approaches. IEEE Transactions on Power Systems,14(1):96–104, 1999.

[29] J. A. Momoh, M. E. El-Hawary, and R. Adapa. A review of selected op-timal power flow literature to 1993. Part II: Newton, linear programmingand interior point methods. IEEE Trans. on Power Systems, 14(1):105– 111, 1999.

[30] R. P. O’Neill, A. Castillo, and M. B. Cain. The computational testingof AC optimal power flow using the current voltage formulations (OPFPaper 3). Technical report, US FERC, December 2012.

[31] R. P. O’Neill, A. Castillo, and M. B. Cain. The IV formulation and linearapproximations of the AC optimal power flow problem (OPF Paper 2).Technical report, US FERC, December 2012.

Page 30: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Optimal power flow n  DistFlow model and ACOPF n  Online algorithm n  Analysis and simulations

Load-side frequency control n  Dynamic model & design approach n  Distributed online algorithm n  Analysis and simulations n  Details

Main references (frequency control): Zhao, Topcu, Li, L, TAC 2014 Mallada, Zhao, L, Allerton 2014 Zhao et al: CDC 2014, CISS 2015, PSCC 2016

Page 31: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

2011 Southwest blackout

(1 min)

n  All buses synchronized to same nominal frequency (US: 60 Hz; Europe/China: 50 Hz)

n  Supply-demand imbalance è frequency fluctuation

Motivation

Page 32: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Imagine when we have 50%+ renewable generation …

(1 min)

(10 min)

Motivation

Page 33: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Why load-side participation

sec min 5 min 60 min

primary freq control

secondary freq control

economic dispatch

Ubiquitous continuous load-side control can supplement generator-side control

n  faster (no/low inertia) n  no extra waste or emission n  more reliable (large #) n  better localize disturbances n  reducing generator-side control capacity

Page 34: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

What is the potential

1

Abstract— This paper addresses design considerations for

frequency responsive Grid FriendlyTM appliances (FR-GFAs), which can turn on/off based on frequency signals and make selective low-frequency load shedding possible at appliance level. FR-GFAs can also be treated as spinning reserve to maintain a load-to-generation balance under power system normal operation states. The paper first presents a statistical analysis on the frequency data collected in 2003 in Western Electricity Coordinating Council (WECC) systems. Using these frequency data as an input, the triggering frequency and duration of an FR-GFA device with different frequency setting schemes are simulated. Design considerations of the FR-GFA are then discussed based on simulation results.

Index Terms—Grid FriendlyTM appliances, load frequency

control, load shedding, frequency regulation, frequency response, load control, demand-side management, automated load control.

I. INTRODUCTION

RADITIONALLY, services such as frequency regulation, load following, and spinning reserves were provided by

generators. Under a contingency where the system frequency falls below a certain threshold, under-frequency relays are triggered to shed load to restore the load-to-generator balance. In restructured power systems, the services provided may be market based. Because load control can play a role very similar to generator real power control in maintaining the power system equilibrium, it can not only participate in under-frequency load shedding programs as a fast remedial action under emergency conditions, but also be curtailed or reduced in normal operation states and supply energy-balancing services [1][2][3].

Grid FriendlyTM appliances (GFAs) are appliances that can have a sensor and a controller installed to detect frequency signals and turn on or off according to certain control logic, thereby helping the electrical power grid with its frequency control objectives. Refrigerators, air conditioners, space heating units, water heaters, freezers, dish washers, clothes washers, dryers, and some cooking units are all potential GFAs. Survey [4] shows that nearly one-third of U.S. peak

This work is supported by the Pacific Northwest National Laboratory,

operated for the U.S. Department of Energy by Battelle under Contract DE-AC05-76RL01830.

N. Lu and D. J. Hammerstrom are with the Energy Science and Technology Division, Pacific Northwest National Laboratory, P.O. Box 999, MSIN: K5-20, Richland, WA - 99352, USA (e-mail: [email protected], [email protected])

load capacity is residential (Fig. 1a). The residential load can be categorized into GFA and non-GFA loads. Based on a residential energy consumption survey (Fig. 1b) conducted in 1997, 61% of residential loads are GFA compatible. If all GFA resources were used, the regulation ability of load would exceed the operating reserve (13% of peak load capacity) provided by generators.

(a)

(b)

Fig. 1. (a) Load and reserves on a typical U.S. peak day, (b) Residential load components. [4]

Compared with the spinning reserve provided by generators, GFA resources have the advantage of faster response time and greater capacity when aggregated at feeder level. However, the GFA resources also have disadvantages, such as low individual power load, poor coordination between units, and uncertain availabilities caused by consumer comfort choices and usages. Another critical issue is the coordination between regulation services provided by FR-GFAs and generators. Therefore, whether FR-GFAs can achieve similar regulation capabilities as generators is a key issue to be addressed before one can deploy FR-GFAs widely.

As a first step to evaluate the FR-GFA performance, a research team at Pacific Northwest National Laboratory (PNNL) carried out a series of simulations which focused on studying the individual FR-GFA performance to obtain basic operational statistics under different frequency setting

Design Considerations for Frequency Responsive Grid FriendlyTM Appliances

Ning Lu, Member, IEEE and Donald J. Hammerstrom, Member, IEEE

T

1

Abstract— This paper addresses design considerations for

frequency responsive Grid FriendlyTM appliances (FR-GFAs), which can turn on/off based on frequency signals and make selective low-frequency load shedding possible at appliance level. FR-GFAs can also be treated as spinning reserve to maintain a load-to-generation balance under power system normal operation states. The paper first presents a statistical analysis on the frequency data collected in 2003 in Western Electricity Coordinating Council (WECC) systems. Using these frequency data as an input, the triggering frequency and duration of an FR-GFA device with different frequency setting schemes are simulated. Design considerations of the FR-GFA are then discussed based on simulation results.

Index Terms—Grid FriendlyTM appliances, load frequency

control, load shedding, frequency regulation, frequency response, load control, demand-side management, automated load control.

I. INTRODUCTION

RADITIONALLY, services such as frequency regulation, load following, and spinning reserves were provided by

generators. Under a contingency where the system frequency falls below a certain threshold, under-frequency relays are triggered to shed load to restore the load-to-generator balance. In restructured power systems, the services provided may be market based. Because load control can play a role very similar to generator real power control in maintaining the power system equilibrium, it can not only participate in under-frequency load shedding programs as a fast remedial action under emergency conditions, but also be curtailed or reduced in normal operation states and supply energy-balancing services [1][2][3].

Grid FriendlyTM appliances (GFAs) are appliances that can have a sensor and a controller installed to detect frequency signals and turn on or off according to certain control logic, thereby helping the electrical power grid with its frequency control objectives. Refrigerators, air conditioners, space heating units, water heaters, freezers, dish washers, clothes washers, dryers, and some cooking units are all potential GFAs. Survey [4] shows that nearly one-third of U.S. peak

This work is supported by the Pacific Northwest National Laboratory,

operated for the U.S. Department of Energy by Battelle under Contract DE-AC05-76RL01830.

N. Lu and D. J. Hammerstrom are with the Energy Science and Technology Division, Pacific Northwest National Laboratory, P.O. Box 999, MSIN: K5-20, Richland, WA - 99352, USA (e-mail: [email protected], [email protected])

load capacity is residential (Fig. 1a). The residential load can be categorized into GFA and non-GFA loads. Based on a residential energy consumption survey (Fig. 1b) conducted in 1997, 61% of residential loads are GFA compatible. If all GFA resources were used, the regulation ability of load would exceed the operating reserve (13% of peak load capacity) provided by generators.

(a)

(b)

Fig. 1. (a) Load and reserves on a typical U.S. peak day, (b) Residential load components. [4]

Compared with the spinning reserve provided by generators, GFA resources have the advantage of faster response time and greater capacity when aggregated at feeder level. However, the GFA resources also have disadvantages, such as low individual power load, poor coordination between units, and uncertain availabilities caused by consumer comfort choices and usages. Another critical issue is the coordination between regulation services provided by FR-GFAs and generators. Therefore, whether FR-GFAs can achieve similar regulation capabilities as generators is a key issue to be addressed before one can deploy FR-GFAs widely.

As a first step to evaluate the FR-GFA performance, a research team at Pacific Northwest National Laboratory (PNNL) carried out a series of simulations which focused on studying the individual FR-GFA performance to obtain basic operational statistics under different frequency setting

Design Considerations for Frequency Responsive Grid FriendlyTM Appliances

Ning Lu, Member, IEEE and Donald J. Hammerstrom, Member, IEEE

T US: operating reserve: 13% of peak total GFA capacity: 18%

Lu & Hammerstrom (2006), PNNL

•  Residential load accounts for ~1/3 of peak demand •  61% residential appliances are Grid Friendly

Page 35: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

How

How to design load-side frequency control ? How does it interact with generator-side control ?

Page 36: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Literature: load-side control Original idea & early analytical work

n  Schweppe et al 1980; Bergin, Hill, Qu, Dorsey, Wang, Varaiya … Small scale trials around the world

n  D.Hammerstrom et al 2007, UK Market Transform Programme 2008

Early simulation studies n  Trudnowski et al 2006, Lu and Hammerstrom 2006, Short et al

2007, Donnelly et al 2010, Brooks et al 2010, Callaway and I. A. Hiskens, 2011, Molina-Garcia et al 2011

Analytical work – load-side control n  Zhao et al (2012/2014), Mallada and Low (2014), Mallada et al

(2014), Zhao and Low (2014), Zhao et al (2015) n  Simpson-Porco et al 2013, You and Chen 2014, Zhang and

Papachristodoulou (2014), Ma et al (2014), Zhao, et al (2014), Recent analysis – generator-side/microgrid control:

n  Andreasson et al (2013), Zhang and Papachristodoulou (2013), Li et al (2014), Burger et al (2014), You and Chen (2014), Simpson-Porco et al (2013), Hill et al (2014), Dorfler et al (2014)

Page 37: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Network model

i

Pim

generation

di + diloads:

controllable + freq-sensitive

i : region/control area/balancing authority

j

xij

branch power Pij

Will include generator-side control later

Page 38: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Network model

Mi ωi = Pim − di − di − CieP e

e∑

Pij = bij ωi −ω j( ) ∀ i→ jGenerator bus: Mi > 0 Load bus: Mi = 0

Pim

i

jPij

di + di

Damping/uncontr loads:

Controllable loads:

di = Diωi

di

Page 39: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Network model

Pim

i

jPij

di + di

•  swing dynamics •  all variables are deviations from nominal •  extends to nonlinear power flow

Mi ωi = Pim − di − di − CieP e

e∑

Pij = bij ωi −ω j( ) ∀ i→ j

Page 40: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Frequency control

Suppose the system is in steady state Then: disturbance in gen/load …

ωi = 0 Pij = 0 ωi = 0

Mi ωi = Pim − di − di − CieP e

e∑

Pij = bij ωi −ω j( ) ∀ i→ j

Page 41: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Frequency control

current approach

load-side control

Mi ωi = Pim − di − di − CieP e

e∑

Pij = bij ωi −ω j( ) ∀ i→ j

Page 42: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Network model

Distributed online algorithm

Simulations

Details Main references (frequency control):

Zhao, Topcu, Li, L, TAC 2014 Mallada, Zhao, L, Allerton 2014 Zhao et al: CDC 2014, CISS 2015, PSCC 2016

Page 43: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Load-side controller design

Mi ωi = Pim − di − di − CieP e

e∑

Pij = bij ωi −ω j( ) ∀ i→ j

Control goals (while min disutility)

n  Rebalance power & stabilize frequency

n  Restore nominal frequency n  Restore scheduled inter-area flows n  Respect line limits

Zhao, Topcu, Li, Low TAC 2014

Mallada, Zhao, Low Allerton, 2014

Page 44: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Load-side controller design

Control goals (while min disutility)

n  Rebalance power & stabilize frequency

n  Restore nominal frequency n  Restore scheduled inter-area flows n  Respect line limits

Zhao, Topcu, Li, Low TAC 2014

Mallada, Zhao, Low Allerton, 2014

Mi ωi = Pim − di − di − CieP e

e∑

Pij = bij ωi −ω j( ) ∀ i→ j

Page 45: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Load-side controller design

Design control law whose equilibrium

solves:

mind,P

ci (dii∑ )

s. t. Pim − di = Cie

e∑ Pe node i

Ciee∑

i∈Nk

∑ Pe = Pk area k

Pe ≤ Pe ≤ Pe line e

power balance

inter-area flows

line limits

Control goals (while min disutility)

n  Rebalance power & stabilize frequency

n  Restore nominal frequency n  Restore scheduled inter-area flows n  Respect line limits

load disutility

freq will emerge as Lagrange multiplier

for power imbalance

Page 46: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Load-side controller design

Design control (G, F) s.t. closed-loop system

n  is stable n  has equilibrium that is optimal

!λ = G ω(t),P(t),λ(t)( )di = Fi ω(t),P(t),λ(t)( )

Mi !ωi = Pim − di − di − CieP e

e∑

!Pij = bij ωi −ω j( )

mind,P

ci (dii∑ )

s. t. Pim − di = Cie

e∑ Pe node i

Ciee∑

i∈Nk

∑ Pe = Pk area k

Pe ≤ Pe ≤ Pe line e

power network

load control

Page 47: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Load-side controller design

Idea: exploit system dynamic as part of primal-dual algorithm for modified opt

n  Distributed algorithm n  Stability analysis n  Control goals in equilibrium

!λ = G ω(t),P(t),λ(t)( )di = Fi ω(t),P(t),λ(t)( )

Mi !ωi = Pim − di − di − CieP e

e∑

!Pij = bij ωi −ω j( )

mind,P

ci (dii∑ )

s. t. Pim − di = Cie

e∑ Pe node i

Ciee∑

i∈Nk

∑ Pe = Pk area k

Pe ≤ Pe ≤ Pe line e

power network

load control

Page 48: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Summary: control architecture

Primary load-side frequency control •  completely decentralized •  Theorem: stable dynamic, optimal equilibrium

6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

Zhao, Topcu, Li, Low. TAC 2014

phys

ical

net

wor

k

Page 49: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Summary: control architecture 6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

Mallada, Zhao, Low. Allerton 2014

Secondary load-side frequency control •  communication with neighbors •  Theorem: stable dynamic, optimal equilibrium

phys

ical

net

wor

k cy

ber n

etw

ork

Page 50: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Summary: control architecture

With generator-side control, nonlinear power flow •  load-side improves both transient & eq •  Theorem: stable dynamic, optimal equilibrium

Zhao, Mallada, Low. CISS 2015

6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

θ,ω, p,a( )ph

ysic

al n

etw

ork

cybe

r net

wor

k

Page 51: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Network model

Load-side frequency control

Simulations

Details Main references (frequency control):

Zhao, Topcu, Li, L, TAC 2014 Mallada, Zhao, L, Allerton 2014 Zhao et al: CDC 2014, CISS 2015, PSCC 2016

Page 52: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Example Transient Stability Results

¾Figure shows simulated generator frequencies after a large generator outage contingency

10

Local frequencies

[Tom Overbye, 2015 Cornell]

Page 53: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Simulations

Dynamic simulation of IEEE 39-bus system

•  Power System Toolbox (RPI) •  Detailed generation model •  Exciter model, power system stabilizer model •  Nonzero resistance lines

13

Fig. 2: IEEE 39 bus system: New England

VII. NUMERICAL ILLUSTRATIONS

We now illustrate the behavior of our control scheme. Weconsider the widely used IEEE 39 bus system, shown in Figure2, to test our scheme. We assume that the system has twoindependent control areas that are connected through lines(1, 2), (2, 3) and (26, 27). The network parameters as wellas the initial stationary point (pre fault state) were obtainedfrom the Power System Toolbox [41] data set.

Each bus is assumed to have a controllable load with Di

=

[�dmax

, dmax

], with dmax

= 1p.u. on a 100MVA base anddisutility function

ci

(di

)=

Zdi

0

tan(

2dmax

s)ds=�2dmax

⇡ln(| cos( ⇡

2dmax

di

)|).

Thus, di

(�i

) = c0i

�1

(!i

+ �i

) =

2d

max

arctan(!i

+ �i

). SeeFigure 3 for an illustration of both c

i

(di

) and di

(�i

).

−1 −0.5 0 0.5 1

0

5

10

15

20

25

di

ci(d

i)

−10 −5 0 5 10−1

−0.5

0

0.5

1

ω i + λi

di(ω

i+

λi)

Fig. 3: Disutility ci

(di

) and load function di

(!i

+ �i

)

Throughout the simulations we assume that the aggregategenerator damping and load frequency sensitivity parameterD

i

= 0.2 8i 2 N and �v

i

= ⇣�i

= ⇣⇡k

= ⇣⇢+

e

= ⇣⇢�

e

= 1,for all i 2 N , k 2 K and e 2 E . These parameter valuesdo not affect convergence, but in general they will affectthe convergence rate. The values of Pm are corrected sothat they initially add up to zero by evenly distributing themismatch among the load buses. ˆP is obtained from thestarting stationary condition. We initially set ¯P and P so thatthey are not binding.

We simulate the OLC-system as well as the swing dynam-ics (31) without load control (d

i

= 0), after introducing aperturbation at bus 29 of Pm

29

= �2p.u.. Figures 4 and 5 showthe evolution of the bus frequencies for the uncontrolled swing

0 5 10 15 20 25 30−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(b) OLC unconstr

t

Fig. 4: Frequency evolution: Area 1

0 5 10 15 20 25 30−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(b) OLC unconstr

t

Fig. 5: Frequency evolution: Area 2

dynamics (a), the OLC system without inter-area constraints(b), and the OLC with area constraints (c).

It can be seen that while the swing dynamics alone failto recover the nominal frequency, the OLC controllers canjointly rebalance the power as well as recovering the nominalfrequency. The convergence of OLC seems to be similar oreven better than the swing dynamics, as shown in Figures 4and 5.

0 10 20 30 40 50 60−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

0.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 6: LMPs and inter area lines flows: no thermal limits

0 10 20 30 40 50 60−1

−0.5

0

0.5

1

1.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 7: LMPs and inter area lines flows: with thermal limits

Now, we illustrate the action of the thermal constraints byadding a constraint of ¯P

e

= 2.6p.u. and Pe

= �2.6p.u. tothe tie lines between areas. Figure 6 shows the values ofthe multipliers �

i

, that correspond to the Locational MarginalPrices (LMPs), and the line flows of the tie lines for the samescenario displayed in Figures 4c and 5c, i.e. without thermal

Page 54: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Primary control

V. CASE STUDY

We illustrate the performance of the proposed controlthrough a simulation of the IEEE New England test systemshown in Fig. 1.

Fig. 1. IEEE New England test system [39].

This system has 10 generators and 39 buses, and a totalload of about 60 per unit (pu) where 1 pu represents 100MVA. Details about this system including parameter valuescan be found in Power System Toolbox [39], which we useto run the simulation in this section. Compared to the model(2)–(4), the simulation model is more detailed and realistic,with transient generator dynamics, excitation and flux decaydynamics, changes in voltage and reactive power over time,and lossy transmission lines, et cetera.

The primary frequency control of generator or load j

is designed with cost function c

j

(p

j

) =

Rj

2 (p

j

� p

setj

)

2,where p

setj

is the power injection at the setpoint, an initialequilibrium point solved from static power flow problem. Bychoosing this cost function, we try to minimize the deviationsof power injections from the setpoint, and have the control

p

j

=

hp

setj

� 1Rj

!

j

ipj

p

j

from (15)(16) 3. We consider the

following two cases in which the generators and loads havedifferent control capabilities and hence different [p

j

, p

j

]:

1) All the 10 generators have [p

j

, p

j

] = [p

setj

(1 �c), p

setj

(1 + c)], and all the loads are uncontrollable;2) Generators 2, 4, 6, 8, 10 (which happen to provide half

of the total generation) have the same bounds as in case(1). Generators 1, 3, 5, 7, 9 are uncontrollable, and allthe loads have [p

j

, p

j

] = [p

setj

(1 + c/2), p

setj

(1� c/2)],if we suppose p

setj

0 for loads j 2 L.Hence cases (1) and (2) have the same total control capacityacross the network. Case (1) only has generator control while

3Only the load control pj for j 2 L is written since the generator controlpcj for j 2 G takes the same form.

in case (2) the set of generators and the set of loads eachhas half of the total control capacity. We select c = 10%,which implies the total control capacity is about 6 pu. For allj 2 N , the feedback gain 1/R

j

is selected as 25p

setj

, whichis a typical value in practice meaning a frequency changeof 0.04 pu (2.4 Hz) causes the change of power injectionfrom zero all the way to the setpoint. Note that this controlis the same as frequency droop control, which implies thatindeed frequency droop control implicitly solves an OFCproblem with quadratic cost functions we use here. However,our controller design is more flexible by allowing a largerset of cost functions.

In the simulation, the system is initially at the setpointwith 60 Hz frequency. At time t = 0.5 second, buses 4,15, 16 each makes 1 pu step change in their real powerconsumptions, causing the frequency to drop. Fig. 2 showsthe frequencies of all the 10 generators under the two casesabove, (1) with red and (2) with black. We see in both casesthat frequencies of different generators have relatively smalldifferences during transient, and are synchronized towardsthe new steady-state frequency. Compared with generator-only control, the combined generator-and-load control im-proves both the transient and steady-state frequency, eventhough the total control capacities in both cases are the same.

0 5 10 15 20 25 30

59.8

59.85

59.9

59.95

60

Time (sec)

Freq

uenc

y (H

z)

generator−only control

generator−and−load control

Fig. 2. Frequencies of all the 10 generators under case (1) only generatorsare controlled (red) and case (2) both generators and loads are controlled(black). The total control capacities are the same in these two cases.

VI. CONCLUSION AND FUTURE WORKWe have presented a systematic method to jointly design

generator and load-side primary frequency control, by for-mulating an optimal frequency control (OFC) problem tocharacterize the desired equilibrium points of the closed-loop system. OFC minimizes the total generation cost anduser disutility subject to power balance over entire network.The proposed control is completely decentralized, dependingonly on local frequency. Stability analysis for the closed-loop system with Lyapunov method has led to a sufficientcondition for any equilibrium point to be asymptoticallystable. A simulation shows that the combined generator-and-load control improves both transient and steady-statefrequency, compared to the traditional control on generatorsonly, even when the total control capacity remains the same.

Page 55: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Secondary control

13

Fig. 2: IEEE 39 bus system: New England

VII. NUMERICAL ILLUSTRATIONS

We now illustrate the behavior of our control scheme. Weconsider the widely used IEEE 39 bus system, shown in Figure2, to test our scheme. We assume that the system has twoindependent control areas that are connected through lines(1, 2), (2, 3) and (26, 27). The network parameters as wellas the initial stationary point (pre fault state) were obtainedfrom the Power System Toolbox [41] data set.

Each bus is assumed to have a controllable load with Di

=

[�dmax

, dmax

], with dmax

= 1p.u. on a 100MVA base anddisutility function

ci

(di

)=

Zdi

0

tan(

2dmax

s)ds=�2dmax

⇡ln(| cos( ⇡

2dmax

di

)|).

Thus, di

(�i

) = c0i

�1

(!i

+ �i

) =

2d

max

arctan(!i

+ �i

). SeeFigure 3 for an illustration of both c

i

(di

) and di

(�i

).

−1 −0.5 0 0.5 1

0

5

10

15

20

25

di

ci(d

i)

−10 −5 0 5 10−1

−0.5

0

0.5

1

ω i + λi

di(ω

i+

λi)

Fig. 3: Disutility ci

(di

) and load function di

(!i

+ �i

)

Throughout the simulations we assume that the aggregategenerator damping and load frequency sensitivity parameterD

i

= 0.2 8i 2 N and �v

i

= ⇣�i

= ⇣⇡k

= ⇣⇢+

e

= ⇣⇢�

e

= 1,for all i 2 N , k 2 K and e 2 E . These parameter valuesdo not affect convergence, but in general they will affectthe convergence rate. The values of Pm are corrected sothat they initially add up to zero by evenly distributing themismatch among the load buses. ˆP is obtained from thestarting stationary condition. We initially set ¯P and P so thatthey are not binding.

We simulate the OLC-system as well as the swing dynam-ics (31) without load control (d

i

= 0), after introducing aperturbation at bus 29 of Pm

29

= �2p.u.. Figures 4 and 5 showthe evolution of the bus frequencies for the uncontrolled swing

0 5 10 15 20 25 30−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(b) OLC unconstr

t

Fig. 4: Frequency evolution: Area 1

0 5 10 15 20 25 30−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(b) OLC unconstr

t

Fig. 5: Frequency evolution: Area 2

dynamics (a), the OLC system without inter-area constraints(b), and the OLC with area constraints (c).

It can be seen that while the swing dynamics alone failto recover the nominal frequency, the OLC controllers canjointly rebalance the power as well as recovering the nominalfrequency. The convergence of OLC seems to be similar oreven better than the swing dynamics, as shown in Figures 4and 5.

0 10 20 30 40 50 60−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

0.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 6: LMPs and inter area lines flows: no thermal limits

0 10 20 30 40 50 60−1

−0.5

0

0.5

1

1.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 7: LMPs and inter area lines flows: with thermal limits

Now, we illustrate the action of the thermal constraints byadding a constraint of ¯P

e

= 2.6p.u. and Pe

= �2.6p.u. tothe tie lines between areas. Figure 6 shows the values ofthe multipliers �

i

, that correspond to the Locational MarginalPrices (LMPs), and the line flows of the tie lines for the samescenario displayed in Figures 4c and 5c, i.e. without thermal

13

Fig. 2: IEEE 39 bus system: New England

VII. NUMERICAL ILLUSTRATIONS

We now illustrate the behavior of our control scheme. Weconsider the widely used IEEE 39 bus system, shown in Figure2, to test our scheme. We assume that the system has twoindependent control areas that are connected through lines(1, 2), (2, 3) and (26, 27). The network parameters as wellas the initial stationary point (pre fault state) were obtainedfrom the Power System Toolbox [41] data set.

Each bus is assumed to have a controllable load with Di

=

[�dmax

, dmax

], with dmax

= 1p.u. on a 100MVA base anddisutility function

ci

(di

)=

Zdi

0

tan(

2dmax

s)ds=�2dmax

⇡ln(| cos( ⇡

2dmax

di

)|).

Thus, di

(�i

) = c0i

�1

(!i

+ �i

) =

2d

max

arctan(!i

+ �i

). SeeFigure 3 for an illustration of both c

i

(di

) and di

(�i

).

−1 −0.5 0 0.5 1

0

5

10

15

20

25

di

ci(d

i)

−10 −5 0 5 10−1

−0.5

0

0.5

1

ω i + λi

di(ω

i+

λi)

Fig. 3: Disutility ci

(di

) and load function di

(!i

+ �i

)

Throughout the simulations we assume that the aggregategenerator damping and load frequency sensitivity parameterD

i

= 0.2 8i 2 N and �v

i

= ⇣�i

= ⇣⇡k

= ⇣⇢+

e

= ⇣⇢�

e

= 1,for all i 2 N , k 2 K and e 2 E . These parameter valuesdo not affect convergence, but in general they will affectthe convergence rate. The values of Pm are corrected sothat they initially add up to zero by evenly distributing themismatch among the load buses. ˆP is obtained from thestarting stationary condition. We initially set ¯P and P so thatthey are not binding.

We simulate the OLC-system as well as the swing dynam-ics (31) without load control (d

i

= 0), after introducing aperturbation at bus 29 of Pm

29

= �2p.u.. Figures 4 and 5 showthe evolution of the bus frequencies for the uncontrolled swing

0 5 10 15 20 25 30−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(b) OLC unconstr

t

Fig. 4: Frequency evolution: Area 1

0 5 10 15 20 25 30−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(b) OLC unconstr

t

Fig. 5: Frequency evolution: Area 2

dynamics (a), the OLC system without inter-area constraints(b), and the OLC with area constraints (c).

It can be seen that while the swing dynamics alone failto recover the nominal frequency, the OLC controllers canjointly rebalance the power as well as recovering the nominalfrequency. The convergence of OLC seems to be similar oreven better than the swing dynamics, as shown in Figures 4and 5.

0 10 20 30 40 50 60−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

0.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 6: LMPs and inter area lines flows: no thermal limits

0 10 20 30 40 50 60−1

−0.5

0

0.5

1

1.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 7: LMPs and inter area lines flows: with thermal limits

Now, we illustrate the action of the thermal constraints byadding a constraint of ¯P

e

= 2.6p.u. and Pe

= �2.6p.u. tothe tie lines between areas. Figure 6 shows the values ofthe multipliers �

i

, that correspond to the Locational MarginalPrices (LMPs), and the line flows of the tie lines for the samescenario displayed in Figures 4c and 5c, i.e. without thermal

13

Fig. 2: IEEE 39 bus system: New England

VII. NUMERICAL ILLUSTRATIONS

We now illustrate the behavior of our control scheme. Weconsider the widely used IEEE 39 bus system, shown in Figure2, to test our scheme. We assume that the system has twoindependent control areas that are connected through lines(1, 2), (2, 3) and (26, 27). The network parameters as wellas the initial stationary point (pre fault state) were obtainedfrom the Power System Toolbox [41] data set.

Each bus is assumed to have a controllable load with Di

=

[�dmax

, dmax

], with dmax

= 1p.u. on a 100MVA base anddisutility function

ci

(di

)=

Zdi

0

tan(

2dmax

s)ds=�2dmax

⇡ln(| cos( ⇡

2dmax

di

)|).

Thus, di

(�i

) = c0i

�1

(!i

+ �i

) =

2d

max

arctan(!i

+ �i

). SeeFigure 3 for an illustration of both c

i

(di

) and di

(�i

).

−1 −0.5 0 0.5 1

0

5

10

15

20

25

di

ci(d

i)

−10 −5 0 5 10−1

−0.5

0

0.5

1

ω i + λi

di(ω

i+

λi)

Fig. 3: Disutility ci

(di

) and load function di

(!i

+ �i

)

Throughout the simulations we assume that the aggregategenerator damping and load frequency sensitivity parameterD

i

= 0.2 8i 2 N and �v

i

= ⇣�i

= ⇣⇡k

= ⇣⇢+

e

= ⇣⇢�

e

= 1,for all i 2 N , k 2 K and e 2 E . These parameter valuesdo not affect convergence, but in general they will affectthe convergence rate. The values of Pm are corrected sothat they initially add up to zero by evenly distributing themismatch among the load buses. ˆP is obtained from thestarting stationary condition. We initially set ¯P and P so thatthey are not binding.

We simulate the OLC-system as well as the swing dynam-ics (31) without load control (d

i

= 0), after introducing aperturbation at bus 29 of Pm

29

= �2p.u.. Figures 4 and 5 showthe evolution of the bus frequencies for the uncontrolled swing

0 5 10 15 20 25 30−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(b) OLC unconstr

t

Fig. 4: Frequency evolution: Area 1

0 5 10 15 20 25 30−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(b) OLC unconstr

t

Fig. 5: Frequency evolution: Area 2

dynamics (a), the OLC system without inter-area constraints(b), and the OLC with area constraints (c).

It can be seen that while the swing dynamics alone failto recover the nominal frequency, the OLC controllers canjointly rebalance the power as well as recovering the nominalfrequency. The convergence of OLC seems to be similar oreven better than the swing dynamics, as shown in Figures 4and 5.

0 10 20 30 40 50 60−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

0.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 6: LMPs and inter area lines flows: no thermal limits

0 10 20 30 40 50 60−1

−0.5

0

0.5

1

1.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 7: LMPs and inter area lines flows: with thermal limits

Now, we illustrate the action of the thermal constraints byadding a constraint of ¯P

e

= 2.6p.u. and Pe

= �2.6p.u. tothe tie lines between areas. Figure 6 shows the values ofthe multipliers �

i

, that correspond to the Locational MarginalPrices (LMPs), and the line flows of the tie lines for the samescenario displayed in Figures 4c and 5c, i.e. without thermal

swing dynamics with OLC

area 1

Page 56: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Secondary control

13

Fig. 2: IEEE 39 bus system: New England

VII. NUMERICAL ILLUSTRATIONS

We now illustrate the behavior of our control scheme. Weconsider the widely used IEEE 39 bus system, shown in Figure2, to test our scheme. We assume that the system has twoindependent control areas that are connected through lines(1, 2), (2, 3) and (26, 27). The network parameters as wellas the initial stationary point (pre fault state) were obtainedfrom the Power System Toolbox [41] data set.

Each bus is assumed to have a controllable load with Di

=

[�dmax

, dmax

], with dmax

= 1p.u. on a 100MVA base anddisutility function

ci

(di

)=

Zdi

0

tan(

2dmax

s)ds=�2dmax

⇡ln(| cos( ⇡

2dmax

di

)|).

Thus, di

(�i

) = c0i

�1

(!i

+ �i

) =

2d

max

arctan(!i

+ �i

). SeeFigure 3 for an illustration of both c

i

(di

) and di

(�i

).

−1 −0.5 0 0.5 1

0

5

10

15

20

25

di

ci(d

i)

−10 −5 0 5 10−1

−0.5

0

0.5

1

ω i + λi

di(ω

i+

λi)

Fig. 3: Disutility ci

(di

) and load function di

(!i

+ �i

)

Throughout the simulations we assume that the aggregategenerator damping and load frequency sensitivity parameterD

i

= 0.2 8i 2 N and �v

i

= ⇣�i

= ⇣⇡k

= ⇣⇢+

e

= ⇣⇢�

e

= 1,for all i 2 N , k 2 K and e 2 E . These parameter valuesdo not affect convergence, but in general they will affectthe convergence rate. The values of Pm are corrected sothat they initially add up to zero by evenly distributing themismatch among the load buses. ˆP is obtained from thestarting stationary condition. We initially set ¯P and P so thatthey are not binding.

We simulate the OLC-system as well as the swing dynam-ics (31) without load control (d

i

= 0), after introducing aperturbation at bus 29 of Pm

29

= �2p.u.. Figures 4 and 5 showthe evolution of the bus frequencies for the uncontrolled swing

0 5 10 15 20 25 30−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.45

−0.4

−0.35

−0.3

−0.25

−0.2

−0.15

−0.1

−0.05

0

0.05

(b) OLC unconstr

t

Fig. 4: Frequency evolution: Area 1

0 5 10 15 20 25 30−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(a) Swing dynamics

ωirad/s

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(c) OLC area−constr

t0 5 10 15 20 25 30

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

(b) OLC unconstr

t

Fig. 5: Frequency evolution: Area 2

dynamics (a), the OLC system without inter-area constraints(b), and the OLC with area constraints (c).

It can be seen that while the swing dynamics alone failto recover the nominal frequency, the OLC controllers canjointly rebalance the power as well as recovering the nominalfrequency. The convergence of OLC seems to be similar oreven better than the swing dynamics, as shown in Figures 4and 5.

0 10 20 30 40 50 60−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

0.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 6: LMPs and inter area lines flows: no thermal limits

0 10 20 30 40 50 60−1

−0.5

0

0.5

1

1.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 7: LMPs and inter area lines flows: with thermal limits

Now, we illustrate the action of the thermal constraints byadding a constraint of ¯P

e

= 2.6p.u. and Pe

= �2.6p.u. tothe tie lines between areas. Figure 6 shows the values ofthe multipliers �

i

, that correspond to the Locational MarginalPrices (LMPs), and the line flows of the tie lines for the samescenario displayed in Figures 4c and 5c, i.e. without thermal

13

0 10 20 30 40 50 60−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

0.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 6: LMPs and inter area lines flows: no thermal limits

0 10 20 30 40 50 60−1

−0.5

0

0.5

1

1.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 7: LMPs and inter area lines flows: with thermal limits

scheme, we can see in Figure 7 that the system converges toa new operating point that satisfies our constraints.

Finally, we show the conservativeness of the bound obtainedin Theorem 17. We simulate the system (24) and (52) underthe same conditions as in Figure 6. We set B

i

such that thecorresponding �b

i

s are homogeneous for every bus i. We alsodo not impose the bounds (63) on d

i

(·) and use instead di

asdescribed in Figure 3. This last assumption actually impliesthat the interval in (64) is empty since d0 = 0.

0 50 100 150 200−6

−5

−4

−3

−2

−1

0

1

δbi = −0.40

t

ωi

0 50 100 150 200−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.21

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.20

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.19

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = 0.00

t

Fig. 8: Bus frequency evolution for homogeneous perturbation�b

i

2 {�0.4,�0.21,�0.2,�0.19, 0.0}

0 50 100 150 200−50

0

50

100

150

200

250

300

350

δbi = −0.40

t

λi

0 50 100 150 200−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

δbi = −0.21

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.20

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.19

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = 0.00

t

Fig. 9: Location Marginal Prices evolution for homogeneousperturbation �b

i

2 {�0.4,�0.21,�0.2,�0.19, 0.0}

Figures 8 and 9 show the evolution of the frequency!i

and LMPs �i

for different values of �bi

belonging to{�0.4,�0.21,�0.2,�0.19, 0.0}. Since D

i

= 0.2 at all thebuses, then �b

i

= �0.2 is the threshold that makes Bi

gofrom positive to negative as �b

i

decreases.

Despite condition (64) is not satisfied for any �bi

, oursimulations show that the system converges whenever B

i

� 0

(�bi

� �0.2). The case when �bi

= �0.2 is of special interest.Here, the system converges, yet the nominal frequency is notrestored. This is because the terms �b

i

!i

(53) are equal tothe terms D

i

!i

in (24a)-(24b). Thus !i

and ˙�i

can be madesimultaneously zero with nonzero !⇤

i

. Fortunately, this canonly happen when B

i

= 0 which can be avoided since Bi

isa designed parameter.

VIII. CONCLUDING REMARKS

This paper studies the problem of restoring the powerbalance and operational constraints of a power network aftera disturbance by dynamically adapting the loads. We showthat provided communication is allowed among neighboringbuses, it is possible to rebalance the power mismatch, restorethe nominal frequency, and maintain inter-area flows andthermal limits. Our distributed solution converges for everyinitial condition and is robust to parameter uncertainty. Severalnumerical simulations verify our findings and provide newinsight on the conservativeness of the theoretical sufficientcondition.

Several future directions must be explored to assess the fullpotential of this control scheme. Nonlinear versions of thenetwork as well as additional generator and load dynamicsneed to be included in the analysis. A thorough study that con-siders delays as well as implementations where only a subsetof the network buses implements our controllers needs to beundertaken in order to assess robustness and the feasibility ofan incremental deployment of the proposed scheme.

APPENDIX APROOF OF LEMMAS

A. Proof of Lemma 3Proof: From the derivation of �

i

(�i

) it is easy to showthat

i

(�i

) = min

di,ˆ

di

Li

(di

, ˆdi

,�i

) (78)

where

Li

(di

, ˆdi

,�i

) := ci

(di

) +

ˆd2i

2Di

+ (⌫i

+ �i

)(Pm

i

� di

)� ⌫i

ˆdi

.

Notice that Li

(di

, ˆdi

,�i

) is linear in �i

and strictly convex in(d

i

, ˆdi

).Let d

i

(�i

) and ˆdi

(�i

) be the unique minimizer of (78). Thenfrom (11) it follows that d

i

(�i

) = di

(⌫i

+�i

) = c0�1

i

(⌫i

+�i

)

and ˆdi

(�i

) = Di

⌫i

.We will first show that, given �

i,1

6= �i,2

, then

(di

(�i,1

), ˆdi

(�i,1

)) 6= (di

(�i,2

), ˆdi

(�i,2

)). (79)

Suppose by contradiction that there is �i,1

6= �i,2

such that

(di

(�i,1

), ˆdi

(�i,1

)) = (di

(�i,2

), ˆdi

(�i,2

)).

Then by (11), c0�1

i

(⌫i,1

+ �i,1

) = c0�1

i

(⌫i,2

+ �i,2

) andD

i

⌫i,1

= Di

⌫i,2

. Thus, ⌫i,1

= ⌫i,2

= ⌫ and c0�1

i

(⌫ +

�i,1

) = c0�1

i

(⌫ + �i,2

). But since ci

(·) is strictly convex,

13

0 10 20 30 40 50 60−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

0.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 6: LMPs and inter area lines flows: no thermal limits

0 10 20 30 40 50 60−1

−0.5

0

0.5

1

1.5

LMPs

λi

t0 10 20 30 40 50 60

0

0.5

1

1.5

2

2.5

3

3.5

Inter area line flows

Pij

t

Fig. 7: LMPs and inter area lines flows: with thermal limits

scheme, we can see in Figure 7 that the system converges toa new operating point that satisfies our constraints.

Finally, we show the conservativeness of the bound obtainedin Theorem 17. We simulate the system (24) and (52) underthe same conditions as in Figure 6. We set B

i

such that thecorresponding �b

i

s are homogeneous for every bus i. We alsodo not impose the bounds (63) on d

i

(·) and use instead di

asdescribed in Figure 3. This last assumption actually impliesthat the interval in (64) is empty since d0 = 0.

0 50 100 150 200−6

−5

−4

−3

−2

−1

0

1

δbi = −0.40

t

ωi

0 50 100 150 200−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.21

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.20

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.19

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = 0.00

t

Fig. 8: Bus frequency evolution for homogeneous perturbation�b

i

2 {�0.4,�0.21,�0.2,�0.19, 0.0}

0 50 100 150 200−50

0

50

100

150

200

250

300

350

δbi = −0.40

t

λi

0 50 100 150 200−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

0.3

0.4

δbi = −0.21

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.20

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = −0.19

t0 50 100 150 200

−0.5

−0.4

−0.3

−0.2

−0.1

0

0.1

0.2

δbi = 0.00

t

Fig. 9: Location Marginal Prices evolution for homogeneousperturbation �b

i

2 {�0.4,�0.21,�0.2,�0.19, 0.0}

Figures 8 and 9 show the evolution of the frequency!i

and LMPs �i

for different values of �bi

belonging to{�0.4,�0.21,�0.2,�0.19, 0.0}. Since D

i

= 0.2 at all thebuses, then �b

i

= �0.2 is the threshold that makes Bi

gofrom positive to negative as �b

i

decreases.

Despite condition (64) is not satisfied for any �bi

, oursimulations show that the system converges whenever B

i

� 0

(�bi

� �0.2). The case when �bi

= �0.2 is of special interest.Here, the system converges, yet the nominal frequency is notrestored. This is because the terms �b

i

!i

(53) are equal tothe terms D

i

!i

in (24a)-(24b). Thus !i

and ˙�i

can be madesimultaneously zero with nonzero !⇤

i

. Fortunately, this canonly happen when B

i

= 0 which can be avoided since Bi

isa designed parameter.

VIII. CONCLUDING REMARKS

This paper studies the problem of restoring the powerbalance and operational constraints of a power network aftera disturbance by dynamically adapting the loads. We showthat provided communication is allowed among neighboringbuses, it is possible to rebalance the power mismatch, restorethe nominal frequency, and maintain inter-area flows andthermal limits. Our distributed solution converges for everyinitial condition and is robust to parameter uncertainty. Severalnumerical simulations verify our findings and provide newinsight on the conservativeness of the theoretical sufficientcondition.

Several future directions must be explored to assess the fullpotential of this control scheme. Nonlinear versions of thenetwork as well as additional generator and load dynamicsneed to be included in the analysis. A thorough study that con-siders delays as well as implementations where only a subsetof the network buses implements our controllers needs to beundertaken in order to assess robustness and the feasibility ofan incremental deployment of the proposed scheme.

APPENDIX APROOF OF LEMMAS

A. Proof of Lemma 3Proof: From the derivation of �

i

(�i

) it is easy to showthat

i

(�i

) = min

di,ˆ

di

Li

(di

, ˆdi

,�i

) (78)

where

Li

(di

, ˆdi

,�i

) := ci

(di

) +

ˆd2i

2Di

+ (⌫i

+ �i

)(Pm

i

� di

)� ⌫i

ˆdi

.

Notice that Li

(di

, ˆdi

,�i

) is linear in �i

and strictly convex in(d

i

, ˆdi

).Let d

i

(�i

) and ˆdi

(�i

) be the unique minimizer of (78). Thenfrom (11) it follows that d

i

(�i

) = di

(⌫i

+�i

) = c0�1

i

(⌫i

+�i

)

and ˆdi

(�i

) = Di

⌫i

.We will first show that, given �

i,1

6= �i,2

, then

(di

(�i,1

), ˆdi

(�i,1

)) 6= (di

(�i,2

), ˆdi

(�i,2

)). (79)

Suppose by contradiction that there is �i,1

6= �i,2

such that

(di

(�i,1

), ˆdi

(�i,1

)) = (di

(�i,2

), ˆdi

(�i,2

)).

Then by (11), c0�1

i

(⌫i,1

+ �i,1

) = c0�1

i

(⌫i,2

+ �i,2

) andD

i

⌫i,1

= Di

⌫i,2

. Thus, ⌫i,1

= ⌫i,2

= ⌫ and c0�1

i

(⌫ +

�i,1

) = c0�1

i

(⌫ + �i,2

). But since ci

(·) is strictly convex,

no line limits

with line limits

Total inter-area flow is the same in both cases

line limit

line limit

Page 57: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Key message

Large network of DERs n  Real-time optimization at scale

Online optimization n  Network solves hard problems in real time for

free n  Exploit it for our optimization/control n  Naturally adapts to evolving network

conditions

Examples n  Slow timescale: OPF n  Fast timescale: frequency control

Page 58: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

more details (backup)

Page 59: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Network model

Load-side frequency control

Simulations

Details Main references (frequency control):

Zhao, Topcu, Li, L, TAC 2014 Mallada, Zhao, L, Allerton 2014 Zhao et al: CDC 2014, CISS 2015, PSCC 2016

Page 60: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Recall: design approach

Idea: exploit system dynamic as part of primal-dual algorithm for modified opt

n  closed-loop system is stable n  its equilibria are optimal

!λ = G ω(t),P(t),λ(t)( )di = Fi ω(t),P(t),λ(t)( )

Mi !ωi = Pim − di − di − CieP e

e∑

!Pij = bij ωi −ω j( )

mind,P

ci (dii∑ )

s. t. Pim − di = Cie

e∑ Pe node i

Ciee∑

i∈Nk

∑ Pe = Pk area k

Pe ≤ Pe ≤ Pe line e

power network

load control

Page 61: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Load-side frequency control n  Primary control n  Secondary control n  Interaction with generator-side control

Zhao et al SGC2012, Zhao et al TAC2014

Page 62: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Optimal load control (OLC)

demand = supply

disturbances

mind,d,P

ci (di )+di

2

2Di

!

"#

$

%&

i∑

s. t. Pim − di + di( ) = Cie

e∑ Pie ∀i

controllable loads

mind,P

ci (dii∑ )

s. t. Pim − di = Cie

e∑ Pe node i

Ciee∑

i∈Nk

∑ Pe = Pk area k

Pe ≤ Pe ≤ Pe line e

Page 63: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

swing dynamics

system dynamics + load control = primal dual alg

ωi = −1Mi

di (t)+Diωi (t)−Pim + Pij (t)− Pji (t)

j→i∑

i→ j∑

$

%&&

'

())

Pij = bij ωi (t)−ω j (t)( )

load control

di (t) := ci'−1 ωi (t)( )"# $%di

diactive control

implicit

Page 64: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Control architecture 6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

Page 65: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Theorem

Starting from any

system trajectory

converges to

n  is unique optimal of OLC

n  is unique optimal for dual

d(0), d(0), ω(0), P(0)( )

d*, d*, ω*, P*( ) as t→∞

d*, d*( )ω*

d(t), d(t), ω(t), P(t)( )

•  completely decentralized •  frequency deviations contain right info for local

decisions that are globally optimal

Load-side primary control works

Page 66: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

n  Rebalance power n  Stabilize frequencies n  Restore nominal frequency n  Restore scheduled inter-area flows n  Respect line limits

Recap: control goals

Yes

Yes

No

No ω* ≠ 0( )

No

Page 67: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Load-side frequency control n  Primary control n  Secondary control n  Interaction with generator-side control

Mallada, Low, IFAC 2014 Mallada et al, Allerton 2014

Page 68: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

OLC for secondary control

mind,d,P,v

ci di( )+ 12Di

di2

!

"#

$

%&

i∑

s. t. Pm − (d + d) = CP Pm − d = CBCTv

CBCTv = P P ≤ BCTv ≤ P

restore nominal freq

demand = supply

mind,P

ci (dii∑ )

s. t. Pim − di = Cie

e∑ Pe node i

Ciee∑

i∈Nk

∑ Pe = Pk area k

Pe ≤ Pe ≤ Pe line e

Page 69: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

OLC for secondary control

mind,d,P,v

ci di( )+ 12Di

di2

!

"#

$

%&

i∑

s. t. Pm − (d + d) = CP Pm − d = CBCTv

CBCTv = P P ≤ BCTv ≤ Pkey idea: “virtual flows”

BCTv

demand = supply

in steady state: virtual flow = real flows

BCTv = P

restore nominal freq

Page 70: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

OLC for secondary control

mind,d,P,v

ci di( )+ 12Di

di2

!

"#

$

%&

i∑

s. t. Pm − (d + d) = CP Pm − d = CBCTv

CBCTv = P P ≤ BCTv ≤ P

restore nominal freq

in steady state: virtual flow = real flows

BCTv = P

restore inter-area flow

respect line limit

demand = supply

Page 71: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

swing dynamics:

Recall: primary control

ωi = −1Mi

di (t)+Diωi (t)−Pim + CiePe(t)

e∈E∑

$

%&

'

()

Pij = bij ωi (t)−ω j (t)( )

load control: di (t) := ci'−1 ωi (t)( )"# $%di

di active control

implicit

6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

Page 72: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Control architecture 6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

phys

ical

net

wor

k cy

ber n

etw

ork

Page 73: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Secondary frequency control

load control: di (t) := ci'−1 ωi (t)+λi (t)( )"# $%di

di

computation & communication:

6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

primal var:

6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

dual vars:

Page 74: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Theorem

starting from any initial point, system trajectory converges s. t.

n  is unique optimal of OLC

n  nominal frequency is restored

n  inter-area flows are restored

n  line limits are respected

Secondary control works

d*, d*,P*,v*( )ω* = 0

CP* = PP ≤ P* ≤ P

Page 75: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Design optimal load control (OLC) problem n  Objective function, constraints

Derive control law as primal-dual algorithms n  Lyapunov stability n  Achieve original control goals in equilibrium

Distributed algorithms

Recap: key ideas

primary control:

di (t) := ci'−1 ωi (t)+λi (t)( )

di (t) := ci'−1 ωi (t)( )

secondary control:

Page 76: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Design optimal load control (OLC) problem n  Objective function, constraints

Derive control law as primal-dual algorithms n  Lyapunov stability n  Achieve original control goals in equilibrium

Distributed algorithms

Virtual flows n  Enforce desired properties on line flows

Recap: key ideas

in steady state: virtual flow = real flows BCTv = P

Page 77: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

n  Rebalance power n  Resynchronize/stabilize frequency n  Restore nominal frequency n  Restore scheduled inter-area flows n  Respect line limits

Recap: control goals

Yes

Yes

ω* ≠ 0( )

Secondary control restores nominal frequency but requires local communication

Yes

Yes

Mallada, et al Allerton2014

Zhao, et al TAC2014

Yes

Page 78: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Outline

Load-side frequency control n  Primary control n  Secondary control n  Interaction with generator-side control

Zhao and Low, CDC2014

Zhao, Mallada, Low, CISS 2015 Zhao, Mallada, Low, Bialek, PSCC 2016

Page 79: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Generator-side control

Recall model: linearized PF, no generator control Mi !ωi = −Diωi +Pi

m − di − CieP ee∑

!Pij = bij ωi −ω j( ) ∀ i→ j

New model: nonlinear PF, with generator control

!θi =ωi

Mi !ωi = −Diωi + pi − CieP ee∑

Pij = bij sin θi −θ j( ) ∀ i→ j

Page 80: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Generator-side control

generator bus: real power injection load bus: controllable load

New model: nonlinear PF, with generator control

!θi =ωi

Mi !ωi = −Diωi + pi − CieP ee∑

Pij = bij sin θi −θ j( ) ∀ i→ j

Page 81: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Generator-side control New model: nonlinear PF, with generator control

!pi = −1τ bi

pi + ai( )

!ai = −1τ gi

ai + pic( )

generator buses:

primary control pic (t) = pi

c ωi (t)( )e.g. freq droop pi

c ωi( ) = −βiωi

!θi =ωi

Mi !ωi = −Diωi + pi − CieP ee∑

Pij = bij sin θi −θ j( ) ∀ i→ j

Page 82: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Load-side control 6

The name of the dynamic law (27) comes from the fact that

@

@⌫L(x,�)T = Pm � (d(�

i

) +D⌫)� CP (30a)

@

@�L(x,�)T = Pm � d(�)� L

B

v (30b)

@

@⇡L(x,�)T =

ˆCDB

CT v � ˆP (30c)

@

@⇢+L(x,�)T = D

B

CT v � ¯P (30d)

@

@⇢�L(x,�)T = P �D

B

CT v (30e)

@

@PL(x,�)T = �(CT ⌫) (30f)

@

@vL(x,�)T = �(L

B

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�))

(30g)

Equations (27a), (27b) and (27g) show that dynamics (1)can be interpreted as a subset of the primal-dual dynamicsdescribed in (27) for the special case when ⇣⌫

i

= M�1

i

and�P

ij

= Bij

. Therefore, we can interpret the frequency !i

asthe Lagrange multiplier ⌫

i

.This observation motivates us to propose a distributed load

control scheme that is naturally decomposed intoPower Network Dynamics:

!G = M�1

G (Pm

G � (dG +

ˆdG)� CGP ) (31a)

0 = Pm

L � (dL +

ˆdL)� CLP (31b)˙P = D

B

CT! (31c)ˆd = D! (31d)

andDynamic Load Control:

˙� = ⇣� (Pm � d� LB

v) (32a)

⇡ = ⇣⇡ĈCD

B

CT v � ˆPä

(32b)

⇢+ = ⇣⇢+

⇥D

B

CT v � ¯P⇤+

+

(32c)

⇢� = ⇣⇢� ⇥

P �DB

CT v⇤+

� (32d)

v = �v

ÄLB

�� CDB

ˆCT⇡ � CDB

(⇢+ � ⇢�)ä

(32e)

d = c0�1

(! + �) (32f)

Equations (31) and (32) show how the network dynamicscan be complemented with dynamic load control such that thewhole system amounts to a distributed primal-dual algorithmthat tries to find a saddle point on L(x,�). We will show inthe next section that this system does achieve optimality asintended.

Figure 1 also shows the unusual control architecture derivedfrom our OLC problem. Unlike traditional observer-basedcontroller design archtecture [36], our dynamic load controlblock does not try to estimate state of the network. Instead,it drives the network towards the desired state using a sharedstatic feedback loop, i.e. d

i

(�i

+ !i

).

Remark 5. One of the limitations of (32) is that in orderto generate the Lagrange multipliers �

i

one needs to estimate

Power Network Dynamics(!, P )

. . . 0di(·)

0. . .

Dynamic Load Control(�, ⇡, ⇢+, ⇢�, v)

+

!

+

d

d

Fig. 1: Control architecture derived from OLC

Pm

i

�di

which is not easy since one cannot separate Pm

i

fromPm

i

�Di

!i

when one measure the power injection of a givenbus without knowing D

i

. This problem will be addressed inSection VI where we propose a modified control scheme thatcan achieve the same equilibrium without needing to know D

i

exactly.

V. OPTIMALITY AND CONVERGENCE

In this section we will show that the system (31)-(32) canefficiently rebalance supply and demand, restore the nominalfrequency, and preserve inter-area flow schedules and thermallimits.

We will achieve this objective in two steps. Firstly, we willshow that every equilibrium point of (31)-(32) is an optimalsolution of (9). This guarantees that a stationary point of thesystem efficiently balances supply and demand and achieveszero frequency deviation.

Secondly, we will show that every trajectory(d(t), ˆd

i

(t), P (t), v(t),!(t),�(t),⇡(t), ⇢+(t), ⇢�(t))converges to an equilibrium point of (31)-(32). Moreover, theequilibrium point will satisfy (2) and (5).

Theorem 6 (Optimality). A point p⇤ = (d⇤, ˆd⇤, x⇤,�⇤) is an

equilibrium point of (31)-(32) if and only if is a primal-dualoptimal solution to the OLC problem.

Proof: The proof of this theorem is a direct applicationof Lemma 4. Let (d⇤, ˆd⇤, x⇤,�⇤

) be an equilibrium point of(31)-(32). Then, by (31c) and (32c)-(32e), �⇤ is dual feasible.

Similarly, since !i

= 0, ˙�i

= 0, ⇡k

= 0, ⇢+ij

= 0 and⇢�ij

= 0, then (31a)-(31b) and (32a)-(32d) are equivalent toprimal feasibility, i.e. (d⇤, ˆd⇤, P ⇤, v⇤) is a feasible point of (9).Finally, by definition of (31)-(32) conditions (21) and (22) arealways satisfied by any equilibrium point. Thus we are underthe conditions of Lemma 4 and therefore p⇤ = (d⇤, ˆd⇤, x⇤,�⇤

)

is primal-dual optimal which also implies that !⇤= 0.

Remark 7. Theorem 6 implies that every equilibrium solutionof (31)-(32) is optimal with respect to OLC. However, itguarantees neither convergence to it nor that the line flowssatisfy (2) and (5).

The rest of this section is devoted to showing that infact for every initial condition (P (0), v(0),!(0),�(0),⇡(0),

θ,ω, p,a( )

phys

ical

net

wor

k cy

ber n

etw

ork

Page 83: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Theorem

o  Every closed-loop equilibrium solves OLC and its dual

Load-side primary control works

θi* −θ j

* <π2

Suppose

o  Any closed-loop equilibrium is (locally)

asymptotically stable provided

pic ω( )− pic ω*( ) ≤ Li ω −ω*

near ω* for some Li < Di

Page 84: Online Optimization for Power Networks - NREL · PDF fileOnline Optimization for Power Networks Changhong Zhao Lingwen Gan Steven Low EE, CMS, Caltech January 2016 Enrique Mallada

Forward-engineering design facilitates n  explicit control goals n  distributed algorithms n  stability analysis

Load-side frequency regulation n  primary & secondary control works n  helps generator-side control

Conclusion