41
Chair of Automatic Control Department of Mechanical Engineering Technical University of Munich Maria Cruz Varona joint work with Elcio Fiordelisio Junior Technical University Munich Department of Mechanical Engineering Chair of Automatic Control Odense, 13th January 2017 Krylov Subspace Methods for Model Reduction of MIMO Quadratic-Bilinear Systems

Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Maria Cruz Varona

joint work with Elcio Fiordelisio Junior

Technical University Munich

Department of Mechanical Engineering

Chair of Automatic Control

Odense, 13th January 2017

Krylov Subspace Methods for Model Reduction of MIMO Quadratic-Bilinear Systems

Page 2: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Given a large-scale nonlinear control system of the form

2

Motivation

with and

with and

Reduced order model (ROM)

MOR

Simulation, design, control and optimization cannot be done efficiently!

Goal:

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 3: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Nonlinear systems can exhibit complex behaviours

• Strong nonlinearities

• Multiple equilibrium points

• Limit cycles

• Chaotic behaviours

Input-output behaviour of nonlinear systems cannot be described with transfer functions,

the state-transition matrix or the convolution integral (only possible for special cases)

3

Challenges of Nonlinear Model Order Reduction

Choice of the reduced order basis

• Projection basis should comprise most

dominant directions of the state-space

• Different existing approaches:

Simulation-based methods

System-theoretic techniques

Expensive evaluation of

• Vector of nonlinearities f still has to be

evaluated in full dimension

• Approximation of f by so-called hyper-

reduction techniques:

EIM, DEIM, GNAT, ECSW…

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 4: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

4

State-of-the-Art: Overview

Reduction of nonlinear (parametric) systems

Simulation-based:

POD, TPWL

Reduced Basis, Empirical Gramians

Reduction of bilinear systems

Carleman bilinearization (approx.)

Large increase of dimension:

Generalization of well-known methods:

Balanced truncation

Krylov subspace methods

(pseudo)-optimal approaches

Reduction of quadratic-bilinear systems

Quadratic-bilinearization (no approx.!)

Minor increase of dimension:

Generalization of well-known methods:

Krylov subspace methods

-optimal approaches

Reduction methods for MIMO models

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 5: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Objective: Bring general nonlinear systems to the quadratic-bilinear (QB) form

5

Quadratic-Bilinearization Process

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

1 Polynomialization: Convert nonlinear system into an equivalent polynomial system

Quadratic-bilinearization: Convert the polynomial system into a QBDAE

SISO Quadratic-bilinear system:

: Hessian tensor

Quadratic

terms of x

States-input

coupling

2

Page 6: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

6

Quadratic-Bilinearization Process – Example

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

1 Polynomialization step: Introduce new variable

and its Lie derivative

Nonlinear ODE:

Page 7: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

7

Quadratic-Bilinearization Process – Example

Equivalent representationDimension slightly

increasedTransformation not unique

The matrix H can be seen as a tensor

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Quadratic-bilinearization step: Convert polynomial system into a QBDAE2

Page 8: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

8

Variational Analysis of Nonlinear Systems

For an input of the form , we assume that the response should be of the form

Assumption: Nonlinear system can be broken down into a series of homogeneous subsystems

that depend nonlinearly from each other (Volterra theory)

Inserting the assumed input and response in the QB system and comparing coefficients of

we obtain the variational equations:

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

[Rugh ’81]

Page 9: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Series of generalized transfer functions can be obtained via the growing exponential approach:

9

Generalized Transfer Functions (SISO)

1st subsystem:

2nd subsystem:

is symmetric

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

[Rugh ’81]

Page 10: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Taylor coefficients of the transfer function:

10

Moments of QB-Transfer Functions

1st subsystem:

2nd subsystem:

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 11: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

11

Krylov subspaces for SISO systems

Multimoments approach [Gu ’11, Breiten ’12]: Hermite approach [Breiten ’15]:

• Quadratic and bilinear dynamics are treated

separately

• Higher-order moments can be matched

• 3 Krylov directions per shift

• Quadratic and bilinear dynamics are treated

as one

• Only 0th and 1st moments can be matched

• 2 Krylov directions per shift

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 12: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

12

Numerical Examples: SISO RC-Ladder

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

SISO RC-Ladder model:

Nonlinearity:

Input/Output:

Reduction information:

Page 13: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

13

Numerical Examples: SISO RC-Ladder

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

SISO RC-Ladder model:

Nonlinearity:

Input/Output:

Reduction information:

Page 14: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

14

MIMO quadratic-bilinear systems

One bilinear matrix

for each input

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

MIMO Quadratic-bilinear system:

: Hessian tensor

Page 15: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

15

Transfer matrices of a MIMO QB system

Transfer matrices with The quadratic term cannot

be simplified

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Generalized transfer matrices can be obtained similarly via the growing exponential approach:

1st subsystem:

2nd subsystem:

Page 16: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

16

Moments of QB-Transfer Matrices

1st subsystem:

2nd subsystem:

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

This term cannot

be simplified

Page 17: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

17

Block-Multimoments approach (MIMO)

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

linear

bilinear

quadratic

Page 18: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Block tensor-based approach:

18

Krylov subspaces for MIMO systems

• Subsystem interpolation

• (m+1) + 4 moments matched

• (m+1)m + m² = m + 2m²

columns per shift

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 19: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Tangential tensor-based approach:

19

Krylov subspaces for MIMO systems

• Tangential sub-

system interpolation

• (m+1) + 4 moments

matched

• 3 columns per shift

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 20: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

20

Numerical Examples: MIMO RC-Ladder

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

MIMO RC-Ladder model:

Nonlinearity:

Inputs/Outputs:

Reduction information:

Page 21: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

21

Numerical Examples: FitzHugh-Nagumo

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Nonlinearity:

Inputs:

Reduction information:

Page 22: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Summary:

• Many smooth nonlinear systems can be equivalently transformed into QB systems

• QB systems can be described by generalized transfer functions

• Systems theory and Krylov subspaces for SISO QB systems

• Systems theory for MIMO QB systems

• Krylov subspaces were extended to MIMO case

Conclusions:

• Transfer matrices make Krylov subspace methods more complicated in MIMO case

• Tangential directions: good option

• Choice of shifts and tangential directions plays an important role

22

Conclusions

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Page 23: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Next steps:

• Optimal choice of shifts

Comparison with T-QB-IRKA

Shifts gotten from T-QB-IRKA

• Stability preserving methods

• Other benchmark models

Nonlinear heat transfer

Electrostatic beam

Navier-Stokes equation

23

Outlook

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

Thank you for your attention!

Page 24: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Backup

Page 25: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Assumption: State trajectory does not transit all

regions of the state-space equally often, but mainly

stays in a subspace of lower dimension

25

Projective Model Order Reduction

Procedure:

1. Replace by its approximation

2. Reduce the number of equations (via projection with )

3. Petrov-Galerkin condition

Approximation in the subspace

Maria Cruz Varona | MOR of MIMO QB Systems

Page 26: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

26

Tensors

Three-dimensional figure

Matricizations:Definition:

1-mode: layers are put

side by side

3-mode: fibers on the

depth are put side by

side

2-mode: transposed

layers are put side by

side

Maria Cruz Varona | MOR of MIMO QB Systems

Page 27: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

27

Matricization example

1-mode: layers

are put side by

side

3-mode: fibers

on the depth

side by side

2-mode:

transposed

side by side

Maria Cruz Varona | MOR of MIMO QB Systems

Page 28: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Definition:

Most used:

28

Kronecker product

Maria Cruz Varona | MOR of MIMO QB Systems

Page 29: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

29

Polynomialization Process

Maria Cruz Varona | MOR of MIMO QB Systems

Page 30: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

30Maria Cruz Varona | MOR of MIMO QB Systems

Page 31: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

31

Polynomialization Process

Equivalent

representation

Maria Cruz Varona | MOR of MIMO QB Systems

Page 32: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

32

Quadratic-Bilinearization Process

Maria Cruz Varona | MOR of MIMO QB Systems

Page 33: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Kernels

33

Page 34: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

34Maria Cruz Varona | MOR of MIMO QB Systems

Page 35: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

35Maria Cruz Varona | MOR of MIMO QB Systems

Page 36: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

36Maria Cruz Varona | MOR of MIMO QB Systems

Page 37: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

QBMOR

37

Page 38: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

38

Projective Model Order Reduction

Maria Cruz Varona | MOR of MIMO QB Systems

Page 39: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

39

Multimoments approach (SISO)

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions

linear

bilinear

quadratic

[Breiten ’12]

Page 40: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Let be nonsingular,

with having full rank such that

Hermite approach (SISO)

Theorem: Two-sided rational interpolation [Breiten ’15]

Then:

with .

Motivation | State-of-the-Art | QB Procedure | SISO QB-MOR | MIMO QB-MOR | Examples | Conclusions 40

Page 41: Krylov Subspace Methods for Model Reduction of MIMO ... · 4 State-of-the-Art: Overview Reduction of nonlinear (parametric) systems Simulation-based: POD, TPWL Reduced Basis, Empirical

Chair of Automatic ControlDepartment of Mechanical EngineeringTechnical University of Munich

Pseudolinear approach:

41

Krylov subspaces for MIMO systems

• 2m columns per shift

• 7 moments matched

V and W do not have any

nonlinear information!Stability issues

Maria Cruz Varona | MOR of MIMO QB Systems