46
POD-DEIM Model Order Reduction for Large Nonlinear Problems Christian Himpe, Tobias Leibner and Stephan Rave Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster Westfälische Wilhelms-Universität Münster

POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

POD-DEIM Model Order Reductionfor Large Nonlinear ProblemsChristian Himpe, Tobias Leibner and Stephan Rave

Séminaire d’analyse numérique

Université de Genève

Genève

April 30, 2019living knowledgeWWU Münster

WestfälischeWilhelms-UniversitätMünster

Page 2: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 2 /32

Outline

1. Reduced Basis Methods and POD.

2. HAPOD – Hierarchical Approximate POD.2.1 Definition of the Algorithm.2.2 Theoretical Analysis.2.3 Numerical Experiments.

,,

Stephan Rave ([email protected])

Page 3: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 3 /32

Reduced Basis Methods and POD

,,

Stephan Rave ([email protected])

Page 4: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 4 /32

Reduced Basis MethodsParametric linear parabolic problem (full order model)

For given parameter µ ∈ P, find uµ(t) ∈ Vh s.t.

uµ(0) = u0

〈v , ∂tuµ(t)〉+ bµ(v , uµ(t)) = f (v) ∀v ∈ Vh,

yµ(t) = g(uµ(t)).

Parametric linear parabolic problem (reduced order model)

For given VN ⊂ Vh, let uµ,N(t) ∈ VN be given by Galerkin proj. onto VN , i.e.

uµ,N(0) = PVN(u0),

〈v , ∂tuµ(t),N〉+ bµ(v , uµ(t),N) = f (v) ∀v ∈ VN ,

yµ,N(t) = g(uµ,N(t)),

where PVN: Vh → VN is orthogonal proj. onto VN .

,,

Stephan Rave ([email protected])

Page 5: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 4 /32

Reduced Basis MethodsParametric linear parabolic problem (full order model)

For given parameter µ ∈ P, find uµ(t) ∈ Vh s.t.

uµ(0) = u0

〈v , ∂tuµ(t)〉+ bµ(v , uµ(t)) = f (v) ∀v ∈ Vh,

yµ(t) = g(uµ(t)).

Parametric linear parabolic problem (reduced order model)

For given VN ⊂ Vh, let uµ,N(t) ∈ VN be given by Galerkin proj. onto VN , i.e.

uµ,N(0) = PVN(u0),

〈v , ∂tuµ(t),N〉+ bµ(v , uµ(t),N) = f (v) ∀v ∈ VN ,

yµ,N(t) = g(uµ,N(t)),

where PVN: Vh → VN is orthogonal proj. onto VN .

,,

Stephan Rave ([email protected])

Page 6: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 5 /32

RB Methods – Computing VN

Weak greedy basis generation

1: function WEAK-GREEDY(Strain ⊂ P, ε)2: VN ← {0}3: while maxµ∈Strain ERR-EST(ROM-SOLVE(µ), µ) > ε do4: µ∗ ← arg-maxµ∈Strain

ERR-EST(ROM-SOLVE(µ), µ)

5: VN ← BASIS-EXT(VN , FOM-SOLVE(µ∗))6: end while7: return VN

8: end function

BASIS-EXT

1. Compute u⊥µ∗ (t) = (I − PVN)uµ∗ (t).

2. Add POD(u⊥µ∗ (t)) to VN (leading left-singular vectors of snapshot matrix).

ERR-EST

Use residual-based error estimate w.r.t. FOM (finite dimensional can compute dual norms).

,,

Stephan Rave ([email protected])

Page 7: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 6 /32

RB Methods – Online EfficiencyParametric linear parabolic problem (reduced order model)

uµ,N(0) = PVN(u0),

〈v , ∂tuµ(t),N〉+ bµ(v , uµ(t),N) = f (v) ∀v ∈ VN ,

yµ,N(t) = g(uµ,N(t)),

Affine decomposition

Assume that bµ can be written as

bµ(v , u) =Q∑

q=1

θq(µ)bq(v , u).

Offline/Online splitting

By pre-computing〈ϕi , ϕj 〉, bq(ϕi , ϕj ), f (ϕi ), g(ϕi )

for a reduced basis ϕ1, . . . , ϕN of VN , solving ROM becomes independent of dimVh.

,,

Stephan Rave ([email protected])

Page 8: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 6 /32

RB Methods – Online EfficiencyParametric linear parabolic problem (reduced order model)

uµ,N(0) = PVN(u0),

〈v , ∂tuµ(t),N〉+ bµ(v , uµ(t),N) = f (v) ∀v ∈ VN ,

yµ,N(t) = g(uµ,N(t)),

Affine decomposition

Assume that bµ can be written as

bµ(v , u) =Q∑

q=1

θq(µ)bq(v , u).

Offline/Online splitting

By pre-computing〈ϕi , ϕj 〉, bq(ϕi , ϕj ), f (ϕi ), g(ϕi )

for a reduced basis ϕ1, . . . , ϕN of VN , solving ROM becomes independent of dimVh.

,,

Stephan Rave ([email protected])

Page 9: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 7 /32

RB Methods – Nonlinear ProblemsParametric nonlinear parabolic problem (full order model)

uµ(0) = u0,

〈v , ∂tuµ(t)〉+ 〈v ,Aµ(uµ(t))〉 = f (v) ∀v ∈ Vh,

yµ(t) = g(uµ(t)),

whereAµ : Vh → V ∗h is a nonlinear operator.

Parametric nonlinear parabolic problem (reduced order model)

uµ,N(0) = PVN(u0),

〈v , ∂tuµ(t),N〉+ 〈v ,Aµ(uµ(t),N)〉 = f (v) ∀v ∈ VN ,

yµ,N(t) = g(uµ,N(t)).

Problem: No offline/online splitting of nonlinear

Aµ : VN −→ Vh −→ VN∗.

Same problem for non-affinely decomposed bµ.

,,

Stephan Rave ([email protected])

Page 10: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 7 /32

RB Methods – Nonlinear ProblemsParametric nonlinear parabolic problem (full order model)

uµ(0) = u0,

〈v , ∂tuµ(t)〉+ 〈v ,Aµ(uµ(t))〉 = f (v) ∀v ∈ Vh,

yµ(t) = g(uµ(t)),

whereAµ : Vh → V ∗h is a nonlinear operator.

Parametric nonlinear parabolic problem (reduced order model)

uµ,N(0) = PVN(u0),

〈v , ∂tuµ(t),N〉+ 〈v ,Aµ(uµ(t),N)〉 = f (v) ∀v ∈ VN ,

yµ,N(t) = g(uµ,N(t)).

Problem: No offline/online splitting of nonlinear

Aµ : VN −→ Vh −→ VN∗.

Same problem for non-affinely decomposed bµ.

,,

Stephan Rave ([email protected])

Page 11: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 7 /32

RB Methods – Nonlinear ProblemsParametric nonlinear parabolic problem (full order model)

uµ(0) = u0,

〈v , ∂tuµ(t)〉+ 〈v ,Aµ(uµ(t))〉 = f (v) ∀v ∈ Vh,

yµ(t) = g(uµ(t)),

whereAµ : Vh → V ∗h is a nonlinear operator.

Parametric nonlinear parabolic problem (reduced order model)

uµ,N(0) = PVN(u0),

〈v , ∂tuµ(t),N〉+ 〈v ,Aµ(uµ(t),N)〉 = f (v) ∀v ∈ VN ,

yµ,N(t) = g(uµ,N(t)).

Problem: No offline/online splitting of nonlinear

Aµ : VN −→ Vh −→ VN∗.

Same problem for non-affinely decomposed bµ.,,

Stephan Rave ([email protected])

Page 12: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 8 /32

RB Methods – Empirical Interpolation

EI – abstract versionLet normed Space V , functionals Ψ ⊆ V ∗ and training setM⊂ V be given.Construct via EI-GREEDY algorithm:

1. Interpolation basis b1, . . . bM ∈ spanM,

2. Interpolation functionals ψ1, . . . , ψM ∈ Ψ.

The empirical interpolant IM(v) of an arbitrary v ∈ V is then determined by

IM(v) ∈ span{b1, . . . , bM} and ψm(IM(v)) = ψm(v) 1 ≤ m ≤ M.

EI Cheat SheetV Ψ online

function EI function space point evaluations evaluation at ‘magic points’

operator EI range of (discrete) operator DOFs local evaluation at selected DOFs

matrix DEIM matrices of given shape matrix entries assembly of selected entries

,,

Stephan Rave ([email protected])

Page 13: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 9 /32

RB Methods – Hyper-ReductionReduced Order Model (with EI)

Find uµ,N ∈ VN s.t.

〈v , ∂tuµ,N(t)〉+ 〈v ,{IM ◦ AM,µ ◦ RM′

}(uµ,N(t))〉 = f (v) ∀v ∈ VN ,

where

RM′ : Vh → RM′ restriction to M′ DOFs needed for local evaluationAM,µ: RM′ → RM local evaluation ofAµ at M interpolation DOFs

IM : RM → V ∗h linear interpolation operator

Offline/Online splitting

I Pre-compute the linear operators 〈·, IM(·)〉 and RM′ w.r.t. basis of VN .I Effort to evaluate 〈·, IM ◦ AM,µ ◦ RM′ (·)〉 w.r.t. this basis:

O(MN) +O(M) +O(MN).

,,

Stephan Rave ([email protected])

Page 14: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 10 /32

MULTIBAT: RB Approximation of Li-Ion Battery ModelsExperimental Data

MathematicalModeling

MultiscaleNumerics

ModelReduction

IntegrationValidation

MULTIBAT: Gain understandingof degradation processes inrechargeable Li-Ion Batteriesthrough mathematical modelingand simulation.

I Focus: Li-Plating.

I Li-plating initiated atinterface between activeparticles and electrolyte.

I Need microscale modelswhich resolve activeparticle geometry.

I Very large nonlineardiscrete models.

,,

Stephan Rave ([email protected])

Page 15: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 11 /32

MULTIBAT: Numerical ResultsModel:I Half-cell with plated LiI µ = discharge currentI 2.920.000 DOFs

Reduction:I Snapshots: 3I N = 178 + 67I M = 924 + 997I Rel. err.: < 4.5 · 10−3

Timings:I Full model: ≈ 15.5hI Projection: ≈ 14hI Red. model: ≈ 8mI Speedup: 120

0 2 4 6

0.10

0.15

0.20

0.25

0.30

transferred charge / nAh

cell

volta

ge/

V

0 0.2 0.4 0.6 0.8 1

19.30

19.40

19.50

19.60

19.70

19.80

avg.

Lico

ncen

tr./

kmol

/m3

14.7 nA 79.6 nA 150.6 nA 211.8 nA

355.6 nA full model red. model

0 2 4 6

0.10

0.15

0.20

0.25

0.30

transferred charge / nAh

cell

volta

ge/

V

0 0.2 0.4 0.6 0.8 1

19.30

19.40

19.50

19.60

19.70

19.80

avg.

Lico

ncen

tr./

kmol

/m3

14.7 nA 79.6 nA 150.6 nA 211.8 nA

355.6 nA full model red. model

0 2 4 6

0.10

0.15

0.20

0.25

0.30

transferred charge / nAh

cell

volta

ge/

V

0 0.2 0.4 0.6 0.8 1

19.30

19.40

19.50

19.60

19.70

19.80

avg.

Lico

ncen

tr./

kmol

/m3

14.7 nA 79.6 nA 150.6 nA 211.8 nA

355.6 nA full model red. model

Figure: Validation of reduced order model output for random dischargecurrents; solid lines: full order model, markers: reduced order model.

,,

Stephan Rave ([email protected])

Page 16: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 12 /32

pyMOR – Model Order Reduction with Python

Discretization

Operator

product

operator, rhs

LincombOperator

Operator

Operator

. . .

VectorArray

Reductor

apply inverse

apply2

apply2

Gram-Schmidt

apply2

axpy

scal

Greedyreductor(d, basis)

gram schmidt basis extension(basis, U, prod)

U = d.solve(mu)

Generic algorithms . . .

pyMOR

PDE solver deal.II FEniCS DUNE . . .

dune-pymordolfinpymor-deal.II

dealii model()

fenics model()

dune model()

example.py

User Code

U = d.solve(mu)

d.visualize(U)

greedy(d, ...)

d, prod = ...

I Quick prototyping with Python.

I Seamless integration with high-performance PDE solvers.

I Out of box MPI support for reduction algs. and PDE solvers.

I BSD-licensed, fork us on Github!,,

Stephan Rave ([email protected])

Page 17: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

pyMOR School

October 7-11, 2019MPI Magdeburghttps://school.pymor.org

Page 18: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 14 /32

HAPOD – Hierarchical Approximate POD

,,

Stephan Rave ([email protected])

Page 19: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 15 /32

Computing VN with PODOffline phase

Basis for VN is computed from solution snapshots uµs (t) of full order problem via:I Proper Orthogonal Decomposition (POD)I POD-Greedy (= greedy search in µ + POD in t)

POD (a.k.a. PCA, Karhunen–Loève decomposition)

Given Hilbert space V , S := {v1, . . . , vS} ⊂ V , the k-th POD mode of S isthe k-th left-singular vector of the mapping

Φ : RS → V , es → Φ(es) := vs

Φ ∼= V

RS

Optimality of POD

Let VN be the linear span of first N POD modes, then:∑s∈S‖s − PVN

(s)‖2 =

|S|∑m=N+1

σ2m = min

X⊂Vdim X≤N

∑s∈S‖s − PX (s)‖2

,,

Stephan Rave ([email protected])

Page 20: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 15 /32

Computing VN with PODOffline phase

Basis for VN is computed from solution snapshots uµs (t) of full order problem via:I Proper Orthogonal Decomposition (POD)I POD-Greedy (= greedy search in µ + POD in t)

POD (a.k.a. PCA, Karhunen–Loève decomposition)

Given Hilbert space V , S := {v1, . . . , vS} ⊂ V , the k-th POD mode of S isthe k-th left-singular vector of the mapping

Φ : RS → V , es → Φ(es) := vs

Φ ∼= V

RS

Optimality of POD

Let VN be the linear span of first N POD modes, then:∑s∈S‖s − PVN

(s)‖2 =

|S|∑m=N+1

σ2m = min

X⊂Vdim X≤N

∑s∈S‖s − PX (s)‖2

,,

Stephan Rave ([email protected])

Page 21: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 16 /32

Are your tall and skinny matrices not soskinny anymore?

tall

skinny

not so skinny

POD of large snapshot sets:

I large computational effort

I parallelization?

I data> RAM =⇒ disaster

Solution: PODs of PODs!

,,

Stephan Rave ([email protected])

Page 22: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 16 /32

Are your tall and skinny matrices not soskinny anymore?

tall

skinny

not so skinny

POD of large snapshot sets:

I large computational effort

I parallelization?

I data> RAM =⇒ disaster

Solution: PODs of PODs!

,,

Stephan Rave ([email protected])

Page 23: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 17 /32

Disclaimer

I You might have done this before.

I Others have done it before – often well-hidden in a paper on entirely different topic.We are aware of:[Qu, Ostrouchov, Samatova, Geist, 2002], [Paul-Dubois-Taine, Amsallem, 2015],[Brands, Mergheim, Steinmann, 2016], [Iwen, Ong, 2017].

I Our contributions:1. Formalization for arbitrary trees of worker nodes.2. Extensive theoretical error and performance analysis.3. A recipe for selecting local truncation thresholds.4. Extensive numerical experiments for different application scenarios.

I Can be trivially extended to low-rank approximation of snapshot matrix by keepingtrack of right-singular vectors.

,,

Stephan Rave ([email protected])

Page 24: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 17 /32

Disclaimer

I You might have done this before.

I Others have done it before – often well-hidden in a paper on entirely different topic.We are aware of:[Qu, Ostrouchov, Samatova, Geist, 2002], [Paul-Dubois-Taine, Amsallem, 2015],[Brands, Mergheim, Steinmann, 2016], [Iwen, Ong, 2017].

I Our contributions:1. Formalization for arbitrary trees of worker nodes.2. Extensive theoretical error and performance analysis.3. A recipe for selecting local truncation thresholds.4. Extensive numerical experiments for different application scenarios.

I Can be trivially extended to low-rank approximation of snapshot matrix by keepingtrack of right-singular vectors.

,,

Stephan Rave ([email protected])

Page 25: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 17 /32

Disclaimer

I You might have done this before.

I Others have done it before – often well-hidden in a paper on entirely different topic.We are aware of:[Qu, Ostrouchov, Samatova, Geist, 2002], [Paul-Dubois-Taine, Amsallem, 2015],[Brands, Mergheim, Steinmann, 2016], [Iwen, Ong, 2017].

I Our contributions:1. Formalization for arbitrary trees of worker nodes.2. Extensive theoretical error and performance analysis.3. A recipe for selecting local truncation thresholds.4. Extensive numerical experiments for different application scenarios.

I Can be trivially extended to low-rank approximation of snapshot matrix by keepingtrack of right-singular vectors.

,,

Stephan Rave ([email protected])

Page 26: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 18 /32

HAPOD – Hierarchical Approximate POD

ρ

α1

β1 β2 β3

α2

β5 β6

I Input: Assign snapshot vectors to leaf nodes βi as input.

I At each node α:1. Perform POD of input vectors with given local `2-error tolerance ε(α).2. Scale POD modes by singular values.3. Send scaled modes to parent node as input.

I Output: POD modes at root node ρ.

,,

Stephan Rave ([email protected])

Page 27: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 19 /32

HAPOD – Special Cases

Distributed HAPOD

ρ

β1 β2 β3 β4

I Distributed, communication avoidingPOD computation.

Incremental HAPOD

ρ

α3

α2

α1 β1

β2

β3

I On-the-fly compression of largetrajectories.

,,

Stephan Rave ([email protected])

Page 28: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 20 /32

HAPOD – Some Notation

TreesT the treeρT root nodeNT (α) nodes of T below or equal node αLT leafs of TLT depth of T

HAPODS snapshot setD : S → LT snapshot to leaf assignmentε(α) error tolerance at α|HAPOD[S, T ,D, ε](α)| number of HAPOD modes at α|POD(S, ε)| number of POD modes for error tolerance εPα orth. proj. onto HAPOD modes at αSα snapshots at leafs below α

,,

Stephan Rave ([email protected])

Page 29: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 21 /32

HAPOD – Theoretical Analysis

Theorem (Error bound1)∑s∈Sα

‖s − Pα(s)‖2 ≤∑

γ∈NT (α)

ε(γ)2.

Theorem (Mode bound)∣∣∣HAPOD[S, T ,D, ε](α)∣∣∣ ≤ ∣∣∣POD

(Sα, ε(α)

)∣∣∣.But how to choose ε in practice?

I Prescribe error tolerance ε∗ for final HAPOD modes.I Balance quality of HAPOD space (number of additional modes) and computational

efficiency (ω ∈ [0, 1]).I Number of input snapshots should be irrelevant for error measure (might be even

unknown a priori). Hence, control `2-mean error 1|S|∑

s∈S ‖s − PρT (s)‖2.

1For special cases in appendix of [Paul-Dubois-Taine, Amsallem, 2015].,,

Stephan Rave ([email protected])

Page 30: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 21 /32

HAPOD – Theoretical Analysis

Theorem (Error bound1)∑s∈Sα

‖s − Pα(s)‖2 ≤∑

γ∈NT (α)

ε(γ)2.

Theorem (Mode bound)∣∣∣HAPOD[S, T ,D, ε](α)∣∣∣ ≤ ∣∣∣POD

(Sα, ε(α)

)∣∣∣.

But how to choose ε in practice?I Prescribe error tolerance ε∗ for final HAPOD modes.I Balance quality of HAPOD space (number of additional modes) and computational

efficiency (ω ∈ [0, 1]).I Number of input snapshots should be irrelevant for error measure (might be even

unknown a priori). Hence, control `2-mean error 1|S|∑

s∈S ‖s − PρT (s)‖2.

1For special cases in appendix of [Paul-Dubois-Taine, Amsallem, 2015].,,

Stephan Rave ([email protected])

Page 31: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 21 /32

HAPOD – Theoretical Analysis

Theorem (Error bound1)∑s∈Sα

‖s − Pα(s)‖2 ≤∑

γ∈NT (α)

ε(γ)2.

Theorem (Mode bound)∣∣∣HAPOD[S, T ,D, ε](α)∣∣∣ ≤ ∣∣∣POD

(Sα, ε(α)

)∣∣∣.But how to choose ε in practice?

I Prescribe error tolerance ε∗ for final HAPOD modes.I Balance quality of HAPOD space (number of additional modes) and computational

efficiency (ω ∈ [0, 1]).I Number of input snapshots should be irrelevant for error measure (might be even

unknown a priori). Hence, control `2-mean error 1|S|∑

s∈S ‖s − PρT (s)‖2.

1For special cases in appendix of [Paul-Dubois-Taine, Amsallem, 2015].,,

Stephan Rave ([email protected])

Page 32: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 22 /32

HAPOD – Theoretical AnalysisTheorem (`2-mean error and mode bounds)

Choose local POD error tolerances ε(α) for `2-approximation error as:

ε(ρT ) :=√|S| · ω · ε∗, ε(α) :=

√Sα · (LT − 1)−1/2 ·

√1− ω2 · ε∗.

Then:

1|S|∑s∈S‖s − PρT (s)‖2 ≤ ε∗2 and |HAPOD[S, T ,D, ε]| ≤ |POD(S, ω · ε∗)|,

where POD(S, ε) := POD(S, |S| · ε).

Moreover:

|HAPOD[S, T ,D, ε](α)| ≤ |POD(Sα, (LT − 1)−1/2 ·√

1− ω2 · ε∗)|

≤ minN∈N

(dN(S) ≤ (LT − 1)−1/2 ·√

1− ω2 · ε∗).

,,

Stephan Rave ([email protected])

Page 33: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 22 /32

HAPOD – Theoretical AnalysisTheorem (`2-mean error and mode bounds)

Choose local POD error tolerances ε(α) for `2-approximation error as:

ε(ρT ) :=√|S| · ω · ε∗, ε(α) :=

√Sα · (LT − 1)−1/2 ·

√1− ω2 · ε∗.

Then:

1|S|∑s∈S‖s − PρT (s)‖2 ≤ ε∗2 and |HAPOD[S, T ,D, ε]| ≤ |POD(S, ω · ε∗)|,

where POD(S, ε) := POD(S, |S| · ε).

Moreover:

|HAPOD[S, T ,D, ε](α)| ≤ |POD(Sα, (LT − 1)−1/2 ·√

1− ω2 · ε∗)|

≤ minN∈N

(dN(S) ≤ (LT − 1)−1/2 ·√

1− ω2 · ε∗).

,,

Stephan Rave ([email protected])

Page 34: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 23 /32

Incremental HAPOD ExampleCompress state trajectory of forced inviscid Burgers equation:

∂tz(x , t) + z(x , t) · ∂xz(x , t) = u(t) exp(−120

(x −12

)2), (x , t) ∈ (0, 1)× (0, 1),

z(x , 0) = 0, x ∈ [0, 1],

z(0, t) = 0, t ∈ [0, 1],

where u(t) ∈ [0, 1/5] iid. for 0.1% random timesteps, otherwise 0.

I Upwind finite difference scheme on uniform mesh withN = 500 nodes.

I 104 explicit Euler steps.

I 100 sub-PODs, ω = 0.75.

I All computations on Raspberry Pi 1B single boardcomputer (512MB RAM).

1 0.8 0.6Space

0.4 0.2 0

0

0.2

0.4

0.6

0.8

1

Time

10.8

0.60.4

0.2

,,

Stephan Rave ([email protected])

Page 35: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 24 /32

Incremental HAPOD Example

100 10−1 10−2 10−3

100

10−1

10−2

10−3

Prescribed Mean Proj. Error (N = 500)

Mea

nPr

ojec

tion

Erro

r

100 10−1 10−2 10−3

10

20

30

40

50

60

70

80

90

Prescribed Mean Proj. Error (N = 500)

Num

bero

fMod

es

100 10−1 10−2 10−3

200

400

600

Prescribed Mean Proj. Error (N = 500)

Com

puta

tion

alTi

me

[s]

500 1,000 1,500 2,000

102

103

State Dimension N (ε∗ = 10−3/2 )

Com

puta

tion

alTi

me

[s]

POD

HAPOD

Bound

Intermed.

,,

Stephan Rave ([email protected])

Page 36: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 25 /32

Distributed HAPOD ExampleDistributed computation and POD of empirical cross Gramian:

WX ,ij :=M∑

m=1

∫ ∞0〈xmi (t), y j

m(t)〉 dt ∈ RN×N

I ‘Synthetic’ benchmark model2 from MORWiki with parameter θ = 110 .

I Partition WX into 100 slices of size 10.000× 100.

10−2 10−4 10−6 10−8 10−10

10−5

10−3

10−1

Prescribed Mean Proj. Error (ω = 0.5)

Mod

elRe

duct

ion

Erro

r

POD

HAPOD

101 102 103101

102

103

104

105

Block Size (ε∗ = 10−6 ,ω = 0.5)

Spee

dup

LT = 2

LT = 3

LT = 4

LT = 5

2See: http://modelreduction.org/index.php/Synthetic_parametric_model,,

Stephan Rave ([email protected])

Page 37: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 26 /32

HAPOD – HPC ExampleNeutron transport equation

∂tψ(t, x, v) + v · ∇xψ(t, x, v) + σt(x)ψ(t, x, v) =1|V |

σs(x)

∫Vψ(t, x,w) dw + Q(x)

I Moment closure/FV approximation.

I Varying absorbtion and scattering coefficients.

I Distributed snapshot and HAPOD computation onPALMA cluster (125 cores).

,,

Stephan Rave ([email protected])

Page 38: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 27 /32

HAPOD – HPC Exampleαn

α2n

α1n

τ 1n,1 · · · τ 1

n,12

τ 2n,1 · · · τ 2

n,12

τ sn,1 · · · τ s

n,12

I HAPOD on compute node n. Time steps are split into sslices. Each processor core computes one slice at atime, performs POD and sends resulting modes to mainMPI rank on the node.

ρ

α1 α2

α3

α11

I Incremental HAPOD is performed onMPI rank 0 with modes collected oneach node.

,,

Stephan Rave ([email protected])

Page 39: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 28 /32

HAPOD – HPC Example

10−510−410−310−2

10−4

10−3

Prescribed Mean Proj. Error (k = 20)

Mea

nM

odel

Redu

ctio

nEr

ror

10−510−410−310−2

0

10

20

2 10 35 94

Prescribed Mean Proj. Error (k = 20)

Add

itio

nalM

odes

POD modes

0 100 20010−1

101

103

Grid size k (ε∗ = 10−4 ,ω = 0.95)

Com

puta

tion

alTi

me

[s]

POD

HAPOD

Data gen.

10−510−410−310−2

0

100

200

300

Prescribed Mean Proj. Error (k = 20)

Com

puta

tion

alTi

me

[s]

ω = 0.1ω = 0.25ω = 0.5ω = 0.75ω = 0.9ω = 0.95ω = 0.99ω = 0.999

POD

I ≈ 39.000 · k3 doubles of snapshot data (≈ 2.5 terabyte for k = 200).,,

Stephan Rave ([email protected])

Page 40: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 29 /32

What About Nonlinear Problems?For nonlinear problems, we also need to generate a basis for EI.

I In case of DEIM, EI basis is computed as POD of operator evaluations.

I Use HAPOD to simultaneously compute RB and DEIM bases.

I Interpolation DOFs are chosen afterwards only using DEIM basis as data (EI-GREEDY).

First experiments (3D neutron transport with Mn closure):

εrb εei N M ROM error TROM TFOM speedup

1·10−2 1·10−2 4 1 4.42·10−2 0.64 765.47 1,194.581·10−2 5·10−3 4 2 1.48·10−2 1.08 764.85 708.471·10−2 1·10−3 4 6 1.05·10−2 3.63 765.17 210.51

1·10−3 1·10−3 16 6 4.46·10−3 3.82 763.73 199.981·10−3 5·10−4 16 8 3.65·10−3 5.81 764.24 131.571·10−3 1·10−4 16 19 1.37·10−3 12.42 763.62 61.47

1·10−4 1·10−4 43 19 1.71·10−3 11.27 766.01 67.951·10−4 5·10−5 43 25 7.20·10−3 15.71 765.32 48.731·10−4 1·10−5 43 45 4.49·10−4 24.89 765.02 30.73

,,

Stephan Rave ([email protected])

Page 41: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 29 /32

What About Nonlinear Problems?For nonlinear problems, we also need to generate a basis for EI.

I In case of DEIM, EI basis is computed as POD of operator evaluations.

I Use HAPOD to simultaneously compute RB and DEIM bases.

I Interpolation DOFs are chosen afterwards only using DEIM basis as data (EI-GREEDY).

First experiments (3D neutron transport with Mn closure):

εrb εei N M ROM error TROM TFOM speedup

1·10−2 1·10−2 4 1 4.42·10−2 0.64 765.47 1,194.581·10−2 5·10−3 4 2 1.48·10−2 1.08 764.85 708.471·10−2 1·10−3 4 6 1.05·10−2 3.63 765.17 210.51

1·10−3 1·10−3 16 6 4.46·10−3 3.82 763.73 199.981·10−3 5·10−4 16 8 3.65·10−3 5.81 764.24 131.571·10−3 1·10−4 16 19 1.37·10−3 12.42 763.62 61.47

1·10−4 1·10−4 43 19 1.71·10−3 11.27 766.01 67.951·10−4 5·10−5 43 25 7.20·10−3 15.71 765.32 48.731·10−4 1·10−5 43 45 4.49·10−4 24.89 765.02 30.73

,,

Stephan Rave ([email protected])

Page 42: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 29 /32

What About Nonlinear Problems?For nonlinear problems, we also need to generate a basis for EI.

I In case of DEIM, EI basis is computed as POD of operator evaluations.

I Use HAPOD to simultaneously compute RB and DEIM bases.

I Interpolation DOFs are chosen afterwards only using DEIM basis as data (EI-GREEDY).

First experiments (3D neutron transport with Mn closure):

εrb εei N M ROM error TROM TFOM speedup

1·10−2 1·10−2 4 1 4.42·10−2 0.64 765.47 1,194.581·10−2 5·10−3 4 2 1.48·10−2 1.08 764.85 708.471·10−2 1·10−3 4 6 1.05·10−2 3.63 765.17 210.51

1·10−3 1·10−3 16 6 4.46·10−3 3.82 763.73 199.981·10−3 5·10−4 16 8 3.65·10−3 5.81 764.24 131.571·10−3 1·10−4 16 19 1.37·10−3 12.42 763.62 61.47

1·10−4 1·10−4 43 19 1.71·10−3 11.27 766.01 67.951·10−4 5·10−5 43 25 7.20·10−3 15.71 765.32 48.731·10−4 1·10−5 43 45 4.49·10−4 24.89 765.02 30.73

,,

Stephan Rave ([email protected])

Page 43: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 29 /32

What About Nonlinear Problems?For nonlinear problems, we also need to generate a basis for EI.

I In case of DEIM, EI basis is computed as POD of operator evaluations.

I Use HAPOD to simultaneously compute RB and DEIM bases.

I Interpolation DOFs are chosen afterwards only using DEIM basis as data (EI-GREEDY).

First experiments (3D neutron transport with Mn closure):

εrb εei N M ROM error TROM TFOM speedup

1·10−2 1·10−2 4 1 4.42·10−2 0.64 765.47 1,194.581·10−2 5·10−3 4 2 1.48·10−2 1.08 764.85 708.471·10−2 1·10−3 4 6 1.05·10−2 3.63 765.17 210.51

1·10−3 1·10−3 16 6 4.46·10−3 3.82 763.73 199.981·10−3 5·10−4 16 8 3.65·10−3 5.81 764.24 131.571·10−3 1·10−4 16 19 1.37·10−3 12.42 763.62 61.47

1·10−4 1·10−4 43 19 1.71·10−3 11.27 766.01 67.951·10−4 5·10−5 43 25 7.20·10−3 15.71 765.32 48.731·10−4 1·10−5 43 45 4.49·10−4 24.89 765.02 30.73

,,

Stephan Rave ([email protected])

Page 44: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 30 /32

HAPOD

Rigorous!

Error bounds Mode bounds

Fast!

Single passlive data

compression

OvercomeRAM

limitations

Reducedcomputational

complexity

Simple!

Cloud-friendlyBring-your-own-SVD

Easyparallelization

,,

Stephan Rave ([email protected])

Page 45: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 31 /32

Thank you for your attention!

C. Himpe, T. Leibner, S. Rave, Hierarchical Approximate Proper Orthogonal DecompositionSIAM J. Sci. Comput., 40(5), pp. A3267-A3292

pyMOR – Generic Algorithms and Interfaces for Model Order ReductionSIAM J. Sci. Comput., 38(5), pp. S194–S216pip3 install pymor

Matlab HAPOD implementation:git clone https://github.com/gramian/hapod

My homepage:https://stephanrave.de/

,,

Stephan Rave ([email protected])

Page 46: POD-DEIM Model Order Reduction for Large Nonlinear Problems...Séminaire d’analyse numérique Université de Genève Genève April 30, 2019 living knowledge WWU Münster WestfälischeWilhelms-UniversitätMünster

WestfälischeWilhelms-UniversitätMünster POD-DEIM Model Reduction for Large Problems 32 /32

HAPOD vs. Stoachstic SVD

HAPOD stoch. SVD

efficient

rigorous analysis

easy to parallelize

low-rank approximation

matrix free

single-pass

single-pass with error control

easy to implement

I HAPOD is a method to efficiently obtain the POD from PODs of subsets of the data.

I HAPOD can be utilized on top of stochastic SVD methods.

,,

Stephan Rave ([email protected])