construction of parametrically-robust cfd-based reduced...

32
Introduction Progressively Updated ROMs for Optimization Application Conclusion Construction of Parametrically-Robust CFD-Based Reduced-Order Models for PDE-Constrained Optimization Matthew J. Zahr, David Amsallem, Charbel Farhat Farhat Research Group Stanford University 25th June 2013 San Diego, CA 43rd AIAA Fluid Dynamics Conference and Exhibit Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Upload: others

Post on 01-Apr-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Construction of Parametrically-RobustCFD-Based Reduced-Order Models for

PDE-Constrained Optimization

Matthew J. Zahr, David Amsallem, Charbel Farhat

Farhat Research GroupStanford University

25th June 2013San Diego, CA

43rd AIAA Fluid Dynamics Conference and Exhibit

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 2: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Motivation

Complex, steady-state problems

REDUCED ORDER MODEL (ROM)

o Perturbation problems (stability, trends, control, etc.)!

o Response problems (behavior, performance, etc.)!

- linearized !

- nonlinear !

!  Complex, time-dependent problems!

Real-time analyses

Model Predictive Control

Many-query analyses

OptimizationUncertainty QuantificationRoutine Analysis

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 3: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Projection-based Model Reduction

High-Dimensional Model (HDM)

Large-scale discretization of Navier-Stokes equationParametric: shape parameter, Mach number, angle of attack

Reduced-Order Model (ROM)Offline

Sample HDM at multiple parameter configurations(training set)Collect snapshotsCompress snapshots → Reduced-Order Basis (ROB) →reduce dimension of state vectorProject governing equations onto a related subspace

Online

Query ROM

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 4: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

ROM Optimization Applications

For the use of ROMs as surrogates in optimization, the“offline” cost must not be too large

Only timing important is the clock-time from the beginningof the design process to the time the solution is obtainedNo distinction between offline cost and online cost

Well-known that ROMs lack robustness away from theirtraining configurations

Sample HDM only in regions of interest

Vicinity of current iterateVicinity of optimal solution

Such regions not known apriori, i.e. in the “offline” phase

Offline/online framework not natural in optimizationcontext

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 5: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

High-Dimensional Model (HDM)

We are interested in solving the following discretized,steady-state PDE:

R(w;µ) = 0,

where w ∈ RN is the state vector (N typically very large) andµ ∈ Rp is the vector of parameters.

Examples

Navier-Stokes equations

Euler equations

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 6: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Reduced-Order Model (ROM)

Define a ROB ΦD ∈ RN×ny generated from snapshots ofthe HDM in the training set D = {µ1,µ2, . . . ,µns

}Model Order Reduction (MOR) assumption

w = w̄ + ΦDwr

where wr ∈ Rny are the reduced coordinates and ny � N .

N equations, nY unknowns

R(w̄ + ΦDwr;µ) ≈ 0

Require residual ⊥ to the subspace spanned by a left basis,Ψ ∈ RN×nY

ΨTR(w̄ + ΦDwr;µ) = 0

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 7: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Reduced-Order Model (ROM)

Define a ROB ΦD ∈ RN×ny generated from snapshots ofthe HDM in the training set D = {µ1,µ2, . . . ,µns

}Model Order Reduction (MOR) assumption

w = w̄ + ΦDwr

where wr ∈ Rny are the reduced coordinates and ny � N .

N equations, nY unknowns

R(w̄ + ΦDwr;µ) ≈ 0

Require residual ⊥ to the subspace spanned by a left basis,Ψ ∈ RN×nY

ΨTR(w̄ + ΦDwr;µ) = 0

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 8: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Hyperreduction

Despite reduced dimension, still requires operations scalingwith N

ΨTR(w̄ + ΦDwr;µ) = 0

Build reduced basis for residual Φr ∈ RN×nr

R ≈ ΦrRr

Determine residual reduced coordinates via gappyapproximation

Rr = arg minr∈Rnr

∣∣∣∣ZTR− ZTΦrr∣∣∣∣

where Z ∈ RN×ni is a restriction operator

Similar procedure for Jacobian

Avoids online operations scaling with N

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 9: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

ROM-Constrained Optimization

PDE-Constrained Optimization

minimizeµ∈Rp

f(w(µ),µ)

subject to c(w(µ),µ) ≤ 0(1)

w is implicitly defined as a function of µ via the equationR(w;µ) = 0.

ROM-Constrained Optimization

minimizeµ∈Rp

f(w̄ + ΦDwr(µ),µ)

subject to c(w̄ + ΦDwr(µ),µ) ≤ 0(2)

wr is implicitly defined as a function of µ via the equationΨTR(w̄ + ΦDwr;µ) = 0.

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 10: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 11: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 12: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 13: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 14: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 15: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 16: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 17: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 18: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 19: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 20: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 21: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Progressively Updated ROMs for Optimization

Progressively construct a ROM specialized to a particular regionof the parameter space while using it to solve the optimization

problem of interest

� ���������������� �������������������� ����������

Sample HDM Apriori Sample HDM Progressively

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 22: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Sequential Optimization Subproblem

Given ΦD generated from a very coarse sampling of parametersD = {µ1,µ2, . . . ,µk}, solve

minimizeµ∈Rp

f(w̄ + ΦDwr(µ))− γ

2

∣∣∣∣R(w̄ + ΦDwr(µ);µ)∣∣∣∣22

subject to c(w̄ + ΦDwr(µ),µ) ≤ 0.(3)

wr(µ) is implicitly defined via ΨTR(w̄ + ΦDwr;µ) = 0.

Cost: Every iteration requires ROM solution.

Does not require solution of HDM until sample is found

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 23: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

ROM-Constrained Sampling Algorithm

Algorithm 1 Progressively Updated ROMs for Optimization

Input: Initial ROB, ΦD; γ0 ∈ R+; 0 < ρ < 1Output: Solution to (2), µ∗ (approximation to solution of (1))

1: γ = γ02: while optimality conditions of (2) not satisfied do3: Solve (3) → µ∗ and w∗r4: if ||R(w̄ + Φw∗r ,µ

∗)|| > ε then5: Solve R(w,µ∗) = 0→ w∗

6: D ← D ∪ {µ∗}7: Update ΦD with new snapshots w∗

8: end if9: γ = ργ

10: end while

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 24: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Quasi-1D Euler Flow

Quasi-1D Euler equations:

∂U

∂t+

1

A

∂(AF)

∂x= Q

where

U =

ρρue

, F =

ρuρu2 + p(e+ p)u

, Q =

0pA

∂A∂x0

Semi-discretization =⇒ finite volumes with Roe flux andentropy corrections

Full discretization =⇒ Backward Euler → steady state

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 25: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Nozzle Parametrization

Nozzle parametrized with cubic splines using 13 control pointsand constraints requiring

convexity A′′(x) ≥ 0bounds on A(x) Al(x) ≤ A(x) ≤ Au(x)bounds on A′(x) at inlet/outlet A′(xl) ≤ 0, A′(xr) ≥ 0

0 0.05 0.1 0.15 0.2 0.250

0.01

0.02

0.03

0.04

0.05

0.06

0.07

x

Nozzle

Heig

ht

Nozz l e Parametri zation

Al(x)

Au(x)

A(x)

Spl ine Points

Student Version of MATLAB

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 26: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Numerical Experiment (Parameter Estimation)

Select µex and let wex be the solution of R(w;µexact), then theparameter estimation problem is

minimizeµ∈Rp

f(µ) =1

2

∣∣∣∣w̄ + ΦDwr(µ)−wex∣∣∣∣22

subject to c(w̄ + ΦDwr(µ),µ) ≤ 0

(4)

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 27: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Optimization Comparison

HDMOpt, whereby (4) is solved with standardPDE-constrained optimization technology (NANDframework) without introducing a reduced-order model,

LHSOpt, whereby a ROM is built using standardtechniques with parameter samples chosen based on aLatin Hypercube Sampling (LHS) of the feasible region;the HDM is replaced with the resulting ROM in (4),

MergeOpt, whereby Algorithm 1 is applied to (4).

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 28: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

ROM Optimization Experiment Results

Table : Accuracy and performance comparison for variousPDE-constrained optimization methods for the shape optimizationproblem

MergeOpt LHSOpt 1 HDMOpt

µex Error (%) 2.88 (3.32, 44.7, 16.4) 1.04× 10−7

wex Error (%) 0.67 (0.84, 89.6, 12.3) 6.79× 10−9

# HDM 9 (12,12,12) 202

# ROM 770 (2, 613, 168) -

1(min, max, mean)Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 29: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Experiment Results: LHSOpt

Figure : LHSOpt NozzleConfiguration Samples

LHS Samples

A!(x)

A0(x)

Au(x)

Al(x)

Noz

zle

Hei

ght

x0 0.05 0.1 0.15 0.2 0.25

0

0.01

0.02

0.03

0.04

0.05

0.06

0.07

Figure : Mach Distribution atLHSOpt Samples

LHS Samples

A!(x)

A0(x)

Mac

h

x0 0.05 0.1 0.15 0.2 0.25

0

0.5

1

1.5

2

2.5

3

3.5

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 30: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Experiment Results: MergeOpt

Figure : MergeOpt NozzleConfiguration Samples

LHS Samples

A!(x)

A0(x)

Au(x)

Al(x)

Noz

zle

Hei

ght

x0 0.05 0.1 0.15 0.2 0.25

0

0.01

0.02

0.03

0.04

0.05

0.06

0.07

Figure : Mach Distribution atMergeOpt Samples

LHS Samples

A!(x)

A0(x)

Mac

h

x0 0.05 0.1 0.15 0.2 0.25

0

0.5

1

1.5

2

2.5

3

3.5

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 31: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Conclusions and Future Work

Proposed approach progressively updates a ROM whilesolving a PDE-constrained optimization problem usinginformation regarding:

the physics of the problemcurrent state of the ROM

Proposed approach specializes the ROM to the vicinity ofthe current iterate instead of attempting to make the ROMaccurate in the entire parameter space

Requires fewer HDM queries than HDMOpt and LHSOptAchieves low errors in µex and wex

Hyperreduction necessary to realize speedups

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs

Page 32: Construction of Parametrically-Robust CFD-Based Reduced ...math.lbl.gov/~mjzahr/content/slides/zahr2013aiaa1.pdfConclusion Construction of Parametrically-Robust CFD-Based Reduced-Order

IntroductionProgressively Updated ROMs for Optimization

ApplicationConclusion

Acknowledgments

Department of Energy Computational Science GraduateFellowship

Zahr, Amsallem, Farhat Optimization-Based Sampling for ROMs