statistical methods for the analysis of dsmc simulations of hypersonic shocks james s. strand the...

53
Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational Resources Provided by the Department of Energy through the PSAAP Program Predictive Engineering and Computational Computational Fluid Physics Laboratory

Upload: regina-lilian-mcgee

Post on 12-Jan-2016

228 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Statistical Methods for the Analysis of DSMC Simulations

of Hypersonic ShocksJames S. Strand

The University of Texas at Austin

Funding and Computational Resources Provided by the Department of Energy through the PSAAP

Program

Predictive Engineering and Computational Sciences

Computational Fluid Physics Laboratory

Page 2: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Introduction - DSMC

Direct Simulation Monte Carlo (DSMC) is a stochastic, particle based method for simulating gas dynamics.

• Simulated particles represent large numbers of real particles.• Particles move and interact with other particles.• Interactions between particles (such as elastic or inelastic collisions and chemical reactions) are handled statistically.

Page 3: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Motivation: Why Use DSMC?

• DSMC is often the only realistic option for simulation of the rarefied flows which occur in a diverse set of fields. Examples include the high-altitude portion of atmospheric re-entry, space station plume impingement, flow in MEMS devices, and planetary atmospheres.

• DSMC provides accurate simulation of highly non-equilibrium regions of a flowfield (such as strong shock waves).

• DSMC can model thermochemistry on a more detailed level than most CFD codes.

Page 4: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Motivation – DSMC Parameters

• The DSMC model includes many parameters related to gas dynamics at the molecular level, such as: Elastic collision cross-sections. Vibrational and rotational excitation probabilities. Reaction cross-sections. Sticking coefficients and catalytic efficiencies for gas-

surface interactions. …etc.

Page 5: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Motivation – DSMC Parameters

• In many cases the precise values of some of these parameters are not known.• Parameter values often cannot be directly measured, instead they must be inferred from experimental results.• By necessity, parameters must often be used in regimes far from where their values were determined.• More precise values for important parameters would lead to better simulation of the physics, and thus to better predictive capability for the DSMC method. The ultimate goal of this project is to use experimental data to calibrate DSMC parameters relevant to the simulation of hypersonic shocks.

Page 6: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Motivation – General

Aside from the specific long-term goal of calibrating DSMC parameters based on experimental data, we have two more general objectives as well:

• To demonstrate a sensitivity analysis methodology which can be used for complex physical problems related to gas dynamics.

• To demonstrate that making use of multiple types of data from multiple scenarios can be helpful when solving the inverse problem in order to calibrate parameters.

Page 7: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

DSMC Method

Initialize

Move

Index

Collide

Sample

Performed on First Time Step

Performed on Selected Time Steps

Performed on Every Time Step

Create

Page 8: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Particle Interactions in DSMC

Interactions between particles are performed statistically in DSMC. Pairs of particles are randomly selected from within a cell, and a random number draw determines whether or not the particles interact, and if so, which type of interaction occurs.

Page 9: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Particle Interaction Models and Parameters

• Elastic Collisions: VHS Model

• Internal Energy Transfer: Larsen-Borgnakke Model

• Five-species Air Chemistry (Dissocation, Recombination, and Exchange Reactions): TCE Model

Page 10: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Sensitivity Analysis - Overview

• The purpose of the sensitivity analyses presented in this work was to determine which parameters most strongly affect the simulation results for a given scenario and quantity of interest (QoI).

• We will choose which parameters to calibrate based on the results of our sensitivity analyses.

Page 11: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Global Sensitivity Analysis

In this work we use a global sensitivity analysis methodology. In a global sensitivity analysis all of the parameters are varied simultaneously.

Each parameter is assigned a distribution, called the prior, which reflects the level of uncertainty for that parameter (based on literature values and expert judgment). During the sensitivity analysis the parameters take on values drawn from this prior, rather than in a small region about a nominal value.

Page 12: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Sampling the Parameter Space

• Our global sensitivity analysis requires a Monte Carlo sampling of the parameter space. For each sample point, a set of random number draws is performed to determine the values of all of the parameters.

• A simulation is then run with this set of parameter values, and the results for the QoI are output.

• Once a reasonable number of sample points have been completed, we can create scatterplots for the relationship between each parameter and the QoI.

Page 13: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Sampling the Parameter Space

1

QoI

Page 14: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Sensitivity Analysis – Measures of Sensitivity

Two measures for sensitivity were used in this work:

• The square of the Pearson correlation coefficient:

• The mutual information:

Page 15: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

1

QoI

r = -0.0264r2 = 0.0007

2

QoI

r = -0.2384r2 = 0.0568

3

QoI

r = 0.6475r2 = 0.4193

Sensitivity Analysis: r2

Page 16: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

1

QoI

1

QoI

Sensitivity Analysis: Mutual Information

Page 17: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Sensitivity Analysis: Mutual Information

1

p(

1)

QoI

p(QoI)

0.2460.1850.1230.0620.000

p(1,QoI)

Page 18: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Sensitivity Analysis: Mutual Information

1

p(

1)

QoI

p(QoI)

0.1150.0860.0570.0290.000

p(1)p(QoI)

Page 19: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Sensitivity Analysis: Mutual Information

𝑰 (𝜽𝟏 ,𝑸𝒐𝑰 )=∫𝜽𝟏

∫𝑸𝒐𝑰

𝒑 (𝜽𝟏 ,𝑸𝒐𝑰 )[𝒍𝒏( 𝒑 (𝜽𝟏 ,𝑸𝒐𝑰 )𝒑 (𝜽𝟏)𝒑 (𝑸𝒐𝑰 )) ]𝒅𝑸𝒐𝑰 𝒅𝜽𝟏

Hypothetical joint PDF for case where the QoI is indepenent of θ1.

Actual joint PDF of θ1 and the QoI, from a Monte Carlo sampling of theparameter space.

Kullback-Leibler divergence0.2460.1850.1230.0620.000

p(1,QoI)

0.1150.0860.0570.0290.000

p(1)p(QoI)

0.0080.0060.0040.0020.000

𝐩 (𝛉𝟏 ,𝐐𝐨𝐈 )[𝐥𝐧 ( 𝐩 (𝛉𝟏 ,𝐐𝐨𝐈)𝐩 (𝛉𝟏 )𝐩(𝐐𝐨𝐈)) ]

Hypothetical joint PDF for case where the QoI is indepenent of θ1.

Actual joint PDF of θ1 and the QoI, from a Monte Carlo sampling of theparameter space.

QoI

θ1

Page 20: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

0-D Relaxation Scenario

• 0-D box is initialized with 79% N2, 21% O2. Initial bulk number density = 1.0×1023 #/m3. Initial bulk translational temperature = ~50,000 K. Initial bulk rotational and vibrational temperatures are

both 300 K, based on the assumption that in a shock the translational modes equilibrate faster than the internal modes.

• Scenario is intended to be a 0-D substitute for a hypersonic shock at ~8 km/s.

Page 21: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Parameters for the 0-D RelaxationSensitivity Analysis

39 parameters were included in this sensitivity analysis.• 17 for the chemical reaction rates (N2, O2, and NO dissociation/recombination, and the NO exchange reactions).

• 15 for the elastic collision cross-sections (one for each possible set of collision partners).

• 6 for internal energy transfer (one for the rotational mode and one for the vibrational mode for each species).

• One DSMC numerical parameter (the ratio of real to simulated particles).

Page 22: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Prior Distributions for the Parameters

• The Λ parameters for the chemical reaction rates are given a prior which extends from 0.1×Λnom to 10×Λnom, with Λnom for each reaction obtained from Gupta et al. (1989). Since we are varying Λ for each reaction over two orders of magnitude we will actually check sensitivity to log10Λ.

• The dref parameters for the elastic collision cross-sections are given a prior which extends from 0.5×dref,nom to 1.5×dref,nom, with values of dref,nom from Ozawa (2008).

T. Ozawa, J. Zhong, and D. A. Levin, Physics of Fluids, Vol. 20, 2008.

R. Gupta, J. Yos, and R. Thompson, NASA Technical Memorandum 101528, 1989.

Page 23: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Prior Distributions for the Parameters - Continued

• The constant which is used as the value for ZR and the constant C1 in the equation for ZV both are given priors which extend over a two-order of magnitude range, and thus we actually check sensitivity to log10ZR and log10C1. Nominal values for C1 are from Bird (1994) and the nominal values for ZR are based on our own intuition.

• The ratio of real to simulated particles is given a prior which extends over a one order of magnitude range, and we actually check sensitivity to log10(Ratio of Real to Simulated Particles). The nominal value for this numerical parameter is based on our own observations.

G. A. Bird, Molecular Gas Dynamics and the Direct Simulation of Gas Flows, Oxford Univ. Press. Oxford, 1994.

Page 24: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Results: Nominal Parameter Values

Time (s)

Density(kg/m

3)

0 1E-06 2E-06 3E-06 4E-060.0000

0.0005

0.0010

0.0015

0.0020

0.0025

0.0030

0.0035

0.0040

N2

NO2

ONO

Page 25: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Quantity of Interest (QoI)

J. Grinstead, M. Wilder, J. Olejniczak, D. Bogdanoff, G. Allen, and K. Danf, AIAA Paper 2008-1244, 2008.

X

QoI

We cannot yet simulate NASA EAST or other shock tube results, so we must choose a temporary, surrogate QoI.

?

Page 26: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

{𝑸𝒐𝑰 }={𝑸𝒐𝑰𝟏𝑸𝒐𝑰𝟐𝑸𝒐𝑰𝟑

⋮𝑸𝒐𝑰𝒏

}

Sensitivity Analysis - Scalar vs. Vector QoI

We choose the density of NO as our QoI for this sensitivity analysis. This QoI is a vector, with values at discrete points in time during the course of the relaxation.

Time (s)

NO(kg/m

3)

0 2E-06 4E-060.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04For the sensitivity analysis, each bluedot represents a single, scalar QoI.

Page 27: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

0-D Relaxation Sensitivity Analysis: Sampling the Parameter Space

• Simulations were run for a total of 20,000 sample points in parameter space

• This set of 20,000 runs of the DSMC code required a total of ~100,000 CPU hours.

Page 28: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Time (s)

r2

MutualInform

ation

0 1E-06 2E-06 3E-06 4E-060

0.1

0.2

0.3

0.4

0.5

0.6

0

0.05

0.1

0.15

0.2

0.25

0.3

0.35

0.4

0.45

N2 + N <--> 3NO2 + O <--> 3ONO + N <--> 2N + ONO + O <--> N + 2ON2 + O <--> NO + NNO + O <--> O2 + N

Solid Lines for r2, Dashed Linesfor Mutual Information

log10(N2 + N <--> 3N)

NO(kg/m

3),atTime=2E-6s

-8 -7.5 -7 -6.50.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

3.5E-04

4.0E-04

4.5E-04

r2 = 0.0362MI = 0.0814

Sensitivities vs. Time

log10(N2 + O <--> NO + N)

NO(kg/m

3),atTime=1E-6s

-16.5 -16 -15.5 -150.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

3.5E-04

4.0E-04

4.5E-04

5.0E-04

5.5E-04

6.0E-04r2 = 0.0226MI = 0.1123

Page 29: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Need for Variance-Weighted Sensitivities

log10(NO + N <--> 2N + O)

NO(kg/m

3),atTime=4E-6s

-8.5 -8 -7.5 -70.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

3.5E-04

4.0E-04

4.5E-04

5.0E-04

5.5E-04

6.0E-04

r2 = 0.2260MI = 0.1603

log10(NO + N <--> 2N + O)

NO(kg/m

3),atTime=1E-6s

-8.5 -8 -7.5 -70.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

3.5E-04

4.0E-04

4.5E-04

5.0E-04

5.5E-04

6.0E-04

r2 = 0.1983MI = 0.1311

Page 30: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Variance-Weighted Sensitivities vs. Time

Time (s)

Variance-W

eightedSensitivities

Varianceof N

O

0 1E-06 2E-06 3E-06 4E-060

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

0.0E+00

5.0E-09

1.0E-08

1.5E-08

2.0E-08

2.5E-08N2 + N <--> 3NO2 + O <--> 3ONO + N <--> 2N + ONO + O <--> N + 2ON2 + O <--> NO + NNO + O <--> O2 + NVariance of NO

Solid Lines for r2, Dashed Linesfor Mutual Information

Page 31: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Overall Sensitivities

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39

Ove

rall

Sens

itivi

ty (N

orm

aliz

ed)

Parameter #

r^2 (QoI_2)

MI (QoI_2)

N2

+ N

<--

> 3N

r2

Mutual InformationN

O+

N <

-->

2N +

O

NO

+ O

<--

> N

+ 2

O

N2

+ O

<--

> N

O +

N

NO

+ O

<--

> O

2+

N

O2

+ O

<--

> 3O

ZR (N2) ZV (N2)

𝑶𝒗𝒆𝒓𝒂𝒍𝒍𝑺𝒆𝒏𝒔𝒊𝒕𝒊𝒗𝒊𝒕𝒚 (𝒃𝒂𝒔𝒆𝒅𝒐𝒏𝒓𝟐)=∫𝒕

𝒗𝒂𝒓𝑸𝒐𝑰 (𝒕 )𝒓 𝟐 (𝒕 )𝒅𝒕

𝑶𝒗𝒆𝒓𝒂𝒍𝒍𝑺𝒆𝒏𝒔𝒊𝒕𝒊𝒗𝒊𝒕𝒚 (𝒃𝒂𝒔𝒆𝒅𝒐𝒏𝑴𝑰 )=∫𝒕

𝒗𝒂𝒓𝑸𝒐𝑰 (𝒕 )𝑴𝑰 (𝒕 )𝒅𝒕

Page 32: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Scenario: 1-D Shock

• Shock speed is ~8000 m/s, M∞ ≈ 23.• Upstream number density = 3.22×1021 #/m3.• Upstream composition by volume: 79% N2, 21% O2.• Upstream temperature = 300 K.

Page 33: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

1D Shock Simulation

X

Pressure

StreamwiseVelocity

InletBoundary

SpecularWall

Simulation is initialized with a bulk velocitydirected towards the specular wall at the rightboundary of the domain, with pre-shock density,temperature, and chemical composition.

Vbulk

X

Pressure

StreamwiseVelocity

InletBoundary

SpecularWall

ShockPropagatesUpstream

X

Pressure

StreamwiseVelocity

InletBoundary

SpecularWall

The shock is allowedto move a reasonabledistance away from thewall before any form ofsampling begins.

X

Upstream PressureSampling Region

InletBoundary

SpecularWallPressure

Downstream Pressure Sampling Region

X0.0

0.5

1.0

1.5 Normalized PressureBoxcar Averaged Normalized Pressure

InletBoundary

SpecularWall

Shock Position

X0.0

0.5

1.0

1.5Boxcar Averaged Normalized Pressure (Time = t)Boxcar Averaged Normalized Pressure (Time = t + t)

InletBoundary

SpecularWall

Shock Position(time = t)

Shock Position(time = t + t)

sShock PropagationSpeed = VP = s/t

X0.0

0.5

1.0

1.5 Boxcar Averaged Normalized Pressure (Time = t + t)

InletBoundary

SpecularWall

Shock Position(time = t + t)

Shock SamplingRegion

VSampling Region = VP

• We require the ability to simulate a 1-D shock without knowing the post-shock conditions a priori.• To this end, we simulate an unsteady 1-D shock, and make use of a sampling region which moves with the shock.

Page 34: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Parameters, Prior Distributions, and QoI for the 1-D Shock Sensitivity Analysis

• Based on the results of the 0-D relaxation sensitivity analysis, we choose to check sensitivities for only the 17 reaction rate parameters.

• The prior distributions for those 17 parameters in the 1-D shock sensitivity analysis are the same as the prior distributions which were used previously for the 0-D relaxation sensitivity analysis.

• We once again choose the NO density profile as our vector QoI in this sensitivity analysis.

Page 35: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

1-D Shock Sensitivity Analysis: Sampling the Parameter Space

• Simulations were run for a total of 5,600 sample points in parameter space

• This set of 5600 runs of the DSMC code took over 112 hours on 4096 processors (each individual DSMC simulation was performed on 128 processors, and the runs were done simultaneously in multiple sets), for a total of ~450,000 CPU hours. (Remember that for the 0-D relaxation sensitivity analysis it took ~100,000 CPU hours to do 20,000 simulations).

Page 36: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Results: Nominal Parameter Values

X (m)

Density(kg/m

3 )

-0.05 0 0.05 0.1 0.15 0.20.0000

0.0005

0.0010

0.0015

0.0020

0.0025

0.0030 BulkN2NO2ONO

Bulk

O2, NO

N

O

N2

X (m)

Density(kg/m

3)

-0.05 0 0.05 0.1 0.15 0.20.0E+00

2.0E-05

4.0E-05

6.0E-05

8.0E-05O2NO

NO

O2

Page 37: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Overall Sensitivities

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

1

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17

Ove

rall

Sens

itivi

ty (N

orm

aliz

ed)

Parameter #

r^2 (QoI_2)

MI (QoI_2)

N2 + N <--> 3N

r2

Mutual Information

NO + N <--> 2N + O

NO + O <--> N + 2O

N2 + O <--> NO + N

NO + O <--> O2 + N

O2 + O <--> 3O

𝑶𝒗𝒆𝒓𝒂𝒍𝒍𝑺𝒆𝒏𝒔𝒊𝒕𝒊𝒗𝒊𝒕𝒚 (𝒃𝒂𝒔𝒆𝒅𝒐𝒏𝒓𝟐)=∫𝒙

𝒗𝒂𝒓𝑸𝒐𝑰 (𝒙 )𝒓𝟐 (𝒙 )𝒅𝒙

𝑶𝒗𝒆𝒓𝒂𝒍𝒍𝑺𝒆𝒏𝒔𝒊𝒕𝒊𝒗𝒊𝒕𝒚 (𝒃𝒂𝒔𝒆𝒅𝒐𝒏𝑴𝑰 )=∫𝒙

𝒗𝒂𝒓𝑸𝒐𝑰 (𝒙 ) 𝑴𝑰 (𝒙 )𝒅𝒙

Page 38: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Synthetic Data Calibrations

• During the calibration process simulations must be run in sequence, and this makes calibrations for the 1-D shock very time consuming. For this reason, the 0-D relaxation scenario was used for the synthetic data calibrations.

• The purpose of a synthetic data calibration is not to provide information about the parameters. The goal is to demonstrate that the inverse problem is solvable, meaning that we can meaningfully calibrate a set of parameters based on a set or sets of data.

Page 39: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Time (s)

NO(kg/m

3)

0.0E+00 5.0E-07 1.0E-06 1.5E-06 2.0E-060.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

Synthetic Data

Synthetic Data - Example

• We use the ρNO vs. time profile as our synthetic data.

Page 40: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Time (s)

NO(kg/m

3)

0.0E+00 5.0E-07 1.0E-06 1.5E-06 2.0E-060.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

Synthetic Data

Time (s)

NO(kg/m

3)

0.0E+00 5.0E-07 1.0E-06 1.5E-06 2.0E-06

0.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

Synthetic Data2 Error Bars

𝒍𝒊𝒌𝒆𝒍𝒊𝒉𝒐𝒐𝒅=𝑷 (𝑫|𝜽 )= 𝟏

(𝟐𝝅𝝈𝟐)𝑵 𝒅

𝟐

𝐞𝐱𝐩[− 𝟏𝟐𝝈𝟐∑

𝒊=𝟏

𝑵 𝒅

(𝝆𝑵𝑶 ,𝒅𝒂𝒕𝒂, 𝒊− 𝝆𝑵𝑶 , 𝒔𝒊𝒎𝒖𝒍𝒂𝒕𝒊𝒐𝒏 , 𝒊)𝟐]

Time (s)

NO(kg/m

3)

0.0E+00 5.0E-07 1.0E-06 1.5E-06 2.0E-06

0.0E+00

5.0E-05

1.0E-04

1.5E-04

2.0E-04

2.5E-04

3.0E-04

Synthetic Data2 Error BarsCandidate Results

Likelihood Equation

Page 41: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

MCMC Overview

• Markov Chain Monte Carlo (MCMC) is a method which solves the statistical inverse problem in order to calibrate parameters with respect to a set of data.• The likelihood of a given set of parameters is calculated based on the mismatch between the data and the simulation results for that set of parameters.• One or more chains explore the parameter space, moving towards regions of higher likelihood.• Candidate positions are drawn from a multi-dimensional Gaussian proposal distribution centered at the current chain position. The covariance matrix of this Gaussian controls the average distance (in parameter space) that the chain moves in one step.

Page 42: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

MCMC Flowchart: Metropolis-Hastings

Page 43: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Delayed Rejection Adaptive Metropolis

We use the PECOS-developed code QUESO, which implements two major additions to the basic Metropolis-Hastings algorithm. Both of these features can help improve the convergence of the method.• Delayed Rejection:

When an initial candidate position is rejected, a second candidate position is generated based on a scaled proposal covariance matrix.

• Adaptive Metropolis: At periodic intervals, the proposal covariance matrix

is updated based on the calculated covariance of the previously accepted chain positions.

H. Haario, M. Laine, A. Mira, E. Saksman, Statistics and Computing, 16, 339-354 (2006).

Page 44: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Two Parameter Calibration: Chain Progression

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

CurrentPosition

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

CurrentPosition

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

CurrentPosition

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

CurrentPosition

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

CurrentPosition

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

CurrentPosition

log10(N2 + O <--> NO + N)

log10(

O2+N<-->NO+O)

-16.5 -16 -15.5 -15

-18.5

-18

-17.5

-17

StartingPosition

Parameter values usedto generate synthetic data

Page 45: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Two Parameter Calibration: Post-Calibration PDFs

log10(N2 + O <--> NO + N), log10(O2 + N <--> NO + O)

Norm

alizedPost-CalibrationPDF

-18.5 -18 -17.5 -17 -16.5 -16 -15.5 -150

0.2

0.4

0.6

0.8

1

N2 + O <--> NOO2 + N <--> NO + O

NominalParameterValues

N2 + O <--> NO + NO2 + N <--> NO + O

Page 46: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Six Parameter Calibration

We would like to calibrate the six parameters we identified based on the results of the sensitivity analyses. These six parameters are the pre-exponential constants in the Arrhenius rate equations for the following reactions:

N2 + N 3N⇄O2 + O 3O⇄NO + N 2N + O⇄NO + O N + 2O⇄N2 + O NO + N⇄NO + O O⇄ 2 + N

Page 47: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Six Parameter Calibration

We have found that we cannot properly calibrate all six of these parameters if we use only a single 0-D relaxation scenario and a density profile as our dataset.

In order to calibrate successfully, we include a second 0-D relaxation scenario, with an initial translational temperate of 30,000 K (instead of ~50,000 K for the original scenario). We use three sets of synthetic data from each of the two scenarios, namely the density vs. time profiles for N, O, and NO.

𝒍𝒊𝒌𝒆𝒍𝒊𝒉𝒐𝒐𝒅𝒐𝒗𝒆𝒓𝒂𝒍𝒍= ∏𝒊=𝟏

𝑵 𝒅𝒂𝒕𝒂𝒔𝒆𝒕𝒔

𝒍𝒊𝒌𝒆𝒍𝒊𝒉𝒐𝒐𝒅𝒊𝒕𝒉 𝒅𝒂𝒕𝒂𝒔𝒆𝒕

𝒍𝒊𝒌𝒆𝒍𝒊𝒉𝒐𝒐𝒅=𝑷 (𝑫|𝜽 )= 𝟏

(𝟐𝝅𝝈𝟐)𝑵 𝒅

𝟐

𝐞𝐱𝐩[− 𝟏𝟐𝝈𝟐∑

𝒊=𝟏

𝑵 𝒅

(𝝆𝒅𝒂𝒕𝒂, 𝒊− 𝝆𝒔𝒊𝒎𝒖𝒍𝒂𝒕𝒊𝒐𝒏 ,𝒊)𝟐]

Page 48: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Six Parameter Calibration: Chains

Thirty-two 8,000 position long chains were used in the six parameter calibration, each with a random starting position in parameter space. Both delayed rejection and adaptation of the proposal covariance matrix were used to improve the convergence of the chains. The first 4,000 chain positions were discarded as a burn-in when calculating the posterior PDFs for the parameters.

Running the simulations for this calibration required four 16-hour, 4096 processor runs, for a total of more than 250,000 CPU hours.

Page 49: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Six Parameter Calibration: Posterior PDFs

log10 - log10nom

PosteriorPDF

-1 -0.5 0 0.5 10

5

10

15

20

25

30N2 + N <--> 3NO2 + O <--> 3ONO + N <--> 2N + ONO + O <--> N + 2ON2 + O <--> NO + NNO + O <--> O2 + N

log10 - log10nom

PosteriorPDF

-0.05 0 0.050

5

10

15

20

25

30N2 + N <--> 3NO2 + O <--> 3ONO + N <--> 2N + ONO + O <--> N + 2ON2 + O <--> NO + NNO + O <--> O2 + N

Page 50: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Six Parameter Calibration: False Peaks

Page 51: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Conclusions

• We can use a moving sample region to obtain a steady 1D shock profile from the simulation of an unsteady 1D shock. This technique does not require a priori knowledge of the post-shock conditions.• Global, Monte Carlo based sensitivity analyses can provide a great deal of insight into how various parameters affect a given QoI.• A good deal of computer power is required to perform this type of statistical analysis for DSMC shock simulations.

20,000 relaxations and 5,600 shocks were run for the sensitivity analyses presented here, which required a total of ~550,000 CPU hours.

Page 52: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

More Conclusions

• MCMC can be used to calibrate DSMC parameters based on synthetic data for a 0-D relaxation.• It can be very effective to employ multiple types of data from multiple scenarios when calibrating parameters.• We can use the likelihoods calculated for the set of candidate positions for a chain in order to determine whether a secondary peak in the posterior PDF for a given parameter is real or whether it is a numerical artifact due to finite length chains.• Calibrating DSMC parameters is computationally expensive, with the six parameter calibration presented here requiring 250,000 CPU hours even for the 0-D relaxation scenario.

Page 53: Statistical Methods for the Analysis of DSMC Simulations of Hypersonic Shocks James S. Strand The University of Texas at Austin Funding and Computational

Potential Future Work

• Synthetic data calibrations for a 1-D shock with the current code.• Upgrade the code to allow modeling of ionization and electronic excitation.• Couple the code with a radiation solver.• Sensitivity analysis for a 1-D shock with the additional physics included.• Synthetic data calibrations with the upgraded code.• Calibrations with real data from EAST or similar facility.