leibniz supercomputing centre

1

Leibniz Supercomputing Centre18. October – 29. November 2021 | Dr.-Ing. habil. Th. Frank

LRZ Short Course – HCFD1w21“ANSYS CFX Software on LRZ HPC Systems”

ANSYS CFX on LRZ HPC Systems | WS 2021 | Dr. Th. Frank Day 1 | Lecture 01 |

2ANSYS CFX on LRZ HPC Systems | WS 2021 | Dr. Th. Frank

Lecture 1 : Course Introduction

Day 1 | Lecture 01 |

Lecturer : Dr.-Ing. habil. Thomas Frank – LRZ PhD and Lecturer Qualification (Habilitation) in Fluid Mechanics 35+ years of professional experience in fluid mechanics, CFD and HPC

Special fields of experience: turbulence, Eulerian & Lagrangian multiphase flow modeling 100+ technical publications, conference papers & presentations 15 years @ ANSYS Germany in ANSYS CFD Development @ LRZ since 2018

3

Lecturer / LRZ Staff IntroductionANSYS CFD on LRZ HPC Systems - Introduction


Duration of the Course:6 days with 2×2 hours lectures + offline practical workshopsregularly on Mondays, 10:00 - 12:00 am

& 2:00 - 4:00 pm

Target Auditorium:The course is intended for all new or occasional ANSYS CFD users.

• Fluid Mechanics ≥ Finished Master level• ANSYS CFX – Beginner level• Linux OS – Basic knowledge• HPC – Basic knowledge

6

Welcome - Course AgendaANSYS CFD on LRZ HPC Systems - Introduction


• This LRZ Course on “ANSYS CFD on LRZ HPC”is thankfully supported by CADFEM GmbH, Grafing

• The preparation of the LRZ course material was kindlysupported by ANSYS Germany, Otterfing & ANSYS Inc.

▫ Dr. Holger Grothjans▫ Dr. Andre Braune▫ Wim Slagter▫ Krishna Zore & Patrick Sharkey

7

3rd Party SupportANSYS CFD on LRZ HPC Systems - Introduction


What you will learn in this course in the next 6 lecture days?• CFD Workflows and Recommended Best Practices• Introduction to ANSYS CFX• Intro to basic CFD workflows and program interfaces:

General understanding of the CFD process: CFD Setup ⇒ CFD Solver ⇒ Postprocessing

Steady state vs. transient flows Physics modeling : BC‘s, initialization, turbulence, heat transfer Convergence control & solver monitoring, assuring results accuracy, BPG’s

• Basic Linux OS „survival guide“• HPC

Intro to LRZ HPC Systems Executing CFD in LRZ batch queuing system SLURM Advanced topics: CFD automation using Python, remote visualization

8

Course AgendaANSYS CFD on LRZ HPC Systems - Introduction


What you will NOT learn in this course in the next 5 days?

• Geometry Modeling (CAD, SpaceClaim, DesignModeler)• Meshing (ICEM/CFD, ANSYS Meshing, Fluent Meshing,…)• ANSYS Workbench• ANSYS Discovery Product Line (AIM, Discovery Live)• Advanced physics modeling

(turbomachinery, multiphase, chem. reactions & combustion, radiation, moving/deforming mesh, FSI, etc.)

• Advanced CFD solver customization (User FORTRAN)• Advanced Linux shell scripting or programming

9

Course AgendaANSYS CFD on LRZ HPC Systems - Introduction


There is an intranet page for this course available:https://doku.lrz.de/display/PUBLIC/Introduction+to+ANSYS+CFX

Once registered, you might want to locate all support material, the PDF’s of the lectures and interactive workshops from this CFD & HPC course on LRZ Sync & Share:

https://syncandshare.lrz.de/getlink/fi2Wcr5FReeKtc5cW8ZMEiDu/Access via distributed Sync & Share link.

On Linux Cluster the course material (tutorial input files, solutions) can be found in the LRZ Linux Cluster file system path:

/lrz/sys/courses/HCFD1w21

Feel free to make a download and copy of the material.Please be aware, that the overall course material including the solutions is approx. 17 Gb.

10

Lecture Material on LRZ Sync & Share and on Linux File System ANSYS CFD on LRZ HPC Systems - Introduction


https://doku.lrz.de/display/PUBLIC/Introduction+to+ANSYS+CFX

https://syncandshare.lrz.de/getlink/fi2Wcr5FReeKtc5cW8ZMEiDu/

Online lecture courses by video conference:Zoom Link:

Link to LRZ Zoom Video ConferencePasscode: 881664

Please submit your help requests to the LRZ Service Desk:https://servicedesk.lrz.de/en

Please clearly tag your help request in the subject with:Subject: “HCFD1w21: <…my help request topic…>”

In case of “emergency” you can contact the course organizer via email:[email protected]

11

Lecture Material – Communication / How to get help?ANSYS CFD on LRZ HPC Systems - Introduction


https://lrz-de.zoom.us/j/93638331391?pwd=QUE0UVYzdGFVUzBBbUR3VmJQVitrUT09

https://servicedesk.lrz.de/en

Important Notice:

All provided course material is subject to copyright by LRZ and Dr. Thomas Frank.

Distribution to any person not participating in this LRZ CFD course without prior written agreement from LRZ / the lecturer is not permitted.

Any kind of recording of the online lectures and any kind of further distribution / dissemination of any material from this LRZ CFD course in other online or social media is not permitted.

12

Lecture Material – Copyright NoticeANSYS CFD on LRZ HPC Systems - Introduction


Day 1 – ANSYS CFX Core ModulesANSYS CFD on LRZ HPC Systems - Introduction

ANSYS CFX on LRZ HPC Systems | WS 2021 | Dr. Th. Frank 13Day 1 | Lecture 01 |

Time Topic SlidesMonday, 18. October 2021Morning Session:

10:00 – 12:00 Course Introduction - Why do we need supercomputers for CFD? 48 (+11)

Afternoon Session:14:00 – 16:00 Introduction to ANSYS Tools / Overview of the CFD & ANSYS CFX Workflow 48

Introduction to Workshop 0: Basic software installation & testing 36

Tutorial („Homework“):until next week: Workshop 0: Basic software installation & testing on your own local computer

ANSYS 2021.R2, Cisco VPN Anyconnect, MobaXTerm, WinSCP, Notepad++,…

Day 2 – ANSYS CFX Core ModulesANSYS CFD on LRZ HPC Systems - Introduction


Time Topic SlidesMonday, 25. October 2021Morning Session:

10:00 – 12:00 Task Solutions and Q&A from Homework 5Introduction to Workshop 1 : Flow through a Pipe T-Junction 74Afternoon Session:

14:00 – 16:00 ANSYS CFX: Domains, Boundary Conditions & Sources 29ANSYS CFX Solver Settings & the Output File 44

Tutorial („Homework“):until next week: Workshop 1: Flow through a Pipe T-Junction – ANSYS CFX

…to be executed and run on your local computer

Day 3 – Introduction to LRZ HPC Systems, Linux, CFX in SLURM,…ANSYS CFD on LRZ HPC Systems - Introduction


Time Topic SlidesMonday, 08. November 2021 (1st November – German Bank Holiday)Morning Session:

10:00 – 12:00 …to be announced

Afternoon Session:14:00 – 16:00 …to be announced

Tutorial („Homework“):until next week: …to be announced

Please fill out the following questionnaire towards the end of this course:

<…Internet Adress of the Survey Webpage to be announced…>

16

LRZ Questionnaire for this Course HCFD1w21 ANSYS CFD on LRZ HPC Systems - Introduction


This course on ANSYS CFD is held @ LRZ & JSC for the 5th time. This course takes place for the 2nd time as a 100% Online Course.

Also all course material has been prepared with great care, potentially some minor issues, typo’s, errors might be still contained in the provided handouts.

▫ Please report those issues to the LRZ lecturers for future correction and continuous improvementof this LRZ (Online) short course.

▫ Course material has been prepared for ANSYS 2020.R1 and ANSYS 2021.R2. Other ANSYS software versions might show some minor differences. Some flexibility regarding GUI changes in the ANSYS software is required.

The timing of the online lectures and interactive workshops could not have been tested to full extend. The experience of this course will help us in future adjustments and improvements. Please provide us with your feedback!

If you have any suggestions for course improvement, please talk to the LRZ staff or submit your comments in the course feedback form.

17

Introductory Remarks about this CFD CourseANSYS CFD on LRZ HPC Systems - Introduction

ANSYS CFX on LRZ HPC Systems | WS 2021 | Dr. Th. Frank

• Course Announcements: https://app1.edoobox.com/en/LRZ/

• LRZ Documentation for ANSYS Software: https://doku.lrz.de/display/PUBLIC/ANSYS+on+HPC+Systems

• ANSYS Mailing List @ LRZ – please register! https://lists.lrz.de/mailman/listinfo/ansys

• LRZ Service Desk: https://servicedesk.lrz.de/en HPC / Supercomputing Technical & Scientific Software

• ANSYS Customer Portal and ANSYS Help System: https://support.ansys.com/AnsysCustomerPortal/en_us - requires User Login https://ansyshelp.ansys.com/ - requires Customer Portal User Login

• Support by CADFEM GmbH: http://www.cadfem.de , Phone: +49 8092-7005-55 , [email protected]

18

Links to Information ResourcesANSYS CFD on LRZ HPC Systems - Introduction


https://app1.edoobox.com/en/LRZ/

https://doku.lrz.de/display/PUBLIC/ANSYS+on+HPC+Systems

https://lists.lrz.de/mailman/listinfo/ansys

https://servicedesk.lrz.de/en

https://support.ansys.com/AnsysCustomerPortal/en_us

https://ansyshelp.ansys.com/

http://www.cadfem.de/

mailto:[email protected]

• Dr. Thomas Frank (LRZ)• Nisarg Patel (LRZ)• Dr. Martin Ohlerich (LRZ)• Dr. Ferdinand Jamitzky (LRZ)

19

Authors & Contributors to this CFD CourseANSYS CFD on LRZ HPC Systems - Introduction


• ANSYS Course: “Introduction to ANSYS CFX 18.0”Link to ANSYS Customer Portal – Tutorials and Training Materials – Material removed by ANSYS

• ANSYS Course: “Introduction to ANSYS Fluent 18.0”Link to ANSYS Customer Portal – Tutorials and Training Materials – Material removed by ANSYS

• ERCOFTAC Best Practice Guidelines, Special Interest Group “Quality and Trust in Industrial CFD”, ISBN 978-0-9955779-2-3, January 2000.https://www.ercoftac.org/publications/ercoftac_best_practice_guidelines/single-phase_flows_spf/

• ASME Standard for Verification and Validation in Computational Fluid Dynamics and Heat Transfer, ASME V&V 20 (2009)

• LRZ Course “Introduction to the LRZ Supercomputing & Machine Learning Infrastructure”, October 2018 by J. Albert-von der Gönna, F. Jamitzky, M. Ohlerich, S. Rössle-Blank (all LRZ)

20

ReferencesANSYS CFD on LRZ HPC Systems - Introduction


https://www.ercoftac.org/publications/ercoftac_best_practice_guidelines/single-phase_flows_spf/

https://www.asme.org/products/codes-standards/v-v-20-2009-standard-verification-validation

• Ch. Cornelius, Th. Biesinger, P. Galpin, A. Braune: “Experimental and Computational Analysis of a Multistage Axial Compressor Including Stall Prediction by Steady and Transient CFD Methods”, Proceedings of ASME Turbo Expo 2013, Paper No. GT2013-94639, June 3-7, 2013, San Antonio, Texas, USA

• Ch. Cornelius, Th. Biesinger, L. Zori, R. Campregher, P. Galpin, A. Braune: “Efficient Time Resolved Multistage CFD Analysis Applied to Axial Compressors”, Proceedings of ASME Turbo Expo 2014, Paper No. GT2014-26846, June 15-20, 2014, Düsseldorf, Germany

• T. Krappel, S. Riedelbauch, R. Jester-Zuerker, A. Jung, B. Flurl, F. Unger, P. Galpin: “Turbulence resolving flow simulations of a Francis turbine in part load using highly parallel CFD simulations”, 28th IAHR Symposium on Hydraulic Machines and Systems, Grenoble (2016), Switzerland

• K. Zore, S. Shah, J. Stokes, B. Sananapuri, P. Sharkey: „ANSYS CFD Study for High-Lift Aircraft Configurations“, 2018 AIAA Aviation Conf., APA-03, Special Session: High Lift Prediction using CFD, 25. June 2018, Antlanta, Georgia, USA

• Th. Frank, B. Gerlicher, J. Abanto : "DrivAer - Aerodynamic Investigations for a New Realistic Generic Car Model using ANSYS CFD“, ASWC 2013 - Automotive Simulation World Congress, 29.-30. October 2013, Frankfurt am Main, Germany

• J.-A. Nöpel, Th. Frank: “Forced and Natural Convection CHT for a Heated Cylinder in Crossflow”, V&V Investigation for ANSYS CFX, ANSYS Fluent and AIM Fluids R16.0, ANSYS Germany, Otterfing, March 2015, pp. 93.

21

References (cont.)ANSYS CFD on LRZ HPC Systems - Introduction


https://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=2ahUKEwic6KLhxYreAhWOzKQKHdeIAvsQFjABegQIBxAC&url=https://hiliftpw.larc.nasa.gov/Workshop3/ParticipantTalks/Aviation2018/Slides-AIAA-2018-2844-Zore.pdf&usg=AOvVaw2RQXId1nmJLcOeJbKqKrbR

http://www.drthfrank.de/publications/2013/131030_ASWC_Frank_et_al_DrivAer_Car_Simulation.pdf

• Th. Frank, et.al.: “AIM Fluids Solver 18.0 – Verification & Validation Summary”, Cumulative Summary of Investigated V&V Testcases for the Validation of ANSYS CFD Solvers, ANSYS Germany, Otterfing, February 2017, pp. 1-364.

• Th. Frank: “List of ANSYS CFD Solver Verification and Validation Test Cases”, ANSYS Germany, Otterfing, December 2017, pp. 1-40.

• F. Menter: “Best Practice: Scale-Resolving Simulations in ANSYS CFD”, Best Practice Guidelines Report, Vers. 2.0, ANSYS Germany, Otterfing, November 2015, pp. 1-75.

• F. Menter, R. Lechner, A. Matyushenko: “Best Practice Guidelines for the Generalized k-ω (GEKO) Two-Equation Turbulence Model in ANSYS CFD”, Technical Report, Vers. 1.0, ANSYS Germany, Otterfing, December 2018, pp. 1-38.

• F. Menter: “GEKO – A new Paradigm in Turbulence Modeling”, ANSYS Whitepaper, ANSYS Inc., Canonsburg, USA, January 2019, pp. 1-8.

22

References (cont.)ANSYS CFD on LRZ HPC Systems - Introduction



Lecture 1 : Questionnaire


Please categorize your future intended use of CFD• What is your field of application?

24

QuestionnairANSYS CFD on LRZ HPC Systems - Introduction


CFD Physics Modeling & Simulation

Turbulence (LES, DNS)

Turbulence - (U)RANS Acoustics Turbo-

machinery Multiphase Combustion FSI Multiphysics …other

What operating systems you are familiar with?

Operating System

Windows Linux Other Unix Mac OS Other

I do not know what an OS

is?

Please categorize your future intended use of CFD• What is the largest mesh resolution you are heading for?

• Is your simulation: Steady-state Transient Coupled with other physics, e.g. FSI, aero-acoustics, neutron kinetics, system simulation, etc. ?

25



Mesh Resolution

< 1. Mill. Cells

< 5 Mill. Cells

< 20 Mill. Cells

< 50 Mill. Cells

< 100 Mill. Cells

… even larger

Which other CFD packages have you used / are you using / do you intend to use?

26



CFD Software

Siemens PLM (Star) CCM+ Comsol AVL Fire EXA

PowerFlow NUMECA MSC SoftwareSC/Tetra ∇ OpenFoam

Self-programmedR&D Code

…other


Lecture 1 : Introduction to ANSYS Inc.


Company Product(s)Siemens PLM Software SimCenter, Star CCM+, NX,

(LMS SysNoise, AmeSIM),…

Dassault Systems EXA Powerflow, Catia, Solidworks,…

Hexagon AB (MSC Software)

SC Tetra, Adams, Marc, Patran, Nastran,…

Numeca Fine/Turbo, Fine/Marine, Fine/Acoustics

Comsol Comsol Multiphysics

ESI Group ACE+ Suite, Visual-CFD (based on OpenFoam)

OpenFoam (Open Source) OpenFoam

ANSYS is one the Engineering Simulation LeadersANSYS CFD on LRZ HPC Systems – ANSYS Introduction

Focus• Leading product technologies in many

physics areas• Large development team focused on

engineering simulation (CSM, CFD, EMAG)• …but: became more and more diverse due

to manifold acquisitions over past years

Presence3,500+

75

40

employees

locations

countries

Trusted• 96 out of the top 100 FORTUNE 500

Industrials apply ANSYS software• ISO 9001 and NQA-1 certified• Long term V&V efforts to ensure the

accuracy of the software

Largest3x The size of nearest

competitor(depending on definition)

Main Competitors:


30

History of ANSYS Acquisitions (1960 – 2010)ANSYS CFD on LRZ HPC Systems – ANSYS Introduction


1960 1970 1980 1990 2000 2010

Swanson Analysis SystemsANSYS

Compuflow(Flotran)

ICEM/CFD

CFX (AEA Technology)

ASC – Advanced Scientific ComputingTascFlow

Creare, Inc.Fluent, Inc.

ANSOFT Technologies (HFSS, Maxwell)

ANSYS Inc.

Harvard Thermal, Inc.

Century Dynamics (AutoDyn)

31

History of ANSYS Acquisitions (2010 - present)ANSYS CFD on LRZ HPC Systems – ANSYS Introduction


ANSYS Inc.

Esterel(Scade, Apache)

SpaceClaim Corp.

Computational Engineering International, Inc. (CEI - Ensight)

Reaction Design (FORTE, Chemkin)

Newmerical Techn. Int.(Fensap-ICE)

OPTIS

3DSIM

KPIT medini Technologies AG

Helic, Granta Design

LSTC - Livermore Software Technology Corporation (LS-Dyna)

2010 2020 2030 …

Dynardo(OptiSlang)

Lumerical

Phoenix Integration (ModelCenter)

Analytical Graphics(AGI)

DfR Solutions

Zemax LLCoptical

imaging

32

Breadth of ANSYS TechnologiesANSYS CFD on LRZ HPC Systems – ANSYS Introduction


Structural Mechanics:From Linear Statics

Fluid Mechanics: From Single-Phase Flows

Electromagnetics: From Low-Frequency Windings

Systems:From Data Sharing

To High-Speed Impact

To Multiphase Combustion

To High-Frequency Field Analysis

To Multi-Domain System Analysis


ANSYS Information Resources:WWW: www.ansys.com

ANSYS Customer Portal: https://support.ansys.com/AnsysCustomerPortal/en_usANSYS Help (Tutorials): https://ansyshelp.ansys.com/ANSYS Learning Hub Subscription: https://www.ansys.com/de-de/services/learning-hub

(1000,- € per calendar year for academic users)

ANSYS Resource Library: https://www.ansys.com/Resource-Library

ANSYS YouTube Channel (How To’s): https://www.youtube.com/user/ANSYSHowToVideos

ANSYS on LinkedIn: https://www.linkedin.com/company/ansys-inc/?originalSubdomain=de

33

Important Information Resources - ANSYSANSYS CFD on LRZ HPC Systems – ANSYS Introduction


http://www.ansys.com/

https://support.ansys.com/AnsysCustomerPortal/en_us

https://ansyshelp.ansys.com/

https://www.ansys.com/de-de/services/learning-hub

https://www.ansys.com/Resource-Library

https://www.youtube.com/user/ANSYSHowToVideos

https://www.linkedin.com/company/ansys-inc/?originalSubdomain=de

CADFEM Information Resources:WWW: www.cadfem.com

CADFEM Customer Support: T +49 (0)8092-7005-55 [email protected]

CADFEM Academic: http://www.cadfem-academic.com/CADFEM Wissen: https://wissen.cadfem.net/de-de/suche/Seiten/events.aspx

Download of free-to-use ANSYS Software, Students Edition:https://www.ansys.com/de-de/academic/free-student-products(limited to 32.000 DOF’s for Mechanical and 512 k cells for CFD)

34

Important Information Resources – CADFEM GmbHANSYS CFD on LRZ HPC Systems – ANSYS Introduction


http://www.cadfem.com/

mailto:[email protected]

http://www.cadfem-academic.com/

https://wissen.cadfem.net/de-de/suche/Seiten/events.aspx

https://www.ansys.com/de-de/academic/free-student-products


Lecture 1 : Why do we need Supercomputers for CFD?


The Siemens 6-Stage Compressor

36

HLRS: Flow through a Francis Turbine

AIAA HLPW: Lift and Drag of CRM & JSM Aerodynamics of the DrivAer Car


Introductory Examples for Supercomputer CFDANSYS CFD on LRZ HPC Systems - Introduction


Area of R&D: Flow through water turbineFrancis turbine (SAS-SST, scale-resolving)Study of vortex rope induced pressure pulsations

Goal of the CFD simulation:• Flow analysis of complete Francis turbine geometry

including spiral casing, stay and guide vanes, runner and draft tube with expansion tank

• Scale-resolving turbulence model simulation4 meshes : 16 Mill. 300 Mill. Mesh hexahedral cells (4 domains with interfaces), up 1000 ∆t / revolution

576 up to 4032 cores on Cray XC40

43

Introductory Examples : Flow through a Francis TurbineANSYS CFD on LRZ HPC Systems - Introduction


Visualization of flow structures with isosurfaces of Q-criterion(colored by eddy viscosity ratio of νt/ν=0,…,100)

44

Introductory Examples : Cavitation in a Francis TurbineANSYS CFD on LRZ HPC Systems - Introduction


Visualization of the Francis runner vortex rope(colored by eddy viscosity ratio of νt/ν=0,…,150)

45



Francis runner vortex rope for four different runner positions (colored by eddy viscosity ratio of νt/ν=0,…,150)

ANSYS CFX Performance:

• 300 Mill. Cells mesh• SAS-SST SRS simulation• Performance improvements for

ANSYS CFX 16.0 ANSYS CFX 17.0• Dashed line indicates simulations with

extensive I/O (data recording)• On HLRS Cray XC40 Hornet with 3944

nodes with Intel Xeon processors with 12 cores and 128 Gb RAM

• Pre-/post on large memory system with 512 Gb RAM

46



T. Krappel, et al.: “Turbulence resolving flow simulations of a Francis turbine in part load using highly parallel CFD simulations”, 28th IAHR Symposium on Hydraulic Machines and Systems, Grenoble (2016)

Area of R&D: aerospace / airplane aerodynamicslift / drag prediction

Goal of the CFD simulation:• Comparison of CFD code performance

in direct code-to-code comparison (benchmark)• Flow analysis of airplane aerodynamics• CD, CL prediction and comparison

to wind tunnel experiments• Dependency of CD, CL over angle of attack (AoA) flight safety

47

AIAA HLPW: Lift and Drag of the CRM & JSM ANSYS CFD on LRZ HPC Systems - Introduction


CRM – Common Research ModelJSM – JAXA high-lift configuration Standard Model

The CFD task of the AIAA Benchmark:• 3 aircraft configurations• 6 meshes : from Coarse / 18 Mill. Cells Extra Fine / 397 Mill. Cells• AoA=4°,…, 22° - 6 different AoA’s• k-ω SST model, γ-Reθ SST-transition model• Turbulence model parameter variations

⇒ at least 36 full aircraft simulations on rather very fine meshes

48



49



ANSYS Fluent, fine mesh, JSM-WBNP, AoA=21.57° - Streamlines & Vorticity

50



Oil flow visualization, ANSYS Fluent, fine mesh, JSM-WBNP, AoA=21.57°

51



JSM-WBNP, fine meshPressure Coeff. plots

AoA = 21.57°

• ANSYS Fluent simulations on up to 2200 cores of a Cray XC40

• For sufficiently large meshes ANSYS Fluent is scaling almost linearly with the number of cores

• Nevertheless the AIAA HLPW is an extreme computational effort

• Time per simulation:~ approx. 2 weeks

• Duration of the project:≥ 6 months

52



Area of R&D: car outer aerodynamicslift / drag predictiondriving performance (e.g. car behavior in cross-winds)

Goal of the CFD simulation:• Flow analysis of outer aerodynamics• CD, CL prediction and comparison to wind tunnel experiments• Revealing potential for car body construction

(e.g. mirror / underbody / exhaust system design)

53

Introductory Examples : Aerodynamics of the DrivAer CarANSYS CFD on LRZ HPC Systems - Introduction


57



Front view of F_D_wM_wW: Lambda-2 criterion level = 0.0005


• 108M AM/FLTG hybrid cells

• SAS turbulence model• Δt=0.2 ms, T=2.6s• U∞=16 m/s

Computational Effort:• Linux cluster: 380 cores• Approx. 2 weeks for

geometry & meshing & CFD setup

• Approx. 2.5 weeks computational time for 1 CFD simulation= 165.000 CPU h

• 1 week postprocessing• Project duration:

6 months

58



• CFD is extremely diverse in terms of: Investigated flows and physics:

▫ Pure fluids & Homogeneous Mixtures▫ Multiphase – Eulerian & Lagrangian modeling▫ Multispecies & combustion / chem. reactions▫ Multiphysics – coupled system simulation (AMESim, GT-Power), FSI, EMAG, neutron kinetics, etc.

Spatial and time resolutionSteady RANS URANS Hybrid SRS LES DNS

• CFD applicable on a broad range of computer systems from PC to Supercomputerdepending on computational demands and degree of simulation fidelity

• Provided a couple of examples, where computation and investigation requires massively parallel resources of todays supercomputers like SuperMUC-NG and Linux Clusters

60

Summary ANSYS CFD on LRZ HPC Systems - Introduction


leibniz supercomputing centre

Documents