easy submitting, intelligent scheduling and monitoring results of finite element jobs with pbs works
TRANSCRIPT
KIRCHHOFF GRUPPE
Easy Submitting, Intelligent Scheduling and Monitoring Results of Finite Element Jobs with PBS Works
Author: Dirk Junglas
Company: KIRCHHOFF Automotive Deutschland GmbH
Am Eckenbach 30
57439 Attendorn
Germany
Phone +492722696554
Abstract
Introduction: PBS Works offers with PBS Professional (a workload management system), Compute Manager and Result Viewer, a smart solution
to submit, monitor and visualize the results of finite element (FE) analysis. With PBS Analytics, also a PBS Works product, it is
possible to analyze the degree of capacity utilization of existing resources. This presentation will show an example how the CAE
Department of the automotive supplier KIRCHHOFF Automotive optimized workloads on its HPC-Cluster, reduced costs for
software and hardware, and increased the productivity of the FE Analyst.
Problem Definition: The FE Department of KIRCHHOFF Automotive supports other company departments with finite element analysis. Since the need
of computing capacity increased rapidly a HPC-Cluster was installed. The FE analysts are located in different offices at different
locations and therefore spend a lot of time to organize their jobs on the cluster and idle times on the cluster couldn’t be used
efficiently.
Problem Solution: PBS Professional enables the FE Analysts to start their jobs with predefined parameters. The system schedules the jobs on the
cluster and gives feedback to the FE Analysts when the job has been finished. At the end of last year PBS Professional was
upgraded with Compute Manager and Result Viewer. Both tools are web based and platform independent and enable the FE
Analysts to submit their jobs, to monitor the state of the job and to visualize the finite element results in a web browser.
22.04.2013 1
KIRCHHOFF GRUPPE
2 22.04.2013
KIRCHHOFF GRUPPE
Products Kirchhoff Automotive
3 22.04.2013
Reinforcement B pillar
Rear axle crossmember
Frame dash panel
Side impact bar
Instrument panel beam
Bracket bumper (front)
KIRCHHOFF GRUPPE
History Kirchhoff Automotive
4 22.04.2013
1894 foundation
first
stamping
plant
Iserlohn
1785 foundation
Witte
needle
company
1984 takeover
M. Kutsch,
Attendorn
1993 beginning of
worldwide
expansion
1999 Joint Venture
VRK Querétaro
today 30 plants
in 11 countries on
three continents
from 2007 foundation of
three Tec
Centers in
Europe, Asia,
North
America
2011 takeover
majority
shares of
Van-Rob
KIRCHHOFF GRUPPE
Development of Human Resources, Hardware and Software at KIRCHHOFF Automotive FE Department
5 22.04.2013
2005
2 FE Engineers
Local Workstations
2007
5 FE Engineers
One office
1 Linux Server
6000 Jobs
2010
6 FE Engineers
Different offices
4 Linux Servers
12000 Jobs
PBS Pro was established
2013
9 FE Engineers
Different Offices
Different Countries
5 Linux Servers
About 20000 Jobs
KIRCHHOFF GRUPPE
Why a workload management system
6 22.04.2013
In 2009 5 FE Engineers share a HPC Cluster of 2 servers.
A new problem arose:
How to manage the jobs on the Cluster.
Server1
Server2
KIRCHHOFF GRUPPE
Optimizing Workload with PBS Pro
7 22.04.2013
Using
PBS
Planned Workload Real Workload Optimized Workload
KIRCHHOFF GRUPPE
Operation Mode of PBS Pro (Simplified)
Users send request for simulation job.
PBS/PAS Server
Checks Cluster
for free
resources.
NAS or local disk.
Provide Solver Input
Files and
free space for result
files. Yes No
Queue
Execution Hosts
Server1
Server2
Pro
vid
e r
eso
urc
es
22.04.2013 8
Compute Manager
KIRCHHOFF GRUPPE
Submitting Jobs with the Compute Manager
9 22.04.2013
Area on the left hand side:
Applications and Profiles.
Choose the application to use.
Load, save and share profiles.
KIRCHHOFF GRUPPE
Submitting Jobs with the Compute Manager
10 22.04.2013
Area on the center:
Choose parameters.
Number of CPUs, Memory….
Add Solver input deck.
KIRCHHOFF GRUPPE
Area on the right hand side:
File explorer to choose solver
input decks and output
directories.
Submitting Jobs with the Compute Manager
11 22.04.2013
KIRCHHOFF GRUPPE
Smart Job Management with Compute Manager
12 22.04.2013
Drop Down Menu: Queue
Prioritize jobs by choosing
Queues.
KIRCHHOFF GRUPPE
Priorizing Jobs with PBS Pro
13 22.04.2013
At 4:00PM User 5 will run an urgent
job with min. 8 CPUs and uses the
panic queue.
The job of User 1 in the standard
queue is suspended. Job of User 5
starts.
After finished the job of User 1 will
be resumed.
KIRCHHOFF GRUPPE
Monitoring PBS Pro with the Compute Manager
14 22.04.2013
Area at the right upper side:
Show jobs on the cluster.
KIRCHHOFF GRUPPE
Monitoring PBS Pro with the Compute Manager
15 22.04.2013
Area on the left hand side
Possibility to filter the queue
by software, user and state.
KIRCHHOFF GRUPPE
Monitoring PBS Pro with the Compute Manager
16 22.04.2013
Area on the right lower side:
Shows more information of the jobs.
Shows and provide access to the files.
KIRCHHOFF GRUPPE
Visualize Results with the Compute Manager
22.04.2013 17
The Results manager
allows to access the
result files during and
after the job runs and
makes it possible to
visualize the results in
the browser window.
KIRCHHOFF GRUPPE
Analyze the Workload with PBS Analytics
18 22.04.2013
PBS Analytics will help to
analyze the degree of
capacity utilization of
existing resources.
KIRCHHOFF GRUPPE
Analyze the Workload with PBS Analytics
19 22.04.2013
Analyzing wait times
helps to decide if
additional licenses or
hardware are needed.
Monitoring the use of hardware
helps to optimize the cluster.
KIRCHHOFF GRUPPE
Conclusions
20 22.04.2013
16 Abaqus Tokens
7000 Hyperworks GWU
2 Dyna Licenses
6(2) FE Engineers (Students)
4 Execution Hosts
24 Abaqus Tokens
7000 Hyperworks GWU
2 Dyna Licenses
9(2) FE Engineers (Students)
5 Execution Hosts
KIRCHHOFF GRUPPE
Conclusions Qeustions & Answers
Let Engineers be Engineers!
21 22.04.2013
PBS Works …
-is easy to use.
-provides a send and forget technology.
-is an open architecture.
-allows to prioritize jobs.
-use hardware and software efficiently.
reduce cost for hardware and software.
-offers with the Compute Manager an all in
one solution for submitting, monitoring and
visualization FE jobs.
FE Engineers…
-can focus to their project work.
-do not longer need IT expert knowledge.
-save a lot of time.
Thank you for your kind attention!