supercomputing made super human - nimbix · past, present, and future leo reiter, cto and vice...
TRANSCRIPT
![Page 1: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/1.jpg)
Supercomputing made super human
![Page 2: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/2.jpg)
2
5 Years of Containerized HPC in the Cloud:Past, Present, and Future
Leo Reiter, CTO and Vice President of Software Engineering,
Nimbix
![Page 3: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/3.jpg)
3
What Are Containers?
Linux containers• Abstraction – not actually “things”• “Inter-modal” Method for packaging, distributing, and deploying
applications and dependencies onto arbitrary infrastructure• VM’s, PC’s, servers, clusters, etc.• Consistency and integrity across platforms• Repeatable mechanisms
• VM’s useful in some cases, but no longer needed• VM’s are not compatible with HPC!
![Page 4: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/4.jpg)
4
Application
Container
← P
latf
orm
→
Runtime
“Demystified”…
![Page 5: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/5.jpg)
5
Container Ecosystem: Explained
Formats Registries
Platforms
Runtimes
![Page 6: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/6.jpg)
6
Container Solution: Complete
Formats Registries
Platforms
Runtimes
JARVICE
![Page 7: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/7.jpg)
7
JARVICEA purpose built container-native cloud operating system and application delivery platform for accelerated and high performance computing.
Powers the Nimbix Cloud, now available on-premises.
Introduced containerized HPC and ML/DL, at scale to the world.
In production since 2013.
![Page 8: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/8.jpg)
8
What is Containerized HPC?
![Page 9: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/9.jpg)
9
What is Containerized HPC?
✓Bare-metal – no hypervisors• HPC and virtualization don’t mix!
![Page 10: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/10.jpg)
10
What is Containerized HPC?
✓Bare-metal – no hypervisors• HPC and virtualization don’t mix!
✓Large scale, no bottlenecks• Tightly coupled algorithm support for existing MPI and next-gen DDL• Low latency fabric support
![Page 11: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/11.jpg)
11
What is Containerized HPC?
✓Bare-metal – no hypervisors• HPC and virtualization don’t mix!
✓Large scale, no bottlenecks• Tightly coupled algorithm support for existing MPI and next-gen DDL• Low latency fabric support
✓Accelerated and Heterogeneous• x86, POWER, GPUs, FPGAs, multi-core, “many-core” - all of the above
![Page 12: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/12.jpg)
12
What is Containerized HPC?
✓Bare-metal – no hypervisors• HPC and virtualization don’t mix!
✓Large scale, no bottlenecks• Tightly coupled algorithm support for existing MPI and next-gen DDL• Low latency fabric support
✓Accelerated and Heterogeneous• x86, POWER, GPUs, FPGAs, multi-core, “many-core” - all of the above
✓Workflow-oriented• Not machines, not microservices – just answers
![Page 13: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/13.jpg)
13
3 Containerized HPC Myths…
![Page 14: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/14.jpg)
14
3 Containerized HPC Myths…
Myth #1:Containers are not bare-metal!
![Page 15: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/15.jpg)
15
3 Containerized HPC Myths…
Myth #1:Containers are not bare-metal!
Yes they are.
![Page 16: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/16.jpg)
16
3 Containerized HPC Myths…
Myth #1:Containers are not bare-metal!
Yes they are.In the Nimbix Cloud!
![Page 17: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/17.jpg)
17
3 Containerized HPC Myths…
Myth #2:Containers are hard to make!
![Page 18: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/18.jpg)
18
3 Containerized HPC Myths…
Myth #2:Containers are hard to make!
No they’re not!
![Page 19: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/19.jpg)
19
3 Containerized HPC Myths…
Myth #2:Containers are hard to make!
No they’re not!
https://github.com/nimbix/app-hpctest/bb/master/Dockerfile
http://singularity.lbl.gov/docs-recipes
![Page 20: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/20.jpg)
20
3 Containerized HPC Myths…
Myth #3:My code is not container native!
![Page 21: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/21.jpg)
21
3 Containerized HPC Myths…
Myth #3:My code is not container native!
That’s okay.
![Page 22: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/22.jpg)
22
3 Containerized HPC Myths…
Myth #3:My code is not container native!
That’s okay.Neither are most of these!
![Page 23: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/23.jpg)
23
How JARVICE Helps Get There
Traditional App• Turn-key HPC-ready environment with
MPI, IB drivers, SSH, on either Ubuntu or CentOS (RHEL)
• Seamless access to state of the art acceleration
• Batch and interactive modes, including transparent 3D OpenGL hardware acceleration
Container-native App• Fastest container runtime engine with the
fastest starts• Seamless access to state of the art
acceleration• Secure remote access with graphical
desktop capabilities and SSH
![Page 24: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/24.jpg)
24
Journey to Containerized HPC Cloud
NACC2012API-driven HPC SaaSReconfigurable Cloud Computing
JARVICE 12013Containerized workflowsPaaS “v1”Dynamic creation and execution of containerized applications in cloud computing
JARVICE 22015Extensible/scale-out SOAContainer-nativePaaS “v2”
JARVICE 2.12016PushToCompute™
Docker and SingularityPaaS “v3”
![Page 25: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/25.jpg)
25
Stuff We Invented Along the Way
Reconfigurable Cloud Computing• Application-defined workflows• Processing API• Bare-metal for cloud HPC• Seamless programming/setup/teardown of accelerators including
GPUs and FPGAs in the cloud
Dynamic creation and execution of containerized applications in cloud computing
• End-to-end orchestration and scheduling of workflows using Linux containers in cloud computing
![Page 26: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/26.jpg)
26
JARVICE 3 + Kubernetes
JARVICE 3 brings end to end HPC application development, deployment, and scaling capabilities to Kubernetes!
• Same benefits enjoyed in the Nimbix Public Cloud now available on single tenant and on premises clusters via the Kubernetes API
• HPC and distributed deep learning (DDL), side by side with Enterprise microservices and web apps
• Bare-metal or virtualized, or both• Hundreds of commercial and open source turn-key workflow from
Nimbix Public Cloud, ready to run
![Page 27: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/27.jpg)
27
How We Brought HPC to Kubernetes
•Tightly coupled workflows, capable of running MPI style applications in a turn-key manner•Distributed container cache for very large HPC containers
• Essential innovation of PushToCompute™•Nimbix Public Cloud service catalog 100% compatibility•x86 and IBM POWER are equal citizens and runtime selectable by application workflows
![Page 28: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/28.jpg)
28
What About the Next 5 Years?
![Page 29: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/29.jpg)
29
What About the Next 5 Years?
•Very soon: Federated, exascale capabilities across multiple clouds under tenant control, with seamless end-user interface
![Page 30: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/30.jpg)
30
What About the Next 5 Years?
•Very soon: Federated, exascale capabilities across multiple clouds under tenant control, with seamless end-user interface•Down the road: Data-driven workflows, for exploratory computing, including data-driven “pipelines” for scientific data processing
![Page 31: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/31.jpg)
31
What About the Next 5 Years?
•Very soon: Federated, exascale capabilities across multiple clouds under tenant control, with seamless end-user interface•Down the road: Data-driven workflows, for exploratory computing, including data-driven “pipelines” for scientific data processing•Not-too-distant future: ML/DL-driven platform optimization for cost and/or performance
![Page 32: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/32.jpg)
32
What About the Next 5 Years?
•Very soon: Federated, exascale capabilities across multiple clouds under tenant control, with seamless end-user interface•Down the road: Data-driven workflows, for exploratory computing, including data-driven “pipelines” for scientific data processing•Not-too-distant future: ML/DL-driven platform optimization for cost and/or performance•Eventually: time travel, cold fusion, world peace
![Page 33: Supercomputing made super human - Nimbix · Past, Present, and Future Leo Reiter, CTO and Vice President of Software Engineering, Nimbix. 3 What Are Containers? Linux containers •Abstraction](https://reader033.vdocuments.mx/reader033/viewer/2022060317/5f0c664c7e708231d43535df/html5/thumbnails/33.jpg)
33
Thank YouQuestions? Comments? Thoughts?