maryland hhpc@jhu advanced research...
TRANSCRIPT
![Page 1: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/1.jpg)
1
Jaime E. Combariza, PhDDirector
Maryland
Advanced
Research
Computing
Center
HHPC@JHU
![Page 2: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/2.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Data Lifecycle
2
IDIES Annual SymposiumOctober 17 ,2014
Storage
Preservation
Processing
Reuse
Publication
Analysis
Sharing
H
P
C
REPOSITORY
Generation
![Page 3: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/3.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Collecting Big Data
3
IDIES Annual SymposiumOctober 17 ,2014
High Res. telescopes
Satellites
Social Networks
FinancialMarkets
Brain Science
PredictiveComputational Science
Smart Networks
Virtual Libraries
HumanGenomics
Large Scale Experiments
![Page 4: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/4.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Data-Rich Environment (Effects)
4
IDIES Annual SymposiumOctober 17 ,2014
Eco-Informatics Biomedical Informatics
Astro-Informatics Data Driven Applications
Digital Humanities
![Page 5: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/5.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Opportunities
5
IDIES Annual SymposiumOctober 17 ,2014
Innovation, Competition and Productivity
![Page 6: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/6.jpg)
IDIES Annual SymposiumOctober 17 ,2014
What’s being done
6
IDIES Annual SymposiumOctober 17 ,2014
• WH 2012 200M R&D for big data
• NSF & NIH (many programs)
• Gordon and Betty Moore Foundation
• Many schools VIDA, DI2,
• States, e.g.: Mass
• Xsede (9/2/14)
![Page 7: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/7.jpg)
IDIES Annual SymposiumOctober 17 ,2014
HPC Ecosystem that supports computationally-intensive and data centric computing
What’s Maryland doing?
7
IDIES Annual SymposiumOctober 17 ,2014
Investment
![Page 8: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/8.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Data center and data-rich environment
9
IDIES Annual SymposiumOctober 17 ,2014
Infrastructure Network
Compute Engine
Storage
Cyberinfrastructure
![Page 9: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/9.jpg)
IDIES Annual SymposiumOctober 17 ,2014
CIDR
Science DMZ @ JHU
11
IDIES Annual SymposiumOctober 17 ,2014
CIDR
40Gb/sLatrobe
MaloneCRB
PH
Clark
HoRNET
PHA
100Gb/s
![Page 10: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/10.jpg)
IDIES Annual SymposiumOctober 17 ,2014 HPC Resources & Model
13
IDIES Annual SymposiumOctober 17 ,2014
• Approx 18,000 cores and 20 Petabytes storage
KSAS:10.5M Quarter
WSE: 10.5M/Q
SOM: 6.2M/Q
PH: 5.8M/Q
UMCP: 5.8M/Q
![Page 11: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/11.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Hardware
15
IDIES Annual SymposiumOctober 17 ,2014
Count Description
648 Regular compute nodes, 128 GB RAM, Haswell 2.5GHz, 24 cores
50 Large memory nodes, 1 Tbyte RAM, ivy Bridge 3.0GHz, 48 cores
24 GPU nodes, 48 Nvidia K40 GPUs, 24 cores per node
2 PB High Performance File System (CIFS)
14 PB zFS File System
FDR-14 Infiniband Connectivity 2:1 blocking
Rpeak= 771 TFLOPs, RMax=617 TFLOPs, (61st place on Top500)
![Page 12: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/12.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Governance
17
IDIES Annual SymposiumOctober 17 ,2014
• Facility Governing Board (3 members JHU, 3 members UMCP)
• Scientific Management Committee (4 faculty members from JHU and UMCP).– Policies
– Allocation models
– Utilization
![Page 13: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/13.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Timeline
18
IDIES Annual SymposiumOctober 17 ,2014
• Data center: End of November
• Network install “mid December”
• Hardware deployment Dec 1 - Jan 2015
• Production system:
![Page 14: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/14.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Co-Location
19
IDIES Annual SymposiumOctober 17 ,2014
• Priority
• Early Spring we will have better guidelines and policies
• Cluster/server hosting and management
• Cluster/server hosting
• Virtual servers
![Page 15: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/15.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Next . . .
20
IDIES Annual SymposiumOctober 17 ,2014
• Website• FAQs
• Instruction on how to connect
• Request accounts
• Queueing system and queues
• Software & Application support
• Add Condos
• Documentation
![Page 16: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/16.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Summary
21
IDIES Annual SymposiumOctober 17 ,2014
• Create state of the art HPC facility (current and future needs)
• Develop an HPC ecosystem:• To foster collaboration and advance research agendas
• Develop or improve tools for more effective data analysis
• Resource to attract and retain top researchers
• Facility to properly house HPC resources with different requirements (Co-location)
• Researchers concentrate on science not on IT
![Page 17: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/17.jpg)
IDIES Annual SymposiumOctober 17 ,2014
Information
22
IDIES Annual SymposiumOctober 17 ,2014
• Web site (soon) marcc.jhu.edu
![Page 18: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/18.jpg)
IDIES Annual SymposiumOctober 17 ,2014
23
IDIES Annual SymposiumOctober 17 ,2014
![Page 19: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/19.jpg)
IDIES Annual SymposiumOctober 17 ,2014
![Page 20: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/20.jpg)
IDIES Annual SymposiumOctober 17 ,2014
![Page 21: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/21.jpg)
IDIES Annual SymposiumOctober 17 ,2014
![Page 22: Maryland HHPC@JHU Advanced Research …idies.jhu.edu/wp-content/uploads/2016/07/IAS2014...Innovation, Competition and Productivity IDIES Annual Symposium October 17 ,2014 What’s](https://reader034.vdocuments.mx/reader034/viewer/2022042303/5ecee4a89648e02c7b7f96b1/html5/thumbnails/22.jpg)
IDIES Annual SymposiumOctober 17 ,2014