summer vacation scholarship | im&t scientific computing in the cloud
TRANSCRIPT
Scientific Computing in the Cloud | Alyssa Biasi
Cloud Service Models
Software-as-a-Service (SaaS)• E.g. Gmail, Dropbox
Platform-as-a-Service (PaaS)• E.g. Google AppEngine, Window
Azure
Infrastructure-as-a-Service (IaaS)• E.g. Amazon EC2, Rackspace
5 |
Figure 4.
Scientific Computing in the Cloud | Alyssa Biasi
Cloud 9 Test Beds
Compute Clusters:
• Burnet• Bragg• Vayu
7 |
Virtual Machines (VMs):
• IM&T Cloud• “Bluetea”• Amazon EC2• Windows Azure• NeCTAR• QERN (QCIF Early Research Node)
Operating System:
Vayu and QERN - CentOS 5.9Compute Clusters - SUSE Linux Enterprise Server 11Virtual Machines - Custom SUSE Linux Enterprise Server 11
Scientific Computing in the Cloud | Alyssa Biasi
Burnet
• Run by the Advanced Scientific Computing (ASC) group
8 |
Machine Type:CPU Type:
Number of Cores: Memory:
File System:
Compute clusterIntel Xeon X5670 at 2.93 GHz175214 TBIBM GPFS
Scientific Computing in the Cloud | Alyssa Biasi
Bragg
• Run by the Advanced Scientific Computing (ASC) group
9 |
Machine Type:CPU Type:
Number of Cores: Memory:
File System:
Compute clusterIntel Xeon E5-2650 at 2 GHz 204816.4 TBNFS
Scientific Computing in the Cloud | Alyssa Biasi
Vayu
• National Computational Infrastructure (NCI)
10 |
Machine Type:CPU Type:
Number of Cores: Memory:
File System:
Compute clusterIntel Xeon E5540 at 2.53GHz 1193637 TBLustre
Scientific Computing in the Cloud | Alyssa Biasi
IM&T Cloud
11 |
Machine Type:CPU Type:
Number of Cores:Memory:
File System:
Cloud VMIntel Xeon X5680 at 3.33 GHz8 (virtual CPUs)32 GBSAS
Scientific Computing in the Cloud | Alyssa Biasi
“Bluetea” - OpenStack
12 |
• Dedicated desktop• Implementation of OpenStack
Figure 5.
Figure 6.
Scientific Computing in the Cloud | Alyssa Biasi
CPU Type:Number of Cores:
Memory:Operating System:
Intel Xeon X5660 at 2.80GHz648 GBUbuntu 12.04.1 LTS (Precise) - Server
“Bluetea”
13 |
The Host:
The VM:Machine Type:
CPU Type:Number of Cores:
Memory:
Cloud VMIntel Xeon X5660 at 2.80GHz4 (virtual CPUs)32 GB
Scientific Computing in the Cloud | Alyssa Biasi
Amazon Elastic Compute Cloud (EC2)
• Amazon web Infrastructure-as-a-Service
14 |
Machine Type:CPU Type:
Number of Cores:Memory:
Instance Type:
Cloud VMIntel Xeon E5-2665 at 2.40GHz 8 (virtual CPUs)68.4 GBQuadruple Extra Large
Machine Type:CPU Type:
Number of Cores:Memory:
Instance Type:
Cloud VMIntel Xeon E5-2650 at 2.00GHz 16 (virtual CPUs)117 GBHigh Storage Eight Extra Large
First VM:
Second VM:
Scientific Computing in the Cloud | Alyssa Biasi
Windows Azure
• Windows virtual machines• In preview stage
15 |
Machine Type:CPU Type:
Number of Cores:Memory:
Cloud VMAMD Opteron 4171 HE 8 (virtual CPUs) 13.8 GB
Note:Required a 10 GB swap file in order to run benchmarking applications.
Scientific Computing in the Cloud | Alyssa Biasi
NeCTAR
• Research Cloud• Australian Government and research organisations partnership
16 |
Machine Type:CPU Type:
Number of Cores:Memory:
Cloud VMAMD Opteron 6238 2.9GHz 4 (virtual CPUs)16 GB
Scientific Computing in the Cloud | Alyssa Biasi
QERN
• Queensland Cyber Infrastructure Foundation (QCIF)• Queensland node for NeCTAR• In pre-preview stage
17 |
Machine Type:CPU Type:
Number of Cores:Memory:
Cloud VMAMD Opteron 6172 at 2.1GHz8 (virtual CPUs)48 GB
Scientific Computing in the Cloud | Alyssa Biasi
Materials Studio
19 |
2 4 80
500
1000
1500
2000
2500
3000
3500
4000
4500
5000
ASC Burnet ASC Bragg IM&T VM BlueteaAmazon EC2 Windows Azure Nectar
Total Number of Cores
Wall Time (s)
Scientific Computing in the Cloud | Alyssa Biasi
Materials Studio - Speedup
20 |
1
1.5
2
2.5
3
3.5
4
4.5
5
5.5
6
2 4 8
Speedup
Total Number of Cores
ASC Burnet ASC Bragg IM&T VM Bluetea
Amazon EC2 Windows Azure Nectar Linear
Scientific Computing in the Cloud | Alyssa Biasi
TMD - Virtual Machines
21 |
2 4 8 160
500
1000
1500
2000
2500
3000
3500
4000
4500
IM&T VM Bluetea Amazon EC2Windows Azure Nectar QERN
Total Number of Cores
Wall Time (s)
Scientific Computing in the Cloud | Alyssa Biasi
TMD
22 |
2 4 8 16 32 64 96 1280
500
1000
1500
2000
2500
3000
3500
4000
4500
ASC Burnet ASC Bragg Vayu IM&T VM Bluetea Amazon EC2 Windows AzureNectar QERN
Total Number of Cores
Wall Time (s)
Scientific Computing in the Cloud | Alyssa Biasi
TMD - Speedup
23 |
2 4 8 16 32 64 96 1280
10
20
30
40
50
60
70
80
90
100
ASC Burnet ASC Bragg Vayu IM&T VM Bluetea Amazon EC2Windows Azure Nectar QERN Linear
Total Number of Cores
Speedup
2 4 8 160
2
4
6
8
10
12
14
Scientific Computing in the Cloud | Alyssa Biasi
Oversubscription
24 |
Total allocated resources are more than the physical resources.
2 4 8 160
500
1000
1500
2000
2500Bluetea 4 Core VM vs. 16 Core VM
16 Cores
4 Cores
Total Number of Cores
Wall Time (s)
Scientific Computing in the Cloud | Alyssa Biasi
Noisy Neighbour
25 |
Sharing resources with computationally heavy ‘neighbour’.
VM 01 VM 02 Stand Alone0
200
400
600
800
1000
1200
1400
1600
1800
2000
TMD Oversubscription - 4 Cores
Wall Time (s)
Scientific Computing in the Cloud | Alyssa Biasi
• Figure 1: Duncan, D. Cloud-Computing, digital image, EmpowerCS, “Cloud Computing Mainstream still Two Years away”, Accessed 5th February 2013 <http://www.empowercs.com.au/blog/2012/11/cloud-computing-mainstream-still-two-years-away>
• Figure 2: Sourced from and edited Vmware vSphere, vSphere Host vs.. Virtual Infrastructure , digital image, VMware, Accessed 4th February 2013 <http://www.vmware.com/products/datacenter-virtualization/vsphere/scale-security.html >
• Figure 3: Screenshot taken of Ubuntu OpenStack Dashboard – instance launch.• Figure 4: Czernicki, B. Cloud Service Terms , digital image, Silverlight Hack, “IaaS, PaaS and SaaS
Terms Clearly Explained and Defined”, Accessed 8th February 2013 http://www.silverlighthack.com/post/2011/02/27/IaaS-PaaS-and-SaaS-Terms-Explained-and-Defined.aspx
• Figure 5: OpenStack: The Open Source Cloud Operating System. OpenStack Software Diagram, digital image, OpenStack, Accessed 7th February 2013 http://www.openstack.org/software/
• Figure 6: Morrison, G. What is OpenStack?, digital image, TechRadar, “What on Earth is OpenStack?”, Accessed 6th February 2013 <http://www.techradar.com/au/news/software/what-on-earth-is-openstack-1112804>
• Figure 7: Maheshwari, A. Cloud Rain, digital image, Brainstuck, Accessed 11th February 2013 <http://www.brainstuck.com/2009/08/19/drought/>
27 |
References