cloud computing workshop at iit bombay
TRANSCRIPT
IIT Tech Fest Cloud Workshop
Trainer ProfileCo-founder and CEO at Applied Cloud ComputingMr. Nilesh is an experienced technology professional with hands on expertise on cloud technologies.
He is associated with IIT Bombay as an Independent Technology Advisor assisting them with their Virtualization journey. And Cloud Advisor with Wegilant University, an IIT startup.
•Mr. Nilesh Served IBM, HP, Wipro, Hexaware as a cloud expert in last 10 years. •Few of his clients are HCL, Tata Interactive Systems, IIT Bombay, Future Group, CITIBANK, Boehringer Ingelheim india.
AWS certified Solution ArchitectNetsuite Certified Implementation partnerPeoplesoft Certified Technical consultant
Qualification : BE Computer Science from VJTI: MBA form Jamnalal Bajaj Institute of management studies
Linkedin Profile:http://www.linkedin.com/profile/view?id=200500065
Nilesh Satpute
2www.appliedcloudcomputing.com
INTRODUCTION TO CLOUD COMPUTING
Session 1
3www.appliedcloudcomputing.com
History of cloud computing
• Need for Utility : (Electricity, Telecom) : Delivering computer resources over global network
1969 (ARPNET)
1970(mainframes)
1980(PC adoption)
1990-till date (internet economy)
1999 (salesforce.com)
2002(Amazon Web Services)
2004(Private Cloud)
2009(web 2.0)
Mainframe
Full virtualization
Paravirtualization
4www.appliedcloudcomputing.com
cloud
Cloud computing is a model for enabling ubiquitous, convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and released with minimal management effort or service provider interaction.
• 5 characteristics• On demand self Service, Broad Network Access, Resource pooling, Rapid Elasticity and Measured services
• 3 Service Models•SaaS, PaaS, IaaS
•4 Deployment model•Private Cloud, Public Cloud, Community cloud, And Hybrid Cloud
5www.appliedcloudcomputing.com
How Cloud Computing works 1/2
• Using resource pools to share common resources
• Server Virtualization
• Network Virtualization
• Storage Virtualization
• Virtualization to cloud : IT –as-a-Service
• Data Centre transformation to shared Infrastructure
6www.appliedcloudcomputing.com
How Cloud Computing works 2/2
IT Service Management
Software as a Service
Platform as a service
Infrastructure as a service
Virtual Infrastructure Architecture
Virtual Infrastructure Management
System StorageBackup
and Recovery
Networks SecurityTraditional Roles still essential
New role emerging•Cloud Architect•Cloud Admin•Cloud Capacity Planner•IT automation engineer
New focus Area : Cloud services and operations management
Business and Financial management
7www.appliedcloudcomputing.com
Application for Business
• Application testing and staging
• Temporary processing and storage needs
• Data archiving
• Virtual Desktop Infrastructure (VDI)
• Supplier management
• Back-office optimization
• Sales force management
• Project management and collaboration
8www.appliedcloudcomputing.com
Infrastructure Cloud Services Provider
• AWS
• Microsoft Azure
• Google App engine
• Rackspace Cloud
9www.appliedcloudcomputing.com
Cloud Computing Architecture 1/4
10www.appliedcloudcomputing.com
Cloud Computing Architecture 2/4
11www.appliedcloudcomputing.com
Cloud Computing Architecture 3/4
12www.appliedcloudcomputing.com
Cloud Computing Architecture 4/4
13www.appliedcloudcomputing.com
Cloud Computing Terminologies
• Communication-as-a-Service (CaaS)
• Infrastructure-as-a-Service (IaaS)
• Monitoring-as-a-Service (MaaS)
• Software-as-a-Service (SaaS)
• Platform-as-a-Service (PaaS)
14www.appliedcloudcomputing.com
Cloud
Advantage
• Access
• Scalable
• Cross Platform
• No upfront cost
• Data Security
• Integration
Disadvantage
• Security
• Response Time
15www.appliedcloudcomputing.com
VIRTUALIZATIONSession 2
16www.appliedcloudcomputing.com
Virtualization Basics : Hypervisor Virtualization
Guest VM User Space
EmulationMM RM Scheduler
HypervisorHost VM
User Space
Hardware
Hypervisor
Drivers VM OS kernel
Drivers VM Space
Drivers Virtual Hardware
Guest VM User Space
Drivers VM Space
Drivers Virtual Hardware
17www.appliedcloudcomputing.com
Virtualization Basics : OS Virtualization
DriversUser API
MM RM Scheduler
OS Virtualisation
User Space(Container)
User Space(Container)
User Space(Container)
Hardware
OS Kernel
18www.appliedcloudcomputing.com
Virtualization Basics : Para Virtualization
DriversUser API
MM RM Scheduler
Para Virtualisation
User Space(Container)
User Space(Container)
User Space(Container)
Hardware
OS Kernel
Hypervisor
19www.appliedcloudcomputing.com
Benefits
• Hardware Abstraction• Ease of Migration• Encapsulation of storage• Snapshots• Ease of archiving• Ease of growth• Improved Monitoring and troubleshooting• Workload consolidation• Ease of environment segmentation• Improved Remote management
20www.appliedcloudcomputing.com
CLOUD NETWORK AND PRIVATE CLOUD
Session 3
21www.appliedcloudcomputing.com
22www.appliedcloudcomputing.com
23www.appliedcloudcomputing.com
24www.appliedcloudcomputing.com
25www.appliedcloudcomputing.com
www.appliedcloudcomputing.com 26
www.appliedcloudcomputing.com 27
www.appliedcloudcomputing.com 28
AMAZON WEB SERVICES CLOUDSession 4
29www.appliedcloudcomputing.com
Amazon Web Services (AWS) -robust, scalable and affordable
infrastructure for cloud computing.
This session is about:
30www.appliedcloudcomputing.com
5 Benefits of Using Amazon Web Services
1. Pay-per use model
You are only charged for disk space, CPU time and bandwidth that you use.
2. Instant scalability
Your Service automatically scales on AWS stack.
3. Reliable/Redundant/Secure
Infrequent outages (so far).Data is redundant in the cloud.
All services have built-in security.
* Soon will add Comprehensive to the list.
4. Most services accessed via simple REST/SOAP API
Libraries are available in all major languages.Minimal learning curve.
5. Amazon - Experience & Commitment
Amazon has been doing this for ~15 years. Company-wide commitment to AWS.
Amazon Web Services Stack
Simple DatabaseService (SimpleDB)
Elastic Cloud Service (EC2)
Simple StorageService (S3)
Simple QueueService (SQS)
38www.appliedcloudcomputing.com
EC2 in a Nutshell
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
QuickTime™ and a decompressor
are needed to see this picture.
MachineImage
(OS + Apps)
Usage:
• Create Machine Image• Deploy the image to S3• Start 1 or more instances• Use it as regular machine(s)
Main Options:
• Dynamic/Static IPS• Choose cores• Choose locations• Persistence via EBS
40www.appliedcloudcomputing.com
Sample EC2 Use Cases
Batch Processing
All instances are configured with the same code. Each instance operates on a subset of data. Partitions are specified in configuration file.
Web Service
All instances are configured with the same code. One or more instances are configured as load balancers
(HAProxy for example). DNS Server distributes requests between load balancers.
41www.appliedcloudcomputing.com
EC2 vs. Web Hosting Company
Good
Instantly add new instances
Full-control over the machines and choice of the environment
Likely cheaper (but depends on your exact situation)
Bad
Need to put the images together and manage instances
No dedicated technical support
(but there is premium support and RightScale solutions)
42www.appliedcloudcomputing.com
S3 in a Nutshell
Client
Idea:
Put/Get objects into bucketsbased on unique keys.
Main Features:
• Public/Private access.• Support for large objects.
Amazon S3
Bucket 1 Bucket N…
Put object Get object
44www.appliedcloudcomputing.com
Sample S3 Use Cases
Image/Video storage
Put your media once on S3 and then serve it up
Reads are 10 times cheaper than writes!
Serialize your Java Objects
Define unique key based on the object attributes
Write out binary serialized version to a stream
Write bytes to S3
Read them back when needed
45www.appliedcloudcomputing.com
Simple DB in a Nutshell
Client
Idea:
Create flat database with auto-indexed tables.
Main Features:
• Each attribute is indexed.• Record structure is flexible.• Basic operators in queries• Supports sorting.
Simple DB Domain
Record 1
Put record
Get recordQuery records
Key1 Attributes: A1,A2…
Record N
Key2 Attributes: A1,A2…
…
47www.appliedcloudcomputing.com
Sample SimpleDB Use Cases
Index Media files stored on S3
Use the same key as on S3
Write the record with each metadata element as attribute
Store flat objects
Use SimpleDB as a storage for non-nested data
48www.appliedcloudcomputing.com
SQS in a Nutshell
Writer
Idea:
Create an infinite asynchronous queue.
Main Features:
• Multiple queues• Upto 4K messages• Message Locking
SQS Queue
Message 1
SendMessage
ReceiveMessage
Message N
…
Reader
50www.appliedcloudcomputing.com
Sample SQS Use Cases
Twitter Friend Update
For each update generate a task to update friends
Process updates in order
Publish/Subscribe
Post messages to the queue to inform multiple subscribers
Process Pipeline
Use different queues to put, for example, and order through a pipeline.
51www.appliedcloudcomputing.com
52www.appliedcloudcomputing.com
Contact
• Nilesh Satpute
• www.appliedcloudcomputing.com
• [email protected] (official email)
• [email protected] (personal email id)
• Facebook http://www.facebook.com/nilesh.satpute.5
• http://www.facebook.com/AppliedCloudComputing
53www.appliedcloudcomputing.com
PHOTOGRAPHS FROM IIT WORKSHOP
54www.appliedcloudcomputing.com
55www.appliedcloudcomputing.com
56www.appliedcloudcomputing.com