AZURE AND AWS

by: Nachiket Dravid(MDS201918), Hardik Prabhu(MDS201912),

Kshitish Kirt Nanda(MDS201915)

BDH CLASS PRESENTATION

Cloud computingOn-demand availability of computer system resources, especially data storage and

computing power, without direct active management by the user.

Why Cloud?

TYPES OF CLOUD COMPUTING

Cloud computing is mainly divided into three categories.

1. SAAS (Software as a service)

2. PAAS (Platform as a service)

3. IAAS (Infrastructure as a service)

SAAS

These are the commonly used services which we already know. In SAAS we don’t have to

develop or deploy anything. We just use the readymade service, for example, google docs,

Playstore, Facebook, etc. In this, we are not developing anything. We are just using it.

The Software as a Service (SaaS) solutions today rely on the internet and they are in need of web browser to access it.

PAAS

In PAAS they provide the platforms for the software developers so that they can develop

software and deploy them over the servers. In this developers only have to worry about their

software, other infrastructures are managed by cloud computing company. For example Go,

daddy, Heroku, etc.

In this, we just deploy our code to their servers. We don’t have to worry about their

infrastructure, maintenance, security, and other policies.

IAAS

In infrastructure as a service, most of the things are managed by us. As the name suggesting

IAAS, we are having infrastructure as a service like Networking , Storage, Servers, etc.

TYPES OF CLOUD COMPUTING

Cloud Computing Deployment Methods

Public cloud● Public clouds are the most common way of deploying cloud computing.● The cloud resources (like servers and storage) are owned and operated by a

third-party cloud service provider and delivered over the Internet.● In a public cloud, you share the same hardware, storage and network

devices with other organisations● Lower costs—no need to purchase hardware or software and you pay only for

the service you use.● No maintenance—your service provider provides the maintenance.● Near-unlimited scalability—on-demand resources are available to meet your

business needs.● At the same time, relying on a third party in running their infrastructure

deprives users of knowing where their information is kept and who has access to it.

Private cloud

● A private cloud consists of computing resources used exclusively by one business or organisation.

● in a private cloud, the services and infrastructure are always maintained on a private network and the hardware and software are dedicated solely to your organisation.

● Only a clearly defined scope of persons have access to the information kept in a private repository.

● a private cloud can make it easier for an organisation to customise its resources to meet specific IT requirements.

● The major disadvantage of the private cloud deployment model is its cost intensiveness, as it entails considerable expenses on hardware, software and staff training.

Community Cloud● A community cloud deployment model resembles a private one to a large extent.● in the case of a community cloud, several organizations with similar backgrounds share the infrastructure

and related resources.● community model is particularly suited for organizations that work on joint projects

The strengths of a community computing type include the following:

● Cost reduction● Improved security, privacy and reliability over public cloud● Ease of data sharing and collaboration

The shortcomings are:

● Higher cost than that of a public one● Sharing of fixed storage and bandwidth capacity● It is not widespread so far

Hybrid Clouda hybrid cloud encompasses the best features of the above-mentioned cloud computing deployment models – a public, private and community ones.

you can use the public cloud for high-volume, lower-security needs such as web-based email and the private cloud (or other on-premises infrastructure) for sensitive, business-critical operations like financial reporting.

Advantages of hybrid clouds:

● Control—your organisation can maintain a private infrastructure for sensitive assets.● Flexibility—you can take advantage of additional resources in the public cloud when you need them.● Cost-effectiveness—with the ability to scale to the public cloud, you pay for extra computing power

only when needed.

A Brief History of Cloud Computing

1950sMainframes

The primary work of these devices was to organize and store large volumes of information that were tedious to manage by hand. Only large businesses, universities, and government agencies could afford them, and they took a crew of specialized personnel and specialized facilities to maintain.

During the 1960s , the initial concepts of time-sharing became popularized via RJE (Remote Job Entry).

1960-80sThe earliest concepts of cloud computing were introduced by J.C.R. Licklider in April 1963.

Licklider presented the idea of an Intergalactic Computer Network that would allow for “informational interaction among governments, institutions, corporations, and individuals.”

His initial research became the inspiration for ARPANET.

The cloud symbol was used to represent networks of computing equipment in the original ARPANET by as early as 1977.

IBM introduced VM (virtual machine) operating system that took “time sharing model” to next level.

1990sIn the 1990s, telecommunications companies began offering virtual private network (VPN) services with comparable quality of service, but at a lower cost.

2000sIn August 2006, Amazon created subsidiary Amazon Web Services and introduced its Elastic Compute Cloud (EC2)

In February 2010, Microsoft released Microsoft Azure, which was announced in October 2008

these three companies have competed for share of the cloud computing market, which is expected to reach $278B by 2021

AZUREFor 13 years, Azure has been the world’s most comprehensive and broadly

adopted cloud platform

(when he presents AWS make sure to just replace Azure by AWS in the first slide)

Azure● Azure was announced in October 2008, started with codename "Project

Red Dog".● Released on February 1, 2010, as "Windows Azure" before being renamed

"Microsoft Azure" on March 25, 2014.

Azure servicesAzure offers many services on its platform such as:● Compute services● Data services● Application services● Network services

Compute servicesServices used to host and run application workload:

● Azure Virtual Machines● App services● Azure Batch● Azure RemoteApp● Azure Service Fabric● Azure Container Service

App services● Azure App Service is an HTTP-based service for hosting web applications,

REST APIs.● REST APIs - Representational State Transfer. A RESTful web application

gives information about itself in the form of information about its resources. Resource is an object that the API can provide information about. It allows the client to take actions on those resources, e.g. create a new user or edit a post.

Some key features of app services are:

1. Multiple languages and frameworks - excellent support for python, PHP, Java.

2. Variety of application templates - template is a standard framework for users to employ when they make apps.

3. Security and compliance - highly secure, compliant with data integrity parameters

Azure Batch● Used to run large-scale parallel and high-performance computing (HPC)

batch jobs efficiently in Azure. Azure Batch creates and manages a pool of compute nodes (virtual machines), installs the applications you want to run, and schedules jobs to run on the nodes.

Some of the things done on Batch:

● Financial risk modeling using Monte Carlo simulations● VFX and 3D image rendering● Image analysis and processing● Genetic sequence analysis● Data ingestion, processing, and ETL operations

Azure RemoteAppAzure RemoteApp provides secure and remote access to applications from different user devices. It is part of the Microsoft Virtual Desktop Infrastructure and is used to provide employees with access to business applications on different platforms/devices anywhere from the internet.

Azure RemoteApp can be deployed in two different forms:

● Cloud Collection – The entire data for the hosted app is stored on Azure Cloud Platform

● Hybrid Collection – The app data is stored using a combination of on premises and Azure cloud platform.

Azure Service Fabric● Azure Service Fabric is a distributed systems platform to package, deploy,

and manage scalable and reliable microservices and containers.● Microservices, also known as the microservice architecture is an

architectural style that structures an application as a collection of services that are:

1. Highly maintainable and testable2. Independently deployable3. Organized around business capabilities4. Owned by a small team

● Developers can avoid complex infrastructure problems and focus on implementing mission-critical, demanding workloads that are scalable, reliable, and manageable.

● Containers are a logical packaging mechanism in which applications can be abstracted from the environment in which they actually run. It allows container-based applications to be deployed easily and consistently, regardless of the target environment (which may be a private data center, public cloud, or a personal laptop)

Data servicesServices for storing and managing data:

● Azure Storage - Blob, Table, File● Azure SQL Database● Azure StorSimple

Azure Blob● The word blob is an acronym for “binary large object”. Blobs are

unstructured files like the ones that we commonly store on our computers.● Blob storage can store any various types data, such as a document, media

file, or application installer.

Azure Table● Azure Table storage is a service that stores structured NoSQL data in the

cloud. It has a schema-less design.● Because Table storage is schema-less, it's easy to adapt data as the

needs of the application evolve.● Access to data is fast and cost-effective for all kinds of applications. Cost

of table storage is usually much lower than traditional SQL for similar volumes of data.

Azure File● Azure File storage is a service that offers file shares in the cloud by using

the standard Server Message Block (SMB) protocol.● Server Message Block (SMB) is a network communication protocol for

providing shared access to files between nodes on a network.● It is used when you want to take an application to the cloud which already

uses the native file system APIs to share data between it and other applications running in Azure.

● Used when you want to store development and debugging tools that need to be accessed from many virtual machines.

Azure SQL Database● Azure SQL Database is a general-purpose relational database. It allows

creation of highly available and high performance data storage layer for the applications and solutions in Azure.

● Allows usage of advanced query processing features, such as high performance in memory technologies and intelligent query processing.

● In memory technologies include OLTP (to read/update small sets of data), OLAP (allows users to analyze information from multiple database systems at the same time), and hybrid (both OLTP and OLAP on same dataset)

● The intelligent query processing feature includes features that improve the performance of existing workloads with minimal implementation effort.

● Azure StorSimple is a hybrid cloud storage solution by Microsoft Azure, which provides a cloud based storage infrastructure used for storing, accessing and managing large quantities of data.

● Used to provide data storage and backup solutions for both cloud and on premises IT Infrastructure. Primarily used to provide storage resources for:

1. Backing up or offloading inactive or infrequently used data2. Central location for storing primary, backup, archive data3. Providing snapshots, volumes or data to virtual machines for

development, testing, or disaster recovery.

Azure StorSimple

Application servicesServices for building and operating applications:

● Azure Active Directory● Azure HDInsight● Azure Scheduler● Azure Media Services

Azure Active Directory● Azure Active Directory (Azure AD) is Microsoft’s cloud-based identity and

access management service, which helps employees sign in and access resources in:

1. External resources, such as Microsoft Office 365, the Azure portal, and other SaaS applications.

2. Internal resources, such as apps on the corporate network and intranet, along with any cloud apps developed by the organization.

● Azure HDInsight is an open-source analytics service in the cloud for enterprises. You can use open-source frameworks such as Hadoop, Apache Spark, Apache Hive, Apache Kafka, Apache Storm, R, and more.

● Azure HDInsight makes it easy, fast, and cost-effective to process massive amounts of data. With a host of supported frameworks, it enables a broad range of scenarios such as extract, transform, and load (ETL), data warehousing, machine learning, and IoT.

Azure HDInsight

● Azure Scheduler helps create jobs that run in the cloud. It automatically schedules and runs those actions.

● You can run jobs immediately or at a later time. Scheduler easily supports complex schedules. It specifies when to run jobs, keeps a history of job results that can be reviewed.

Azure Scheduler

Scheduler can help:

● Run recurring app actions: For example, periodically collect data from Twitter into a feed.

● Perform daily maintenance: Such as pruning logs daily, performing backups, and other maintenance tasks.

Azure Logic Apps is replacing Azure Scheduler, which is being retired!

● Azure logic apps helps schedule, automate, and orchestrate tasks, business processes, and workflows. For example, tweets can be monitored for a specific subject and the sentiment can be analyzed.

Azure Media Services● Azure Media Services is a cloud-based platform that enables building

solutions that achieve broadcast-quality video streaming, enhance accessibility and distribution, analyze content, and much more.

● Media Services helps create apps that deliver media experiences of outstanding quality to large audiences on mobile devices and browsers.

Features of media services:

● Deliver videos in various formats so they can be played on a wide variety of browsers and devices.

● Streaming live sporting events to a large online audience, like football, baseball, etc.

● Analyze recorded videos or audio content. For example, to achieve higher customer satisfaction, organizations extract speech-to-text and then they can extract intelligence around common complaints, sources of complaints, and other relevant data.

Network servicesServices for networking both within Azure and between Azure and on premises data centres.

● Azure Virtual Network● Azure Traffic Manager● Azure Content Delivery Network

Azure Virtual Network

● Azure Virtual Network is the fundamental building block for the private network in Azure.

● VNet enables many types of Azure resources, such as Azure Virtual Machines, to securely communicate with each other, the internet, and on-premises networks.

Azure Traffic Manager● Azure Traffic Manager is a DNS-based traffic load balancer that distributes

traffic optimally to services across global Azure regions, while providing high availability.

● Traffic Manager directs client requests to the most appropriate service endpoint.

Azure CDN

● A content delivery network (CDN) is a distributed network of servers that can efficiently deliver web content to users.

● CDNs store cached content on edge servers that are close to end users. One of the advantages of CDN is better performance of apps. A CDN edge server is a computer that exists at the “edge” of a network.

● Primary purpose of a CDN edge server is to store content as close as possible to a requesting client machine, thereby reducing latency and improving page load times.

Some key concepts

Azure is generally available in many regions around the world. When provisioning a VM or application in Azure, you are free to select a region. The selected region represents a specific datacentre where your application runs.

One of the benefits of using Azure is that the application can be deployed into a variety of datacentres around the world. Performance of an application is affected by the region chosen. It is best to choose a region that is closer to most of the customers, to reduce delay in network requests.

1. Datacentres and regions

2. Azure Portal

The Azure portal is a web-based application that can be used to create, manage, and remove Azure resources and services.

3. Resources

Azure resources are individual compute, networking, data, or app hosting services that have been deployed into an Azure subscription. Resources include virtual machines, storage accounts, or SQL databases. An Azure virtual machine might include a VM, storage account, network adapter, and public IP address. All of these are individual resources. Each resource can be created, managed, and deleted individually or as a group.

4. Automation

In addition to creating, managing, and deleting resources by using the Azure portal, these activities can be automated by using PowerShell or the Azure command-line interface (CLI).

5. Azure PowerShell

Azure PowerShell is a set of modules that provide cmdlets to manage Azure. Cmdlets can be used to create, manage, and remove Azure services. The cmdlets help achieve consistent and repeatable deployments. Cmdlets are used to automate and simplify routine administration tasks.

4. Azure command-line interface

The Azure command-line interface is a tool that is used to create, manage, and remove Azure resources from the command line. The Azure CLI is available for Linux, Mac OS X, and Windows

Now onto AWS

-For 13 years, Amazon Web Services has been the world’s most comprehensive and broadly adopted

cloud platform.

Goofy Callback Joke !!! But this is the truth...

What is AWS ?Amazon Web Services (AWS) is a subsidiary of Amazon that provides

on-demand cloud computing platforms and APIs (application programming interface) to individuals, companies, and governments,

on a metered pay-as-you-go basis.

Let us Dive in a bit Deeper !!!

What is APIIn building applications, an API (application programming interface) simplifies programming by abstracting the underlying implementation and only exposing

objects or actions the developer needs.

● Used almost in every sphere of digital life extensively.● In case of AWS, most services are not exposed directly to end users, but

instead offer functionality through API’s for developers to use in their applications.

In 2020, AWS comprised more than 212 services spanning a wide range including computing, storage, networking, database, analytics, application services, deployment, management, mobile, developer tools, and tools for the Internet of Things.

The most popular of these services include Amazon Elastic Compute Cloud (EC2) and Amazon Simple Storage Service (Amazon S3).

Amazon Web Services (AWS) is the market leader in IaaS and PaaS for cloud ecosystems, which can be combined to create a scalable cloud application without worrying about delays related to infrastructure provisioning (compute, storage, and network) and management.

Let us look into each of these

Amazon Relational Database Service

It is a web service running "in the cloud" designed to simplify the setup, operation, and scaling of a relational database for use in applications.

Amazon Virtual Private Cloud

Every Amazon account holds a unique virtual network that protects the information from being accessed by others.This makes the user information risk-free in the AWS cloud.

AMAZON ELASTIC COMPUTE CLOUD

● aka EC2● Amazon announced a limited public beta test of EC2 on August 25, 2006.● In November 2010, Amazon switched its own retail website to use EC2

and AWS.

That is when we could be sure that it is in fact very pretty amazing.

What is EC2 ?● It forms a central part of AWS by allowing users to rent virtual computers

on which to run their own computer applications.● It encourages scalable deployment of applications by providing a web

service through which a user can boot an Amazon Machine Image (AMI) to configure a virtual machine (which Amazon calls an "instance") containing any software desired.

● A user can create, launch, and terminate server-instances as needed, paying by the second for active servers – hence the term "elastic".

What is Amazon Machine Image ?

It is a special type of virtual appliance that is used to create a virtual machine within the EC2.

It serves as the basic unit of deployment for services delivered using EC2

Reliability of EC2 (or fault tolerance)● To make EC2 fault-tolerant, Amazon engineered Availability Zones that

are designed to be insulated from failures in other availability zones.

● To minimize downtime, a user can set up server instances in multiple Availability zones failure such that one backs up the other.

AWS offers more than 100 services and it has over one hundred thousand active customers. It is also made up of 55 availability zones that cut across 18 geographic regions all over the world.

Some more Features of EC2● EC2 provides users with control over the geographical location

of instances that allows for latency optimization.● Latency = The round trip time from the browser to the

server. It is obviously desired for this time to remain as close to 0 as possible.

Issues with EC2:● On December 1, 2010, Amazon pulled its service to WikiLeaks after coming under

political pressure in the US.The Internet group Anonymous attempted to attack EC2 in revenge; however, Amazon was not affected by the attack.

● On April 21, 2011, an outage started at EC2's Northern Virginia data center that brought down several websites, including Foursquare, Springpad, Reddit, Quora because of multiple availability zones going down.

● Simultaneous Failures may still harm unprepared EC2 users.● August 8, 2011 saw another network connectivity outage of Amazon's Northern

Virginia datacenter, knocking out the likes of Reddit, Quora, Netflix and FourSquare.

● Another Northern Virginia datacenter outage occurred on October 22, 2012. Edmodo, Airbnb, Flipboard, Reddit, and other customers were affected. Anonymous claimed responsibility, however Amazon denied this assertion.

Note to Self = If ever you work for Amazon, never choose Northern Virginia.

Amazon Elastic Block Store

It provides block-level storage to use with Amazon EC2 instances. Amazon Elastic Block Store volumes are network-attached and remain independent from the life of an instance.

Onto Amazon Simple Storage Service (or S3)

● Amazon S3 has a simple web services interface that you can use to store and retrieve any amount of data, at any time, from anywhere on the web.

● It gives any developer access to the same highly scalable, reliable, fast, inexpensive data storage infrastructure that Amazon uses to run its own global network of websites.

● Launched by AWS in 2006.

Design of S3

● Basic storage units of Amazon S3 = Objects(organized into buckets).

● Object identified by a unique, user-assigned key● Buckets can be managed = using the console provided by Amazon S3, or

with the S3 API. ● Objects can be up to five TB in size with two kilobytes of metadata.

Aspects of Using S3● Creating buckets ● Storing data = object stored & retrieved using unique developer-assigned key.

● Downloading data = anytime & enable others.

● Permissions = Grant/Deny access to others who want to upload or download data into your Amazon S3 bucket.

● Standard interfaces

How does it work ?

● S3 offers eventual consistency for overwrite PUTS and DELETES in all Regions. S3 provides read-after-write consistency for PUTS of new objects in your S3 bucket in all Regions.

Understanding S3● Bucket is a container for objects stored in Amazon S3. Every object is

contained in a bucket.● Objects consist of object data and metadata. The data portion is

opaque to Amazon S3. The Metadata is a set of name-value pairs that describe the object.

● An object is uniquely identified within a bucket by a key (name) and a version ID.

● Amazon S3 is a basic data map between "bucket + key + version" and the object itself.

● You can choose the geographical AWS Region where S3 will store the buckets created. You might choose a Region to optimize latency, minimize costs.

● Won’t leave the region unless explicitly transferred.

Amazon S3 Storage Classes (based on different levels of

durability, availability,and performance requirements)

Notable Users● Reddit is hosted on S3.● Smugmug, Tumblr, Swiftype, Pinterest.● AND Wait for it…● ...● Netflix uses Amazon S3

as their system of record.

Enough of S3 for now..

If we managed to peak even a hint of an interest for AWS among you, then we have just the place for you:

● Of Course wikipedia pages and the AWS Documentation are the best places to start , but there is more…..

AWS has "Pop-up Lofts" in different locations around the world.[These market AWS to entrepreneurs and startups in different tech industries in a physical location. Visitors can work or relax inside the loft, or learn more about what they can do with AWS.

Get started with the AWS Free TierThe AWS Free Tier enables you to gain free, hands-on experience with the AWS platform, products, and services.

Amazon Elastic Compute Cloud (Amazon EC2): 750 hours per month of Linux, RHEL, or SLES t2.micro instance usage or 750 hours per month of Windows t2.micro instance usage

Amazon Simple Storage Service(Amazon S3): 5 GB of Amazon S3 standard storage, 20,000 Get Requests, and 2,000 Put Requests

Pricing of AWS

AWS Philosophy ::You pay as you go, pay for what you use, pay less as you use more, and pay even less when you reserve capacity.

Comparative study

Having gotten a glimpse of the 3 major cloud platforms, a good time to stop.

Market Share Scenario

Why is AWS most popular ?● Early entry into cloud market.● Frequent updates and introduction of new services (1300+

changes since 2017).● Huge capacity means timely solutions for your business

challenges (read in future tense).● Automatically match load demands on your critical, high

volume applications: ADAPTABILITY● Best Customer Support (or so it claims).

CONTINUING ● Aside from budgetary reasons, companies could realistically “set and

forget” all their computing needs.● AWS currently has dozens of data centers across the globe which are

continuously monitored and strictly maintained.● AWS has tried to keep their data centers as hidden as possible,

locating them in out-of-the-way locations and allowing access only on an essential basis.

● For existing companies, Amazon provides low-cost migration services so that your existing infrastructure can be seamlessly moved over to AWS.

● AWS is great for building a business from scratch as it provides all the tools necessary for companies to “start up” with the cloud.

More Reason for Popularity

Bundesliga promises advanced stats with AWS dealIn a bid to boost engagement, the Bundesliga ‘powered by AWS’ statistics will offer fans a new digital user experience and visualisations. Using Amazon’s SageMaker machine learning tool to track live streams and tap historical data, the Bundesliga is hoping to offer fans real-time predictions on when a goal is likely to be scored, identify potential goal-scoring opportunities, as well as highlight how teams are controlling play via an AWS advanced statistics platform.

Hopefully not long before the Bundesliga comes calling for us !!!

What to choose?Several organizations want to do a comparison of AWS and Azure before they can make their decision to move to cloud based environment. However, the reality is that this is not a technology decision. Both AWS and Azure are solid performers with equivalence in almost 99% of the use cases.

Choosing between Azure and AWS is a more of a business decision and depends on the requirements of the organization.

For example, if an organization is in need of a strong Platform-as-a-service (PaaS) provider or needs Windows integration, Azure would be the preferable choice while if an enterprise is looking for infrastructure-as-a-service (IaaS ) or diverse set of tools then AWS might be the best solution.

AWS and Azure offer largely the same basic capabilities around flexible compute, storage, networking and pricing. Both share the common elements of a public cloud – autoscaling, self-service, pay-as-u-go pricing, security.

Let’s understand in detail, the key differences between them.

55-60%

AWS vs Azure Pricing

With increasing competition amongst cloud service providers, there has been a continued downward trend on prices since quite some time now. AWS and Azure offer free introductory tiers with restricted usage limits that let users try and use their services before they can buy.

● AWS provides pay-as-you-go model and charges per hour while Azure’s pricing model is also pay-as-you-go , they charge per minute.

● AWS can help you save more with increased usage- the more you use, the less you pay.

● Azure offers short term commitments to its users allowing them to choose between pre-paid or monthly charges. Azure is a little less flexible than AWS when it comes to pricing model.

Cost is a major factor of attraction for organizations planning to move to the cloud.

AWS vs Azure Storage

● AWS’ storage services are longest running , however, Azure’s storage capabilities are also extremely reliable.

● Both Azure and AWS are strong in this category and include all the basic features such as REST API access and server-side data encryption.

● "Reliable" is the primary reason why developers consider Amazon S3 over the competitors, whereas "All-in-one storage solution" was stated as the key factor in picking Azure Storage.

AWS vs Azure Database

All software applications today require a database to save information. Azure and AWS both provide database services, regardless of whether you need a relational database or a NoSQL offering.

● Amazon’s RDS (Relational Database Service ) and Microsoft’s equivalent SQL Server database both are highly available and durable

● When you consider interface, Azure has a friendlier or a smoother one whereas AWS provides better provisioning with more instances.

Final ScoreBoth Cloud platforms as seen above show potent capabilities and it is difficult to pick a clear winner. Azure is great

when it comes to Hybrid Cloud and integrating with Microsoft stack of products, whereas AWS has more flexibility

and extra features

THANK YOU