deploying complex open source workloads on azure

43

Upload: phamkhanh

Post on 02-Jan-2017

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Deploying Complex Open Source Workloads on Azure
Page 2: Deploying Complex Open Source Workloads on Azure

Haishi BaiSENIOR SDE, TED Services & Devices

Mahesh ThiagarajanSenior Program Manager, Azure Compute

Brian BenzSenior Technical Evangelist

Deploying Complex Open Source Workloads on Azure

2-732

Page 3: Deploying Complex Open Source Workloads on Azure

Azure Loves Open SourceWhy Use OSS on AzureSample Scenarios

Agenda

Page 4: Deploying Complex Open Source Workloads on Azure

Azure Loves Open Source

Page 5: Deploying Complex Open Source Workloads on Azure

20% of Azure VM are Linux Machines

In the past year…

HDInsight runs on Linux

Azure Redis Cache

Azure Search uses Elasticsearch

Open source CoreCLR

ASP.NET and OWIN

Docker integration

Windows containersAzure Template

Marketplace

150+ Standardization bodies

AMQP

OPC

VM Depo

Page 6: Deploying Complex Open Source Workloads on Azure

OSS on Azure

Page 7: Deploying Complex Open Source Workloads on Azure

Open, broad,and flexible

Integration

On-premises AND cloud

Enterprise needs

Microsoft Azure

fundamentals

Operating

systems

Languages

CMS

Devices

Databases

Heterogeneity

Open, broad,and flexible Configuratio

nmanagement

Microsoft Azure: Your Open Cloud

“We have really made sure that [Azure] is a very open platform. It’s not just about .NET and Windows…we have the most open infrastructure. We want to thrive in this heterogeneous world when it comes to the public cloud.”

Applications

DB2

Page 8: Deploying Complex Open Source Workloads on Azure

CoreCLR on LinuxWindows Container with DockerCross-region MongoDB Replica

DEMOs

Page 9: Deploying Complex Open Source Workloads on Azure

Replica Set

West US (10.1.0.0/16)

West Europe (10.2.0.0/16)

VNet-to-VNet

Primary (10.1.0.4) Secondary (10.1.0.5) Secondary (10.2.0.4)

hbai15-mongo-t2.cloudapp.net:27000

hbai15-mongo-t1.cloudapp.net: 27000

hbai15-mongo-t3.cloudapp.net:27000

hbai15-mongo-t1 10.1.0.4hbai15-mongo-t2 10.1.0.5hbai15-mongo-t3 10.2.0.4

hbai15-mongo-t1 10.1.0.4hbai15-mongo-t2 10.1.0.5hbai15-mongo-t3 10.2.0.4

Page 10: Deploying Complex Open Source Workloads on Azure

West US (10.0.0.0/16)

Azure Blog Storage

mongodb-node.sh

custom script extension

Azure CLI

10.0.0.4 mongoh10.0.0.5 mongom10.0.0.6 mongor

Replica Set

create.sh

Page 11: Deploying Complex Open Source Workloads on Azure

Why Use OSS on Azure

Page 12: Deploying Complex Open Source Workloads on Azure

Scalable, Enterprise Grade & SecureAzure Templates support for IaaSWhy Run Oss

on Azure…

Page 13: Deploying Complex Open Source Workloads on Azure

Azure Cloud

HybridEnterprise Grade

Hyper-scale

HybridEnterprise Grade

Hyper-Scale

Page 14: Deploying Complex Open Source Workloads on Azure

VM

Cameras / Alarms24X7 security staffBarriers / Fencing

Days of backup power

Two-factor access control

Secure By DesignOperation Security ControlsCompliance Certifications

ForensicsPenetration Testing

Secure and Isolated VNetsNetwork ACLsAzure Active Directory

Multiple virtual NICsSecurity Appliances

Physical Infrastructure

Network

Anti-MalwareVM Security ExtensionsRole-Based Access Controls

Key Vault and Encryption

Logging / Auditing

VM

Trust and Control

Page 15: Deploying Complex Open Source Workloads on Azure

Resource Groups Tightly coupled containers

of multiple resources of similar or different types

Lifecycle, Access, Billing & Identity control the resources placed in a resource group

Spans multiple regions

RESOURCE GROUP

Page 16: Deploying Complex Open Source Workloads on Azure

Azure Templates can:• Ensure Idempotency• Simplify Orchestration• Simplify Roll-back• Provide Cross-Resource

Configuration and Update Support

Azure Templates are: • Source file, checked-in• Specifies resources and

dependencies (VMs, WebSites, DBs) and connections (config, LB sets)

• Parametized input/output

Instantiation of repeatable config.Configuration Resource Group

Power of Repeatability

SQL - A Website VirtualMachines

SQL-AWebsite[SQL CONFIG] VM (2x)

DEPENDS ON SQLDEPENDS ON SQL

SQLCONFIG

Page 17: Deploying Complex Open Source Workloads on Azure

Azure Templates for IaaS Stack• Complexity made Simple – Build,

integrate and deploy complex applications with ease using Azure Templates

• Build applications using IaaS & PaaS Azure Services in a single Template (For Example: Websites + VM)

• Easily Scalable Deployments using Copy & CopyIndex (Loops) in Azure RM

• Role-Based Access Control support

• Tags Configuration and billing propagation to the monthly usage bill

Page 18: Deploying Complex Open Source Workloads on Azure

Deploy <> on Azure

DEMOs

Page 19: Deploying Complex Open Source Workloads on Azure

Sample Scenarios

Page 20: Deploying Complex Open Source Workloads on Azure

LAMPSample scenarios

Page 21: Deploying Complex Open Source Workloads on Azure

Web Apps

Page 22: Deploying Complex Open Source Workloads on Azure

VM Depot• Azure VM Images• Community managed• Linux and FreeBSD images• Deploy from VM depot• Deployment scripts and tutorials• Over 1000 images• http://aka.ms/vmdepot

Page 23: Deploying Complex Open Source Workloads on Azure

Microsoft Runs Mission Critical WordPress Apps on Azure

Page 24: Deploying Complex Open Source Workloads on Azure

Deploying WordPress on Azure via Web Apps and VM Depot

DEMOs

Page 25: Deploying Complex Open Source Workloads on Azure

Azure Toolkit for Eclipse• Test with Azure Emulator• SSL• Sticky Sessions• Configure your roles

• Instance count• Size• Endpoints• Names

• Self-Signed Certs for testing• Publish to Azure

Page 26: Deploying Complex Open Source Workloads on Azure

MS Open Tech Tools Plugin for IntelliJ• Limited Java functionality compared to the

Eclipse Toolkit• Test using Azure Emulator, deploy to Azure• Configure deployment components for more advanced deployment configurations• Configure Azure storage accounts for your deployments to use• Enable sticky sessions (session affinity)• Add additional Java applications to your deployment (as WAR files)

Page 27: Deploying Complex Open Source Workloads on Azure

Deploying a Tomcat Java App to Cloud Services

DEMOs

Page 28: Deploying Complex Open Source Workloads on Azure

Sample Scenarios

Page 29: Deploying Complex Open Source Workloads on Azure

Big DataSample scenarios

Page 31: Deploying Complex Open Source Workloads on Azure

Selected customer scenarios Scenario Input Operators

(Examples) Side Lookup Output Programming Language

Connected Cars Event HubsWindow-based aggregation, join stream / split stream

HBase, ML DocumentDB C# hybrid, Java

ETL Event Hubs Partitioning / organize N/A WASB Java

IoT Event Hubs Window-based aggregation Hbase, ML DocumentDB,

Hbase Java

Fraud Detection Service Bus Queue Filter ML HBase C# hybrid

Social Analysis Twitter Group-by / trending topics N/A Realtime

Dashboard (BI) Trident

Network Monitoring Kafka Split (on success / failure) ML SQL C# hybrid

Log Search Storage Queue / Event Hubs Parsing & index N/A Elastic Search Java

Mobile Engagement Event Hubs Count HBase SignalR C# hybrid

Page 32: Deploying Complex Open Source Workloads on Azure

Emerson

Page 33: Deploying Complex Open Source Workloads on Azure

Kafka with HDInight

DEMOs

Page 34: Deploying Complex Open Source Workloads on Azure

Sample Scenarios

Page 35: Deploying Complex Open Source Workloads on Azure

Internet of ThingsSample scenarios

Page 36: Deploying Complex Open Source Workloads on Azure

OPC Virtual Compatibility Lab Architecture

VPN

VPN

HTTP

DC

OPC Test DB

Test Lab Client On-premises OPC

Server/Client

OPC Server/Client

OPC Server endpointRDP endpoint

Page 37: Deploying Complex Open Source Workloads on Azure

OPC Connector-Azure Integration

On-premises OPC Server

OPC Connector

Produce Collect Ingress Transform Store Present and Action

Event Hub

Storage Adapters

Azure Search

Azure Machine Learning

OPC Data Analysis Service (ODAS)

Azure Storage

HDInsight

Other data sources Other data sources

Batch Processes

Mobile

Web

API

OPC AMQPRedis

Page 38: Deploying Complex Open Source Workloads on Azure

OPC Foundation on Azure

DEMOs

Page 39: Deploying Complex Open Source Workloads on Azure
Page 40: Deploying Complex Open Source Workloads on Azure

azure.github.com

Page 41: Deploying Complex Open Source Workloads on Azure

msopentech.github.com

Page 42: Deploying Complex Open Source Workloads on Azure

Improve your skills by enrolling in our free cloud development courses at the Microsoft Virtual Academy.Try Microsoft Azure for free and deploy your first cloud solution in under 5 minutes!Easily build web and mobile apps for any platform with AzureAppService for free.

Resources

Page 43: Deploying Complex Open Source Workloads on Azure

© 2015 Microsoft Corporation. All rights reserved.