energy management with aws - · pdf filearchitecture data backups integrated app deployments...

30
Tampa Convention Center • Tampa, Florida Energy Management with AWS Kyle Hart and Nandakumar Sreenivasan Amazon Web Services August [XX], 2017

Upload: lenhan

Post on 17-Mar-2018

220 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Tampa Convention Center • Tampa, Florida

Energy Management with AWSKyle Hart and Nandakumar Sreenivasan

Amazon Web ServicesAugust [XX], 2017

Page 2: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

On-Demand Self

Service

“A consumer can unilaterally provision computing capabilities, such as server time and network storage, as needed automatically without requiring human interaction with each service provider.”

What is Cloud? The NIST Definition

Resource

Pooling

“The provider’s computing resources are pooled to serve multiple consumers using a multi-tenant model, with different physical and virtual resources dynamically assigned and reassigned according to consumer demand.”

Rapid

Elasticity

“Capabilities can be elastically provisioned and released, in some cases automatically, to scale rapidly outward and inward commensurate with demand. To the consumer, the capabilities available for provisioning often appear to be unlimited and can be appropriated in any quantity at any time.”

Measured

Service

“Cloud systems automatically control and optimize resource use by leveraging a metering capability appropriate to the type of service. Resource usage can be monitored, controlled, and reported, providing transparency for both the provider and consumer.”

Broad Network

Access

“Capabilities are available over the network and accessed through standard mechanisms that promote use by heterogeneous thin or thick client platforms (e.g., mobile phones, tablets, laptops, and workstations).“

Private ? ? X X ?

Commercial ✔ ✔ ✔ ✔ ✔

Page 3: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

Benefits of the AWS Cloud

?Move from operational

to variable costLower variable cost than most companies

can achieveNo need to guess

capacity

Agility, speed & innovation

Remove undifferentiated heavy lifting

Go global in minutes

Page 4: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

AWS Global Infrastructure

16 Regions

42 Availability Zones

73 Edge Locations

Page 5: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve5

Long-term commitment to achieve

100%RENEWABLE ENERGY

Page 6: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

Page 7: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

Page 8: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

Page 9: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

A M A Z O N S O L A R F A R M E A S T

A M A Z O N W I N D F A R M U S E A S T

A M A Z O N W I N D F A R M F O W L E R R I D G E

A M A Z O N W I N D F A R M U S C E N T R A L 2

A M A Z O N W I N D F A R M U S C E N T R A L

A M A Z O N S O L A R F A R M U S E A S T 3

A M A Z O N S O L A R F A R M U S E A S T 4

A M A Z O N S O L A R F A R M U S E A S T 5

A M A Z O N S O L A R F A R M U S E A S T 6

A M A Z O N S O L A R F A R M U S E A S T 2

Page 10: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

AWS Projects bring online 907MW of new renewable generation

Page 11: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

Page 12: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

Power Consumption with AWS

• On average, customers consume 77% fewer servers

• Cloud customers consume 84% less power

• Cloud customers reduce carbon emissions by 88% vs traditional data center

https://aws.amazon.com/blogs/aws/cloud-computing-server-utilization-the-environment/

12

Page 13: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Energy Exchange: Connect • Collaborate • Conserve

ENTERPRISE APPS

DEVELOPMENT & OPERATIONSMOBILE SERVICESAPP SERVICESANALYTICS

DataWarehousing

Hadoop/Spark

Streaming Data Collection

Machine Learning

Elastic Search

Virtual Desktops

Sharing & Collaboration

Corporate Email

Backup

Queuing & Notifications

Workflow

Search

Email

Transcoding

One-click App Deployment

Identity

Sync

Single Integrated Console

PushNotifications

DevOps Resource Management

Application Lifecycle Management

Containers

Triggers

Resource Templates

TECHNICAL & BUSINESS SUPPORT

Account Management

Support

Professional Services

Training & Certification

Security & Pricing Reports

Partner Ecosystem

Solutions Architects

MARKETPLACE

Business Apps

Business Intelligence

DatabasesDevOps Tools

NetworkingSecurity Storage

RegionsAvailability Zones

Points of Presence

INFRASTRUCTURE

CORE SERVICES

ComputeVMs, Auto-scaling, & Load Balancing

StorageObject, Blocks, Archival, Import/Export

DatabasesRelational, NoSQL, Caching, Migration

NetworkingVPC, DX, DNS

CDN

Access ControlIdentity Management

Key Management & Storage

Monitoring & Logs

Assessment and reporting

Resource & Usage Auditing

SECURITY & COMPLIANCE

Configuration Compliance

Web application firewall

HYBRID ARCHITECTURE

Data Backups

Integrated App Deployments

DirectConnect

IdentityFederation

IntegratedResource Management

Integrated Networking

API Gateway

IoT

Rules Engine

Device Shadows

Device SDKs

Registry

Device Gateway

Streaming Data Analysis

Business Intelligence

MobileAnalytics

AWS: Comprehensive Infrastructure Services Platform with 90+ services

Page 14: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Three pillars of IoT

ThingsSense

& Act

CloudStorage

& Compute

IntelligenceInsights &

Logic → Action

Page 15: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

ThingsSense

& Act

CloudStorage

& Compute

IntelligenceInsights &

Logic → Action

AWS IoT

Starting in the cloud

Action

Device

State

AWS Services

Applications

Authentication

& AuthorizationDevice

Gateway

Registry

AWS IoT API

Messages Messages

Page 16: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

AWS IoT Strengths

• Focus on Security, End to End

• It’s a Serverless, managed service

• Built on modern architecture:

messages, events, rules, functions – at

scale

• Front door to all of AWS

• Any Chipset

• Any Operating System

• Protocol Agnostic

• Cost follows usage

Page 17: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Most machine data never reaches the cloud

Medical equipment Industrial machinery Extreme environments

Page 18: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Why this problem isn’t going away

Law of physics Law of economics Law of the land

Page 19: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

AWS Greengrass

Cloud

AWS Greengrass extends AWS onto your devices, so they can act locally on

the data they generate, while still taking advantage of the cloud.

Page 20: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Messages Messages

Authentication

& AuthorizationDevice

Gateway

Action

Device

State

AWS Services

Applications

Registry

AWS IoT API

AWS IoT

Going to the edge

Introducing AWS Greengrass

Device

State

Action

Device

Gateway

Messages

Authentication

& Authorization

Security

Page 21: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Benefits of AWS Greengrass

Respond to local events quickly

Operate offline

Simplified device programming

Reduce the cost of IoT applications

Page 22: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

ThingsSense

& Act

IntelligenceInsights &

Logic → Action

AWS IoT

Messages Messages

Authentication

& AuthorizationDevice

Gateway

Action

Device

State

AWS Services

Applications

Registry

AWS IoT API

Intelligence in the cloud

Page 23: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

AWS IoT

Data driven decisions,

value from insights

• Rules engine integration of

Amazon Machine

Learning (AML)

AWS ElasticSearch

& Kibana (ELK)

• Dashboards

IntelligenceInsights &

Logic → Action

Getting smarter

Page 24: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Our Full IoT Platform Is All Of AWS

Amazon Lex Amazon Polly Amazon

Rekognition

Amazon Machine

Learning

Amazon

EMR

Amazon

Kinesis

Amazon

AthenaAmazon

Redshift

Amazon

DynamoDBAmazon

ElastiCacheAWS

Lambda

Amazon API

Gateway

Big Data & Analytics

AI Services

Applications

Page 25: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Amazon Kinesis StreamsBuild your own data streaming applications

Easy administration: Simply create a new stream, and set the desired level of

capacity with shards. Scale to match your data throughput rate and volume.

Build real-time applications: Perform continual processing on streaming big data

using Kinesis Client Library (KCL), Apache Spark/Storm, AWS Lambda, and more.

Low cost: Cost-efficient for workloads of any scale.

Page 26: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Amazon Kinesis FirehoseLoad massive volumes of streaming data into Amazon S3, Redshift and Elasticsearch

Zero administration: Capture and deliver streaming data into Amazon S3, Amazon Redshift,

and other destinations without writing an application or managing infrastructure.

Direct-to-data store integration: Batch, compress, and encrypt streaming data for delivery

into data destinations in as little as 60 secs using simple configurations.

Seamless elasticity: Seamlessly scales to match data throughput w/o intervention

Serverless ETL using AWS Lambda - Firehose can invoke your Lambda function to transform

incoming source data.

Capture and submit

streaming data

Analyze streaming data using

your favorite BI tools Firehose loads streaming data

continuously into Amazon S3, Redshift

and Elasticsearch

Page 27: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Amazon Kinesis Firehose vs. Amazon Kinesis

Streams

Amazon Kinesis Streams is for use cases that require custom

processing, per incoming record, with sub-1 second processing

latency, and a choice of stream processing frameworks.

Amazon Kinesis Firehose is for use cases that require zero

administration, ability to use existing analytics tools based on

Amazon S3, Amazon Redshift and Amazon Elasticsearch, and a

data latency of 60 seconds or higher.

Page 28: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Combining power of AWS IoT & Alexa

Alexa Voice

Services

Amazon

EchoAlexa

Skills KitIoT Apps, Back

End System, Big

Data, Machine

Learning, Storage

Companion

Apps

Lambda

AWS IoT

Voice Control

• Alexa - With the Alexa Skills Kit,

you can easily build and add your

own skills to Alexa.

• AWS IoT manages the connection

devices and integration with ASK,

as well as other backend systems

and companion apps.

• Build skills for Alexa using AWS

Lambda. Simply write the code

using and upload it as a Lambda

function.

• Alexa Voice Service brings voice-

powered experiences to any

connected devices.

Devic

e

Co

nn

ec

tio

n

Page 29: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

Amazon Lex, Amazon Polly Build conversational apps

Page 30: Energy Management with AWS -   · PDF fileARCHITECTURE Data Backups Integrated App Deployments ... Lambda Amazon API Gateway ... Amazon Redshift and Amazon Elasticsearch, and a

• Leveraging AWS IoT for

connecting millions of smart

meters and exposing their data

to several applications running

in AWS

• Includes C3 IoT for grid

monitoring, fraud detection, and

energy maintenance.

Problem To Solve:

Next Generation Smart Meters