from iot security to nrt compute in the rules...

26
From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan Metzner , Specialist Solutions Architect IoT, EMEA @janmetzner

Upload: others

Post on 03-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

From IoT Security to NRT Compute in the Rules Engine inside AWS IoTJan Metzner,Specialist Solutions Architect IoT, EMEA

@janmetzner

Page 2: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

WhattoExpectfromtheSession

• Bring Devices Online Everywhere on the Globe• React instantly on incoming Data• IoT Rules Engine insights• IoT Streaming Analytics Globally• Central IoT Data Lake

Page 3: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT Recap

Page 4: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT Recap

Page 5: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT Recap

Page 6: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT Recap

Page 7: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT Recap

Page 8: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT Recap

Page 9: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT Recap

Page 10: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT – Connect Billions of Things – Globally

Page 11: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Just-In-Time Registration

ManufacturingLine

ProvisioningoftheIdentitiessignedwithCustomersCA

FirstDataConnection

JITRegistration

Page 12: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Just-In-Time Registration – ProvisioningCustomersHardwareSecurityModule(HSM) CS

R

CSR

CSR

Page 13: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Just-In-Time Registration – CA Registration

getRegistrationCode()

CustomersHardwareSecurityModule(HSM) CS

R

CSR

CSR

registerCACertificate(CACert,RegCert)

Page 14: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Just-In-Time RegistrationCustomersHardwareSecurityModule(HSM)

checkYourCRL()updateCertificate(Cert, ACTIVE)attachPrincipalPolicy(Cert, IoTPolicy)updateERP()

FunctionhandlingPENDING_ACTIVATIONState

Page 15: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

AWS IoT – Rules Engine

Page 16: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Rules engine

Page 17: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Rules engine: Extracting value from messages

• Filter messages with certain criteria

• Transform the payload of messages

• React based on messages• Move messages to other topics• Move messages to other systems

• Predict changes based on trends

Page 18: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Rules engine: Move messages to other systems

InvokeaLambda function

PutobjectinanS3bucket

Insert,updateaDynamoDB table

PublishtoanSNStopicorendpoint

PublishtoanAmazonKinesisstream(andtoEMRandSpark)

PublishtoFirehose

RepublishtoAWSIoT

PublishtoAmazonES

CaptureaCloudWatchmetricorchangeanalarm

WritetoSQSqueue

Page 19: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

A rule in AWS IoT

aws iot create-topic-rule --rule-name WindFarmData --topic-rule-payload {

"sql": "SELECT datapoint_id, current, rotation_speed, location,topic(2) as turbine_id, timestamp() as time,

FROM 'wind-farm/+/data'","description": "Save data from wind turbines into Elasticsearch","actions": [

{"elasticsearch": {

"roleArn": "arn:aws:iam::123456789012:role/aws_iot_windfarm","endpoint": "https://my-es-endpoint.eu-west-1.es.amazonaws.com","index": "turbine-data","type": "measurement","id": "${CONCAT(datapoint_id, '_', turbine_id)}"

}}]}

RouteFilter,transform

Page 20: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Live Demo

Page 21: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

IoT – Streaming Analytics

Page 22: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

IoT – Global Data Collection – Where to Process the Data

Page 23: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Example Data Flow with AWS IoT

Amazon S3

AmazonDynamoDB

Kinesis Analytics(Time Series Aggregation)

Kinesis Stream(Buffer)

IoT

InstantReaction

PostProcessing

optimize

Machine Learning

Lambda

Firehose(Buffer + Batch)

EMR(Hadoop/Spark/Presto)

Lambda

Machine Learning

optimize

Page 24: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Global Data Ingest and Processing

IngestRegion ProcessingRegion

StorageRegion

Page 25: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Live Demo

Page 26: From IoT Security to NRT Compute in the Rules …aws-de-media.s3.amazonaws.com/images/_Munich_Loft_Slides/...From IoT Security to NRT Compute in the Rules Engine inside AWS IoT Jan

Now Build a Global IoT Solution!