building and running your first machine learning...

23
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Constantin Gonzalez Principal Solutions Architect, Amazon Web Services Building and running your first Machine Learning application on Amazon SageMaker

Upload: others

Post on 20-May-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Constantin Gonzalez

Principal Solutions Architect, Amazon Web Services

Building and running your first Machine

Learning application on Amazon

SageMaker

Page 2: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

What you’ll get out of this session

• An overview of the Machine Learning (ML) process

• An overview of Amazon SageMaker

• Examples for:

• Using Jupyter Notebooks

• Feature extraction and data preparation in Python

• ML algorithms available in Amazon SageMaker

• Building, training and deploying ML models

• Hands-on

• Opportunities for Q&A

Page 3: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Overview

Page 4: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Long history of ML at Amazon

Personalized

recommendations

Inventing

entirely new

customer

experiences

Fulfillment

automation and

inventory

management

Drones Voice-driven

interactions

Page 5: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Machine Learning at AWS

Our mission:

Put machine learning in the hands of every developer and

data scientist

Page 6: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

The Amazon Machine Learning stack

Frameworks & Infrastructure

Platform Services

Application Services

Page 7: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Bottom layer: frameworks & interfaces

NVIDIA

Tesla V100 GPUs

P3

AWS Deep Learning AMI

5,120 tensor cores

128 GB of memory

1 petaflop of compute

NVLink 2.0

~14X faster than P2

Page 8: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

The Amazon Machine Learning stack

Frameworks & Interfaces

Platform Services

Application Services

Caffe2 CNTKApache

MXNetPyTorch TensorFlow Torch Keras Gluon

AWS Deep Learning AMIs

Page 9: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Amazon SageMaker

End-to-End

Machine Learning

Platform

Zero setup Flexible Model

Training

Pay by the second

$

Build, train, and deploy machine learning models at scale

Page 10: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

The Amazon Machine Learning stack

Frameworks & Infrastructure

Platform Services

Application Services

Caffe2 CNTKApache

MXNetPyTorch TensorFlow Torch Keras Gluon

AWS Deep Learning AMIs

Amazon SageMaker AWS DeepLens

Page 11: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Amazon ML application services

Vision Speech Language

Amazon Rekognition

Amazon Rekognition

Video

Amazon Polly

Amazon Transcribe

Amazon Lex

Amazon Translate

Amazon Comprehend

Page 12: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

The Amazon Machine Learning stack

Frameworks & Infrastructure

Platform Services

Application Services

Caffe2 CNTKApache

MXNetPyTorch TensorFlow Torch Keras Gluon

AWS Deep Learning AMIs

Amazon SageMaker AWS DeepLens

Amazon

RekognitionAmazon Polly

Amazon

TranscribeAmazon Lex

Amazon

Translate

Amazon

Comprehend

Page 13: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Data Visualization &

Analysis

Business Problem –

ML problem framing Data Collection

Data Integration

Data Preparation &

Cleaning

Feature Engineering

Model Training &

Parameter Tuning

Model Evaluation

Are Business

Goals met?

Model Deployment

Monitoring &

Debugging

– Predictions

YesNo

Data

Au

gm

en

tati

on

Featu

re

Au

gm

en

tati

on

Re-training

The Machine Learning process

Page 14: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

End-to-End

Machine Learning

Platform

Zero setup Flexible Model

Training

Pay by the second

$

Build, train, and deploy machine learning models at scale

Amazon SageMaker

Page 15: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Hands On!

Page 16: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Step 1: Create your notebook instance

Page 17: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Step 2: Load, visualize and prepare Data

Page 18: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Step 3: Train your model

Page 19: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Step 4: Inference

Page 20: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Next Steps

• Explore Amazon SageMaker built-in algorithms

• Build you ML endpoint into your web/mobile/IoT app

• Deploy your ML model to IoT devices using Amazon

Greengrass ML inference

• Collect new ground truth data from production

• Run A/B tests to find the best model

• Build automated data -> train -> deploy workflows

• Amazon CodePipeline, AWS Step Functions, etc.

• Use Amazon Mechanical Turk to help label your data

• Combine multiple ML models into an ML pipeline

Page 21: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Build something cool on Amazon SageMaker

• Getting started with Amazon SageMaker:

https://aws.amazon.com/sagemaker/

• Use the Amazon SageMaker SDK:

• For Python: https://github.com/aws/sagemaker-python-sdk

• For Spark: https://github.com/aws/sagemaker-spark

• SageMaker Examples: https://github.com/awslabs/amazon-sagemaker-

examples

• Let us know what you build!

Page 22: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Please complete the session survey in

the summit mobile app.

Page 23: Building and running your first Machine Learning ...aws-de-media.s3.amazonaws.com/images/AWS_Summit_2018/June… · The Amazon Machine Learning stack Frameworks & Infrastructure Platform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

Thank You!