how ai connect dots for iot

How AI connects the dots for IoT:Augmenting IoT Solutionswith Artificial Intelligence

Danilo Poccia, Technical Evangelist@danilop

Credit: Gerry Cranham/Fox Photos/Getty Imageshttp://www.telegraph.co.uk/travel/destinations/europe/united-kingdom/england/london/galleries/The-history-of-the-Tube-in-pictures-150-years-of-London-Underground/1939-ticket-examin/

1939 London Underground


1939 London Underground


IoT

Big DataMachine Learning

One of the big challenges with the IoT is to

Collect Analyze Act on

data from devices to generate insights.

AWS IoT

Customer Success – Philips HealthcareIoT on AWS to collect and act on critical data across different devices

Philips is a leading health-tech company, working to create a new era of connected and personalized digital health and care..

With the addition of AWS IoT, we will greatly accelerate the pursuit of our vision by making it easy to acquire,

process, and act on data from heterogeneous devices in real time.

• AWS gives Philips customers greater control of their health with connected digital health solutions that support healthy living and improved care coordination.

• HealthSuite, powered by AWS, is a digital platform that manages more than 7 million connected medical-grade, consumer devices, sensors and mobile apps

• The Philips HealthSuite digital platform analyzes and stores 15 PB of patient data from 390 million imaging studies, medical records, and patient inputs.

• AWS provides the reliability, performance and scalability that Philips needs to help protect patient data which grows by petabyte/month.

Jeroen TasCEO Healthcare Informatics Solutions and Services, Philips

”

“

Customer Success – SONOSIncrease the Value of a Product Over Time with Data Telemetry and Usage Data

All the music on earth, in every room of your home, wirelessly. Sonos is the smart speaker system that streams all your favorite music to any room, or every room. Control your music with one simple app, and fill your home with

pure, immersive sound.

“A 10 year old product can do things that hadn’t been invented 10 years

ago. Most importantly, going forward, people will expect your product to

improve, and if it isn’t being updated and getting better, you’re literally

being left behind.”

Jon CotterSr. Software Development Manager,

”

“ • Utilizes AWS to collect, store, and process performance metric data and reports for individual speaker systems.

• Can monitor the quality of speakers in the field, and dramatically add new functionality to existing speakers without refreshing hardware.

• Launching Trueplay: a Smart Speaker Tuning services that measures the acoustics in any room and fine-tunes your speaker.

• Launching in 2015 yet available to devices purchased over 5 years ago

“We launched Hive towards the end of 2013 and today we have 75,000

customers… The speed at which we delivered Hive is directly related to our

decision to use AWS cloud”

Seb ChakrabortyHead of Web and Platform Design

• British Gas started a project called Hive, part of its Connected Homes Strategy.

• Hive Active Heating allows users to control heating and hot water remotely from mobile, laptop or smartphones.

• Such a flexibility allows users to control heating exactly how they need it and save up to £150 a year on utility bills

Customer Success – British Gas Brings central heating control to smartphones with AWS

British Gas uses AWS cloud for scaling the project and to deliver API toolsets around it.

”

“

IoT Devices Have Limited Resources On Board

Challenges Of Devices Living On The Edge

Round-trip latency

Intermittent connectivity

Expensive bandwidth

Programming and updating embedded software needs specialized skills

Limited to what is on the device unless you rewrite or program the device

AWS Greengrass: Local Compute, Messaging & Data Caching

Local compute

Local data caching

Securecommunications

Local messaging

Benefits of AWS Greengrass

Respond to local events quickly

Operate offline

Simplified device programming

Reduce the cost of IoT applications

Amazon Greengrass: Example Use Cases

Smart Homes Agriculture Manufacturing

AWS Snowball

How to maximize the capabilities of IoT devices?

Usually IoT devices have significant limitations in terms of processing power, memory and interfaces

Artificial Intelligence & Deep Learning At AmazonThousands Of Employees Across The Company Focused on AI

Discovery &Search

Fulfilment &Logistics

Add ML-poweredfeatures to existing products

Echo &Alexa

Artificial Intelligence on AWS

P2, F1 &Elastic GPUs

Deep LearningAMI and template

Investment inApache MXNet

Apache MXNet

Deep Learning Frameworks

MXNet, Caffe, Tensorflow, Theano, Torch, CNTK and Keras

Pre-installed components to speed productivity, such as Nvidia drivers, CUDA,

cuDNN, Intel MKL-DNN with MXNet, Anaconda, Python 2 and 3

AWS Integration

Deep Learning AMI

Amazon AIBringing Powerful Artificial Intelligence To All Developers

Amazon RekognitionImage Recognition And Analysis

Powered By Deep Learning

1

Amazon RekognitionDeep learning-based image recognition serviceSearch, verify, and organize millions of images

Object and SceneDetection

FacialAnalysis

FaceComparison

FacialRecognition

Image Moderation

Amazon Rekognition: Images In, Categories and Facial Analysis Out

Amazon Rekognition

Car

Outside

Daytime

Driving

Objects & Scenes

Female

Smiling

Sunglasses

Face ID

DetectLabelsDetectFaces

DetectModerationLabels

CompareFaces

IndexFacesSearchFacesByImage

Faces

Bynder allows you to easily create, find and use contentfor branding automation and marketing solutions.

With our new AI capabilities, Bynder’s software… now allows

users to save hours of admin labor when uploading and

organizing their files, adding exponentially more value.

Chris HallCEO, Bynder

”

“With Rekognition, Bynder revolutionizes marketing admin tasks with AI capabilities

Artfinder is building a world where artistscan make a living doing what they love.

While our artists are able to give us descriptions, our users may

want to search in ways the artist hasn’t thought of. We use

Rekognition to obtain objective labels about an artwork based

on its imagery.

David TilleyshortCTO, Artfinder ”

“With both Rekognition and Amazon ML, Artfinder was able to very rapidly prototype advance

machine learning techniques, with minimum developer time and no upfront infrastructure costs

• A growing catalogue of 300,000 artwork pieces – and visual search a key part of that.

• Even though Rekognition was designed to be used for photography, they have been able to get some interesting results across their inventory of paintings, handmade prints, sculptures, collages, drawings and photography.

Amazon PollyText To Speech Powered By Deep Learning

2

Amazon Polly: Text In, Life-like Speech Out

Amazon Polly

“The temperature in WA is 75°F”

“The temperature in Washington is 75 degrees

Fahrenheit”

47 voices spread across 24 languages

TEXT

Marketgrewby>20%.WORDSPHONEMES

{ { { { {ˈtwɛn.tipɚ.ˈsɛntˈmɑɹ.kət ˈgɹu baɪ ˈmoʊɹ

ˈðæn

PROSODYCONTOURUNITSELECTIONANDADAPTATION

TEXTPROCESSING

PROSODYMODIFICATIONSTREAMING

Market grew by morethan

twentypercent

Speechunitsinventory

aws polly synthesize-speech--text "It was nice to live such a wonderful live show."--output-format mp3--voice-id Joanna--text-type textoutput.mp3

Duolingo voices its language learning service Using Polly

Duolingo is a free language learning service where users help translate the web and rate translations.

With Amazon Polly our users benefit from the most lifelike

Text-to-Speech voices available on the market.

Severin HackerCTO, Duolingo

”

“ • Spoken language crucial for language learning

• Accurate pronunciation matters

• Faster iteration thanks to TTS

• As good as natural human speech

”

“

Royal National Institute of Blind People creates and distributes accessible information in the form of

synthesized content

Amazon Polly delivers incredibly lifelike voices which

captivate and engage our readers.

John WorsfoldSolutions Implementation Manager, RNIB

• RNIB delivers largest library of audiobooks in the UK for nearly 2 million people with sight loss

• Naturalness of generated speech is critical to captivate and engage readers

• No restrictions on speech redistributions enables RNIB to create and distribute accessible information in a form of synthesized content

RNIB provides the largest library in the UK for people with sight loss

Amazon ALEXA(It’s what’s inside Alexa)

3

Natural Language Understanding (NLU) & Automatic Speech Recognition (ASR) Powered By Deep Learning

The Advent Of Conversational Interactions

1st Gen: Machine-oriented interactions



2nd Gen: Control-oriented& translated



2nd Gen: Control-oriented& translated

3rd Gen: Intent-oriented

Amazon Lex: Speech Recognition & Natural Language Understanding

Amazon LexAutomatic Speech Recognition

Natural Language Understanding

“What’s the weather forecast?”

WeatherForecast

Amazon Lex: Speech Recognition & Natural Language Understanding

Amazon LexAutomatic Speech Recognition


“What’s the weather forecast?”

“It will be sunny and 25°C”

WeatherForecast

Hotel BookingCity New York CityCheck In Nov 30th

Check Out Dec 2nd

Hotel BookingCity New York CityCheck In

Check Out

“Book a Hotel”

Book HotelNYC

“Book a Hotel in NYC”

Automatic Speech Recognition

Hotel Booking

New York City


Intent/Slot Model

Utterances

“Your hotel is bookedfor Nov 30th”

Polly Confirmation: “Your hotel is booked for Nov 30th”

ain

“Can I go ahead with the booking?”

”

“ Finding missing persons:~100,000 active missing

persons cases in the U.S.at any given time~60% are adults,

~40% are children

• Motorola Solutions applies Amazon Rekognition, Amazon Polly and Amazon Lex

• Image analytics and facial recognition can continually monitor for missing persons

• Tools that understand natural language can enable officers to keep eyes up and hands free

Motorola Solutions is using Amazon AI to help finding missing persons

Motorola Solutions keeps utility workers connected and visible to each other with real-time voice and data

communication across the smart grid.

I see…

AmazonRekognition

AmazonPolly

Camera

Device

VoiceSynthesize

SpeechDetect LabelsDetect Faces

Nikola Tesla, 1926

“When wireless is perfectly applied, the whole earth will be converted into a huge brain…”

Thank you!

Danilo Poccia, Technical Evangelist@danilop

how ai connect dots for iot

Business