internet of things, from datastream to insight · your internet of things: from data stream to...

Your Internet of Things: from data stream to insight

Technology Day 2015

Tim Jacobs Geert Baeke

Presenting the presenters

Machine Learning

Structure of today’s talk

GenerateData

CaptureData

AnalyzeData

VisualizeData

Agenda

•Data Generation & Capturing

•Data Analytics & Visualization

•Machine Learning

•Conclusions

We will be flooded by huge amounts of devices, generating even bigger amounts of data.

Internet of Things

Source: ITU-T Y.2060 / Internet of Things Global Standards Initiative – http://www.itu.int/en/ITU-T/gsi/iot/

The Internet of Things (IoT) is the [dynamic] network of physical objects or "things" embedded with electronics, software, sensors, and network connectivity,

which enables these objects to collect and exchange data.

Place

Time

Thing

Devices, protocols, OS’s & standards

Device Types

• Specific(“Industrial”)

• Generic (“Consumer”)

Protocols

• WiFi

• RF (ZigBee, Z-Wave, …)

• Bluetooth (BLE, iBeacon, Eddystone)

• Cellular

• Sigfox/Neul/LoRaWAN

OS’s

• Device specific

• *nix variants

• Windows 10 IoT Core

Standards

• HTTP

• XMPP

• CoAP

• AMQP

• MQTT

• STOMP

• DDS

• VSCP

• …

communication application

IoT deployment architectures

Communication Endpoint

Device 1

Device 2

Device 3

disconnected mode gateway mode standalone mode

Device 1

Device 2

Device 3

Device 1

Device 2

Device 3

Local Gateway

IoT data reception

• Third party on-premises platforms

• Your own platform

•Public Cloud-based offerings:• Azure IoT/Event Hubs & Stream Analytics• Amazon Kinesis• Citrix Octoblu• …

Let’s see if this gets you excited…

Demo: data generation & capturing

Demo: data generation & capturing

RPi2 Weather Station

Blob Storage

Advanced Analytics

PowerBIEnd-user Analytics

Stream Analytics

IoT/Event Hub

Microsoft Azure

Service Bus

Queue

Custom Applications

Agenda

•Data Generation & Capturing

•Data Analytics & Visualization

•Machine Learning

•Conclusions

Data: from BI to analytics

Standard reports

Ad-hoc reports

Query & drilldown

Alerts

Statistical analysis

Forecasting/extrapolation

Predictive modeling

Optimization

Degree of intelligence

Va

lue

Sta

nd

ard

An

aly

tics

Ad

van

ced

An

aly

tics

What happened?

How many? How often? Where?

Where exactly is the problem?

What actions are needed?

Why is this happening?

What if these trends continue?

What will happen next?

What is the best that can happen?

Traditional BI questionsTraditional tooling:

ETL Tools, SQL, Reporting Services & friends

New type of questionsNew tooling: NoSQL,

NewSQL, MapReduce, statistical software, ...

How to store?

How to capture?

How to process?

How to visualize?

How to analyze?

How to report on?

Azure Data Lake

Demo: data analytics & visualization

Providing insights…. Minion style

Demo: data analytics & visualization

RPi2 Weather Station

Blob Storage

Service Bus

Queue

Advanced Analytics

Custom Applications

Stream Analytics

Microsoft Azure

IoT/Event Hub

PowerBIEnd-user Analytics

Agenda

•Data Generation & Capturing

•Data Analytics & Visualization

•Machine Learning

•Conclusions

Computer

Input Data

Program

Output

Computer

Input Data

Output

Program

TraditionalProgramming

Machine Learning

Machine Learning Paradigm

SELECT customers.ID

FROM customers

LEFT JOIN orders ON customers.ID = orders.customer

LEFT JOIN products ON products.id = orders.product

GROUP BY customers.ID

HAVING orders.date > GETDATE() – 30

AND orders.category = ‘MOVIES’

AND SUM(orders.price) > 100

OR products.description LIKE ‘%MINION%’

OR products.category LIKE ‘%ANIMATION%’

Hey Geert, the new “Minions” movie is available on BluRay with a 40% discount!“ ”

SELECT customers.ID

FROM customers

LEFT JOIN orders ON customers.ID = orders.customer

LEFT JOIN products ON products.id = orders.product

GROUP BY customers.ID

HAVING orders.date > GETDATE() – 30

AND orders.category = ‘MOVIES’

AND SUM(orders.price) > 100

OR products.description LIKE ‘%MINION%’

OR products.category LIKE ‘%ANIMATION%’

Hey Geert, the new “Minions” movie is available on BluRay with a 40% discount!“ ”

90

Use Machine Learning to identify your business logic in your data!

Demo: Machine Learning

Dunno what that guy is talking about, but after this we can have a drink!

Demo: Machine Learning

Blob Storage

Service Bus

Queue

Advanced Analytics

Custom Applications

Microsoft Azure

PowerBIEnd-user Analytics

RPi2 Weather Station

Stream Analytics

IoT/Event Hub

Agenda

•Data Generation & Capturing

•Data Analytics & Visualization

•Machine Learning

•Conclusions

Conclusions

• IoT is more than just hardware, it’s an entire ecosystem.

• Value in data is both in:• Aggregated / historical data

• Realtime data

• Machine Learning helps to go from reactive to proactive decision making based on your data

• Time to value is shorter in the public cloud

How can Xylos help?

Data Strategy

Data Architecture

Data Analytics

Data Platform

Xylos Cloud ServicesXylos Cloud Services

Xylos Cloud Services