deeplearning and advanced machine learning on iot
TRANSCRIPT
![Page 1: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/1.jpg)
Unless stated otherwise all images are taken from wikipedia.org or openclipart.org
DeepLearning and Advanced Machine Learning on IoT@romeokienzler
![Page 2: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/2.jpg)
• Intro (what I do, what we do, why we do IoT)
• Latest advancements in AI based ML
• Demo
• Hands on
![Page 3: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/3.jpg)
![Page 4: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/4.jpg)
Why IoT (now) ?• 15 Billion connected devices in 2015
• 40 Billion connected devices in 2020
• World population 7.4 Billion in 2016
![Page 5: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/5.jpg)
![Page 6: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/6.jpg)
![Page 7: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/7.jpg)
![Page 8: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/8.jpg)
![Page 9: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/9.jpg)
![Page 10: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/10.jpg)
![Page 11: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/11.jpg)
![Page 12: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/12.jpg)
![Page 13: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/13.jpg)
![Page 14: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/14.jpg)
![Page 15: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/15.jpg)
![Page 18: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/18.jpg)
online vs. historic• Pros
• low storage costs
• real-time model update
• Cons
• algorithm support
• software support
• no algorithmic improvement
• compute power to be inline with data rate
• Pros
• all algorithms
• abundance of software
• model re-scoring / re-parameterisation (algorithmic improvement)
• batch processing
• Cons
• high storage costs
• batch model update
![Page 19: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/19.jpg)
1. API
2. pre-trained model
3. existing pipeline with your data
4. create own pipeline / model
abstraction levels
![Page 20: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/20.jpg)
IBM Watson Personality Insights
![Page 21: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/21.jpg)
IBM Watson Natural Language Classifier
![Page 22: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/22.jpg)
![Page 23: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/23.jpg)
DeepLearningDeepLearning
Apache Spark
Hadoop
![Page 24: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/24.jpg)
Neural Networks
![Page 25: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/25.jpg)
Neural Networks
![Page 26: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/26.jpg)
Deeper (more) Layers
![Page 27: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/27.jpg)
AutoEncoders
![Page 28: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/28.jpg)
AutoEncoders
![Page 29: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/29.jpg)
Convolutional
![Page 30: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/30.jpg)
Convolutional
+ =
![Page 31: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/31.jpg)
Convolutional
![Page 32: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/32.jpg)
![Page 33: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/33.jpg)
Learning of a function
A neural network can basically learn any mathematical function
![Page 34: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/34.jpg)
Recurrent
![Page 35: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/35.jpg)
LSTM
“vanishing error problem” == influence of past inputs decay quickly over time
![Page 36: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/36.jpg)
http://karpathy.github.io/2015/05/21/rnn-effectiveness/
![Page 37: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/37.jpg)
![Page 38: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/38.jpg)
![Page 39: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/39.jpg)
![Page 40: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/40.jpg)
• Outperformed traditional methods, such as• cumulative sum (CUSUM)• exponentially weighted moving average (EWMA)• Hidden Markov Models (HMM)
• Learned what “Normal” is• Raised error if time series pattern haven't been seen before
![Page 41: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/41.jpg)
![Page 42: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/42.jpg)
![Page 43: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/43.jpg)
Learning of an algorithm
A LSTM network is touring complete
![Page 44: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/44.jpg)
Problems• Neural Networks are computationally very complex• especially during training• but also during scoring
CPU (2009) GPU (2016) IBM TrueNorth (2017)
![Page 45: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/45.jpg)
IBM TrueNorth• Scalable• Parallel• Distributed• Fault Tolerant• No Clock ! :)• IBM Cluster• 4.096 chips• 4 billion neurons• 1 trillion synapses
• Human Brain• 100 billion neurons• 100 trillion synapses
• 1.000.000 neurons• 250.000.000 synapses
![Page 46: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/46.jpg)
DeepLearningthe future in cloud based analytics
Storage Layer (OpenStack SWIFT / Hadoop HDFS / IBM GPFS)
Execution Layer (Spark Executor, YARN, Platform Symphony)
Hardware Layer (Bare Metal High Performance Cluster)
GraphXStreaming SQL MLLib BlinkDBDeepLearning4J ND4J
R MLBase H2OY O U
GPUAVX
Intel Xeon E7-4850 v2 48 core, 3 TB RAM, 72 GB HDD, 10Gbps, NVIDIA TESLA M60 GPU
(cu)BLAS
jcuBLAS
S T R E A M S
![Page 47: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/47.jpg)
![Page 48: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/48.jpg)
![Page 49: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/49.jpg)
![Page 51: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/51.jpg)
![Page 52: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/52.jpg)
![Page 53: DeepLearning and Advanced Machine Learning on IoT](https://reader034.vdocuments.mx/reader034/viewer/2022052514/58ee919b1a28ab9e038b458f/html5/thumbnails/53.jpg)
• IBM Cloud Free Tier• http://ibm.biz/joinIBMCloud
• Google TPU• http://www.recode.net/2016/5/20/11719392/google-ai-chip-tpu-questions-answers
• IBM Neuromorphic Chip• http://www.research.ibm.com/articles/brain-chip.shtml
• Recoding of the Talk• https://www.youtube.com/watch?v=h5_NH3sL0Qw
• Contact Romeo Kienzler on Twitter: @romeokienzler