khilitchandra v. prajapati · power bi (streaming datasets) author: khilitchandra prajapati...
TRANSCRIPT
![Page 1: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/1.jpg)
Khilitchandra V. Prajapati
www.bigator.com
![Page 2: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/2.jpg)
Agenda Introduction & Architecture
Streaming Datasets in Power BI & Types
Demo
Q & A
![Page 3: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/3.jpg)
![Page 4: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/4.jpg)
Types of Streaming Datasets
Push
Streaming
PubNub
![Page 5: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/5.jpg)
Push
Azure SQL(Provisioned by Power BI Service)
Power BI Service
Incoming Data
Direct Query
Data automatically refresh when pushed
![Page 6: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/6.jpg)
Push Advantages
Its Direct Query
Can build reports, custom visuals, Q & A, alerts etc.
Caveats Slower refresh times
API throttling limitations
When should we use General purpose
~3-5 seconds latency accepted
![Page 7: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/7.jpg)
Streaming
Redis Cache(Provisioned by Power BI Service)
Power BI Service
Incoming Data
Queried byStreaming Visuals
• Data goes into short-lived – Redis Cache store• Power BI connects to Redis Cache when Streaming Visual is active on Dashboard
![Page 8: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/8.jpg)
Streaming Advantages
Very quick refreshes (~ 1 Sec) Visuals optimized for real-time refresh scenarios Easy to build and integrate in Dashboard
Caveats Limited set of Visuals for Dashboard Can not create visual from Data directly Good panning is required
When should we use Absolutely need “Latest” data (up-to-date data)
![Page 9: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/9.jpg)
PubNub
PubNub Service
Power BI Service
Incoming Data
Queries for Streaming Visuals
• 70+ SDKs are available (https://www.pubnub.com/docs)• Power BI requests data from an existing PubNub Stream (https://www.pubnub.com/)
PubNub SDK
![Page 10: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/10.jpg)
PubNub Advantages
Very quick refreshes (~ 1 Sec) Visuals optimized for real-time refresh scenarios Easy to build and integrate in Dashboard
Caveats Limited set of Visuals for Dashboard (data lives @ PubNub) Can not create visual from Data directly Good panning is required
When should we use Absolutely need “Latest” data (up-to-date data)
![Page 11: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/11.jpg)
Before you start – Keep in mind Reduce to data volume down to only what you need to display on
Dashboard
For any deeper analysis/operations, store into Database, connect Power BI via import/live connection
Be aware of data volume limits (more on REST APIs)
Select proper columns for display on Dashboard
![Page 12: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/12.jpg)
Demo Time
![Page 13: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/13.jpg)
Some helper links https://docs.microsoft.com/en-us/power-bi/service-real-time-streaming
https://www.youtube.com/watch?v=0YIBHfgasok
https://www.pubnub.com/tutorials/microsoft-power-bi/streaming-business-data-to-dashboards/
https://blog.jongallant.com/2016/06/iot-dashboard-azure-iot-hub-powerbi/
![Page 14: Khilitchandra V. Prajapati · Power BI (Streaming Datasets) Author: Khilitchandra Prajapati Created Date: 3/11/2018 1:08:47 PM](https://reader035.vdocuments.mx/reader035/viewer/2022062507/5fbecc3f80deb06693235353/html5/thumbnails/14.jpg)
Q & A