visualize can bus how to store and telematic data with
TRANSCRIPT
![Page 1: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/1.jpg)
How to store and visualize CAN bus telematic data with InfluxDB and Grafana
CSS Electronics (DK36711949)Soeren Frichs Vej 38K, 8230 Aabyhoej, Denmarkwww.csselectronics.com
![Page 2: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/2.jpg)
agenda
1. CSS Electronics, CAN bus and the CANedge2
○ About us
○ What is CAN bus?
○ What problem do we solve - and how?
2. Telematics dashboards via InfluxDB and Grafana
○ Why InfluxDB and Grafana?
○ How did we implement it?
○ In action: Examples of dashboards (ours & users)
○ Pros & cons of the implementation
![Page 3: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/3.jpg)
CSS Electronics, CAN bus and the CANedge2
![Page 4: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/4.jpg)
about me
● Co-owner at CSS Electronics
● Responsibilities
○ Sales, tech support, marketing (web content, videos, SEO, ...)
○ Misc software dev (React, Python, Ruby, ...)
● Background: Management consulting, corporate strategy
● Degree in financial economics
● Live in Denmark with my wife and three kids
Martin Falch● www.linkedin.com/in/martin-falch-a7579821
CSS Electronics, CAN bus and the CANedge2
![Page 5: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/5.jpg)
about CSS Electronics
● Started in 2015, based in Denmark
● Supply 2000+ companies across 80+ countries
● Develop & sell CAN bus hardware (data loggers, sensor modules)
○ PCB layouts from scratch
○ Firmware in embedded C
○ PCB assembly by US partner
● Carbon neutral since 2019 via 100% CO2 offsets
● Products are used particularly by automotive/industrial OEMs
● www.csselectronics.com
● +45 91 25 25 63
● www.linkedin.com/company/css-electronics
CSS Electronics
CSS Electronics, CAN bus and the CANedge2
![Page 6: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/6.jpg)
what is CAN bus?
● Quick overview of the technology
● Where is CAN bus used?
● Raw vs decoded CAN bus data
CAN Bus Explained
CSS Electronics, CAN bus and the CANedge2
![Page 7: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/7.jpg)
where is CAN bus used?
CSS Electronics, CAN bus and the CANedge2
![Page 8: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/8.jpg)
raw vs decoded CAN bus data
CSS Electronics, CAN bus and the CANedge2
![Page 9: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/9.jpg)
example: What challenge do we solve?
Situation
● Forklift battery OEM needs to collect
data from new prototype
● Data to be recorded across hundreds
of units & multiple warehouses
CSS Electronics, CAN bus and the CANedge2
![Page 10: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/10.jpg)
example: What challenge do we solve?
Complication
● Because this is a team of OEM
engineers, they have very specific
requirements to the product○ Solution needs to be low cost due to scale
○ Needs to be plug & play to install + power-safe
○ Needs to be pro specs - e.g. 0.05 ms frequency
○ Needs to be configurable (filters, triggers, ...)
○ Need to auto-upload data to their own server
○ Needs to be able to securely upload via WiFi
○ Needs ‘zero loss’ - SD is required to buffer
○ Needs support for many different software tools
○ ...
CSS Electronics, CAN bus and the CANedge2
![Page 11: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/11.jpg)
example: What challenge do we solve?
Solution
● The CANedge2 enables
the OEM to achieve their
required use case
CSS Electronics, CAN bus and the CANedge2
![Page 12: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/12.jpg)
about the CANedge2
● bit.ly/canedge2
● bit.ly/canedge-intro-video
● www.csselectronics.com
● +45 91 25 25 63
CANedge2
2x CAN/LIN Data Logger (SD + WiFi)
The 2xCAN/LIN logger records timestamped CAN bus data (Classical/CAN FD) to the extractable 8 GB industrial SD card.
The device connects via WiFi access points (e.g. WLAN or 3G/4G routers) to securely push data to your own server. Ideal for telematics, field tests, diagnostics, predictive maintenance.
CSS Electronics, CAN bus and the CANedge2
![Page 13: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/13.jpg)
how it works
● Set up your own S3 server (~5 min)
● Configure your CANedge2 with your
server/WiFi details
● Connect it to your CAN bus
application to start logging
● Data is auto-pushed to your server
and can be processed via the free
software/API tools and DBC files
CSS Electronics, CAN bus and the CANedge2
![Page 14: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/14.jpg)
example use cases
CSS Electronics, CAN bus and the CANedge2
![Page 15: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/15.jpg)
what makes our solution different?
● Cross-section between pro specs loggers and telematics
● Ease-of-use: Plug & play & highly configurable (without scripts)
● Low cost: 50-80% lower cost vs. comparable devices
● Interoperable: Utilize open standards to ease custom integration
○ JSON Schema (configuration)
○ S3 (server interface)
○ MF4 (standardized binary log file format)
● 100% free open source software (FOSS)
● We do not host anything (and charge no recurring fees)
pro specs automotive
data loggers
vehicle telematics
CSS Electronics, CAN bus and the CANedge2
![Page 16: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/16.jpg)
Telematics dashboards via InfluxDB and Grafana
![Page 17: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/17.jpg)
issue: We lacked browser data visualization
The CANedge2 integrates with various software tools - but previously no dashboard solution:
● Configuration editor: Load & edit JSON config files
● MF4 converters: Convert log files to other file formats
● asammdf: View, edit, DBC decode, plot log files
● Python API: Load & DBC decode log files
● CANcloud: Manage CANedge2 devices & data
Telematics dashboards via InfluxDB and Grafana
![Page 18: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/18.jpg)
how to best create a dashboard integration?
Challenge
Our users wanted to visualize
their CAN bus data in the
browser - ala a classic
telematics dashboard
Complication
Specific user requirements:
● Need intra-second frequency
● 100% panel customization
required (with no coding)
● Setup has to be really easy
● Solution needs to be
optionally 100% free & open
● Should scale for big data
Solution
Process log files via Python
API, write decoded data to
InfluxDB, visualize in Grafana
(facilitated via step-by-step
guide and plug & play scripts)
Telematics dashboards via InfluxDB and Grafana
![Page 19: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/19.jpg)
why Grafana and InfluxDB?
Why Grafana?
● Very popular (41K+ github stars)
● Intuitive/easy front end customization
● 100% free and open source
● Optional cloud (incl. free starter)
● Many plugins incl. geo maps
● Easy support for variables, alerts
Why InfluxDB?
● Very popular (21K+ github stars)
● Natively supported by Grafana
● 100% free and open source
● Optional cloud (incl. free starter)
● Grafana & Influx Cloud Starter = easy
● Simple-to-use Python write API
● Intuitive explorer functionality
Telematics dashboards via InfluxDB and Grafana
![Page 20: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/20.jpg)
how did we implement it?
● High level article to explain concept and possibilities
● Our users need to be able to set everything up themselves
● “Time-to-awesome” is key - start simple! (free starter cloud)
● Optimized step-by-step guide with sample data + DBC
● Each device = ‘measurement’, each parameter = ‘field’
alternative setup examples
typical ‘proof of concept’ setup
Telematics dashboards via InfluxDB and Grafana
![Page 21: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/21.jpg)
in action: Examples of dashboards
See our public Grafana dashboard
playground examples - or our user
case studies involving dashboards
(Havelsan, VIVES, Antü)
Telematics dashboards via InfluxDB and Grafana
![Page 22: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/22.jpg)
Dashboard links: Heavy duty (J1939)
Telematics dashboards via InfluxDB and Grafana
● Playground link
● J1939 - simple intro
● J1939 data logger intro
● Mining intro
![Page 23: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/23.jpg)
Dashboard links: Cars + GPS/IMU (OBD2)
Telematics dashboards via InfluxDB and Grafana
● Playground link
● OBD2 - simple intro
● OBD2 data logger intro
![Page 24: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/24.jpg)
Dashboard links: Maritime (NMEA 2000)
Telematics dashboards via InfluxDB and Grafana
● Playground link
● Marine telematics
![Page 25: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/25.jpg)
Dashboard links: CANmod.gps sensor fusion
Telematics dashboards via InfluxDB and Grafana
● Playground link
● CANmod.gps
![Page 26: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/26.jpg)
pros & cons of the implementation
Telematics dashboards via InfluxDB and Grafana
Pros
● Easy to get started due to cloud
starters and plug & play data/script
● 100% free & open source - or paid
convenience via full/partial cloud
● Users can fully customize their solution
- without being developers
Cons
● Our devices push data to S3, so an “S3
data source” would be “cleaner” (avoid
duplicate data storage)
● Periodic uploads can result in users
needing to crunch several GB at once
● Flux support in Grafana still semi-new
![Page 27: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/27.jpg)
questions?
Telematics dashboards via InfluxDB and Grafana
● bit.ly/canedge2
● bit.ly/canedge-intro-video
● bit.ly/telematics-dashboard
● www.csselectronics.com
● +45 91 25 25 63
![Page 28: visualize CAN bus How to store and telematic data with](https://reader031.vdocuments.mx/reader031/viewer/2022022809/621b6a74c1105534a2608f7c/html5/thumbnails/28.jpg)
We look forward to bringing together our community of developers to learn, interact and share tips and use cases.
10-11 May 2021Hands-On Flux Training
18-19 May 2021Virtual Experience
www.influxdays.com/emea-2021-virtual-experience/