chiel drost, senior product managermicroservices go here edge microservices go here edge...
TRANSCRIPT
October 8, 2019
Chiel Drost, Senior product manager
Edge native microservices
The following information is confidential information of TIBCO Software Inc. Use, duplication, transmission, or republication for any purpose without the prior written consent of TIBCO is expressly prohibited.
CONFIDENTIALITY
3
About me
● Product manager at TIBCO
● Love anything that touches upon Cloud, Containers and IoT
● I love soccer, millennials, and edge tech
@chiel_drost
4
● Drivers for microservices ● The rise of IOT ● Why open source ● Project Flogo®
● Lightweight compute @ the edge
Agenda
Swap Logo
if needed
In master slide
5
Business changes
…Transforming
data into action
To spot and seize opportunities
from the ever increasing
volumes of data and devices
…Operating with more
speed and agility
To meet stakeholder demands for
delivering rapid innovation and
differentiation
…Empowering more users
To become self-sufficient at
helping the business with digital
transformation efforts
6
…From building and connecting monolithic applications to each other…
Application changes
ESB
App App App
…To an infrastructure on which modern applications are built, with API and event-driven microservices patterns, to support digital transformation needs
Technically the strategy must “integrate integration” and blur the lines between development and integration -Randy Heffner, Forrester Research
Service Service
Service
API
EVEN
T
API
EVEN
T
API
API
“App”
Function
Function
Swap Logo
if needed
In master slide
7
Audience needs drive digital platform requirements
Business Apps
Specify Policies
Specify Business Logic
Specify Connectivity
Data Sources
Build lightweight business apps that digitize manual processes
Provide secure access to systems and data across any channel
Build scalable, cross-platform application components cost-efficiently
Business User
Enterprise IT
Developers
Swap Logo
if needed
In master slide
8
Digital platform requires a modern architecture stack
Help developers accelerate creation of
scalable API and event-
driven application
services
Process and Analytic Apps
Policy Management
APIs Events
Application Services
Connectivity
Systems & Data
Facilitate easy connectivity to any data source, system, or device
Empower business users to assemble applications, gain insight from data, and automate business processes
Enable IT to provide managed access to new and legacy enterprise systems, across any channel
IoT Device
Business IT Developers
Deploy anywhere
✓ Cloud
✓ PaaS
✓ Serverless
✓ Hybrid
✓ Containers
✓On-Premise
✓ Edge Devices
Swap Logo
if needed
In master slide
9
Embrace Microservices for Modern App Development and Integration
Build Microservices Faster
▪ Create microservice flows and logic with intuitive, browser-based visual tooling
▪ Available as an open source project to get started quickly and without any hurdles
Leverage FaaS and Serverless Platforms
▪ Lower your TCO by employing serverless and FaaS architecture
▪ Migrate existing or new services to pure cloud FaaS platforms like AWS Lambda
Deploy Anywhere Including Edge Devices
▪ Deploy microservice flows anywhere: on-premise, cloud, hybrid and edge devices
▪ Run on microcontrollers and sensors, with 50x smaller footprint than Node.js/Java
MICROSERVICES
Easily build and deploy microservices to any cloud-based PaaS or the smallest of IoT edge devices
10
● Drivers for microservices ● The rise of IOT ● Why open source
● Project Flogo® ● Lightweight compute @ the edge
Agenda
11
Connectivity
In 2015, we had 4.9 billion connected things, by 2020, the number of Internet-connected things will reach or even exceed 50 billion. GE believes that the “Industrial Internet” (their term for IoT) will add $10 to $15 trillion to global GDP in the next 20 years. According to estimations by the McKinsey Global Institute, the IoT will have a total economic impact of up to $11 trillion by 2025.
12
Handling connectivity
Easy to develop,
deploy and update
Connect all the devices
Run on different
form factors
Swap Logo
if needed
In master slide
13
Simplify integration and connectivity
Rapid, Simplified Connectivity
▪ Simplify connectivity with a graphical integration flow builder
▪ Leverage pre-built connectors for application, database and network technologies
Web-Scale and Enterprise Ready
▪ Powers many of the world’s largest integration projects across multiple industries
▪ Leverage containers for web-scale integration applications
Deploy Integration Services Anywhere
▪ Deploy integration projects in the cloud, on-premise, or in hybrid environments
▪ Integration app portability and re-use ensures lower TCO
Empower your organization to create connectivity to any of your applications, faster and easier than ever before CONNE
CT
14
IoT Distributed Architecture
Interaction of physical components with IoT
ecosystem
IoT Platform Architecture components build on top of
other IoT applications
Integration between enterprise and IoT
platform components
Source: Gartner – End-to-end “Thing” Data – A Key to Success in IoT, 2018
15
IoT Distributed Architecture
Interaction of physical components with IoT
ecosystem
IoT Platform Architecture components build on top of
other IoT applications
Integration between enterprise and IoT
platform components
Source: Gartner – End-to-end “Thing” Data – A Key to Success in IoT, 2018
16
Open Source Components for IoT Many enterprises are starting with OSS for IoT projects
Source: Gartner – Use Open Source to Jump-Start IoT Projects and Make IoT Vendor Decisions. June 2017.
17
● Drivers for microservices ● The rise of IOT ● Why open source
● Project Flogo® ● Lightweight compute @ the edge
Agenda
18
OSS Consumer
Support and talent
Control product direction
Tailor to your needs
OSS project
Flexibility, agility and speed
Cost effectiveness
Ability to start small
Why open source?
19
Most transformative technology
CNTK
The most important technology has been developed as Open Source
20
Open source trends
91% of developers use the same OSS tools for work and personal projects
98% of developers use open source tools at work
96% of commercial applications already use open source software as a component
21
● Drivers for microservices ● The rise of IOT ● Why open source
● Project Flogo® ● Lightweight compute @ the edge
Agenda
22
Introducing project Flogo
Project Flogo Ultra Lightweight Integration Framework
for IoT and Microservices
Swap Logo
if needed
In master slide
23
Really, How Small?
Java Node.js Flogo Flogo Edge App
180MB
74MB
3MB
0
50
100
150
200
32K
B
Did I mention the small footprint?
Swap Logo
if needed
In master slide
24
Java, NodeJS are great, but too large for resource constrained environments
Why Golang for Project Flogo-
• Complies natively and runs natively. • Only the required dependencies are built into the application. • Static linking enables zero OS dependencies.
How did we get so small?
App
Framework (OSGi)
VM (JVM)
Operating System
Hardware
App
Framework (Node.js)
VM (V8)
Operating System
Hardware
App
Operating System
Hardware
Swap Logo
if needed
In master slide
25
Event processing
The simple notion is that an event is just that, an event. Whether it be one or millions, it’s how you process them that differs.
Stream: Aggregate/Filter Noise
Integrate Correlate & Rules
If (….)
Swap Logo
if needed
In master slide
26
The project Flogo ecosystem
Integration Flows
Stream Processing
Microgateway
Contextual Rules
Swap Logo
if needed
In master slide
27
The lifecycle of a Flogo App
Design and debug flows in
web UI
Package using CLI or CI/CD
pipeline
Deploy to PaaS, Serverless, Edge Device or run locally
Swap Logo
if needed
In master slide
28
⚡
⚡ Powerful event-driven
programming model based on triggers and actions
Internal channel for action chaining. Bundle all app needs into a single bin
Common contribution model enabling you to leverage
100s of activities & triggers
Simple interface to extend event processing capabilities
Flogo Core
Event-driven App Kernel for Serverless & IoT Edge
Swap Logo
if needed
In master slide
29
Integration flows
Ultra-lightweight app integration for serverless and edge
Conditional control flow Ultralight Process engine for Application
Integration
Powerful step-back debugging capabilities in
web browser
Swap Logo
if needed
In master slide
30
Flogo rules
Real time contextual decisions
Real-time Decisions to determine next Best Action/Outcome and
Experience
Open Source/Core complete with
extensions, APIs and Interfaces
Declarative Rules/Rapid Application
Development
Stateful/Contextual Reasoning across time
and space
Swap Logo
if needed
In master slide
31
Ultralight footprint for low-resource
devices
Execute TensorFlow
Models Natively in Flogo Flows
Streaming Data
Constructs
100% Open Source with zero lock-in
Edge machine learning
Execute AI models natively
Swap Logo
if needed
In master slide
32
Flogo Microgateway
Manage your cloud-native microservices and APIs from everywhere
Ideal proxy for distributed microservices ecosystems
Event-driven and other emerging non-RESTful API patterns: Kafka, MQTT, GraphQL, gRPC
Security, access control and threat detection where and when you need it
Swap Logo
if needed
In master slide
33
Developing apps
Zero code, Web UI Golang API Elegant JSON DSL
Swap Logo
if needed
In master slide
34
Zero code, web UI
Swap Logo
if needed
In master slide
35
Handlers
Handler
Trigger(s) WriteDB Log
WebSocket
Rule 1
Rule 2
Stream
Rules Integration
Handler
App
Aggregate
Filter
Swap Logo
if needed
In master slide
36
Chaining
Handler
Trigger(s) WriteDB Log
WebSocket
Rule 1
Rule 2
Stream Rules Integration
App
Aggregate
Filter
Swap Logo
if needed
In master slide
37
38
Demo video
Swap Logo
if needed
In master slide
39
Deploy using your own tools
Deploy to PaaS, Serverless, Edge Device or run locally without changing any code! Build zips to deploy to Lambda Build docker images to deploy to Kubernetes Deploy using Serverless Framework, awscli or simply upload
40
● Drivers for microservices ● The rise of IOT ● Why open source
● Project Flogo® ● Lightweight compute @ the edge
Agenda
41
Remember this one?
Source: Gartner – Use Open Source to Jump-Start IoT Projects and Make IoT Vendor Decisions. June 2017.
42
What if we can do more here?
43
Better IoT Integration
Devices
Control Control
Business microservices
go here
Edge
microservices go here
Edge
microservices logic could
also run here
Benefits of edge integration & event processing
• Local control = more reliable
• Less bandwidth & lower TCO
• Fewer hops, less latency Gateway Cloud
Where appropriate, move application logic and integration out to the devices
Sensor events events
Swap Logo
if needed
In master slide
44
Smart transport
• Passenger numbers to consumers and
operations
• Embedded logic on vehicle
• Predictive maintenance
• Travel times and speed
• Efficiency and cost savings on energy
consumption
Swap Logo
if needed
In master slide
45
Manufacturing
• Visual analytics for yield optimization
• Embedded logic on device
• Predict failures
• Analyze machine and device sensors
• OEM delivery to manufacturing floors
Swap Logo
if needed
In master slide
46
RFID
• Integration logic embedded in RFID
gateway
• Integrates with backend
• Correlate RFID tag to device and
lookup device info for rich edge data
• Flogo design time white labeled
• Customers can use a visual tool to
modify and add logic to device
Swap Logo
if needed
In master slide
47
https://www.flogo.io/