real time data and fme - excellence center for fme€¦ · two types of real-time data event based...
TRANSCRIPT
![Page 1: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/1.jpg)
Real Time Data and FME
FME Server is Automation!
I like how he thinks!
I like to set it and
forget it!!
![Page 2: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/2.jpg)
Two Types of Real-Time Data
Event Based or Notification Based
Independent discrete events that occur
at a rate of:
< 1 message / second
Continuous Data Stream
High Velocity Data Stream of > 1
message / second.
![Page 3: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/3.jpg)
Real Time #1:
Notifications
![Page 4: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/4.jpg)
Real Time #1 - NotificationsNotifications all follow the same pattern:
Somethinghappens
FME Workspace is run
Output isdelivered
![Page 5: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/5.jpg)
Notification Service Terms
SubscriberWorkspacePublisher
T T
Topics
![Page 6: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/6.jpg)
Email based Automation
Email triggers
FME to process
email contents.
![Page 7: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/7.jpg)
Notification ServiceEmail -> Validate DWG -> Email
Publisher
Workspace
Validate
DWG
Subscriber
![Page 8: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/8.jpg)
Notification ServiceEmail -> Validate DWG -> Email
Publisher
Workspace
Validate
DWG
Subscriber
DEMO
![Page 9: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/9.jpg)
Webhook based Automation
![Page 10: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/10.jpg)
Workspace Subscriber
T
Webhook call
to topic
Notification ServiceWebHook -> Run Workspace-> Deliver
T
![Page 11: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/11.jpg)
Schedule Based
Automation
![Page 12: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/12.jpg)
Workspace Subscriber
T
Scheduler
Notification ServiceSchedule -> Run Workspace -> Deliver
![Page 13: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/13.jpg)
Data Driven Automation
![Page 14: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/14.jpg)
Workspace Subscriber
T
Data Arrives
Notification ServiceData Driven Automation
T
Local or UNC
![Page 15: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/15.jpg)
From NetworkTo Cloud…
![Page 16: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/16.jpg)
D
Workspace Subscriber
T
Data Arrives
Notification ServiceData Driven Automation
T
FTP or Amazon S3 or … (others coming)
![Page 17: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/17.jpg)
Workspace Subscriber
T
Data Arrives
Notification ServiceData Driven Automation
T
FTP or Amazon S3 or … (others coming)
DEMO
![Page 18: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/18.jpg)
Real Time #2
Data Streams
![Page 19: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/19.jpg)
FME Engine(s) directly
connected to data stream.
![Page 20: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/20.jpg)
Engines connected to Streams
FME
FME Server Core
JMS Stream WebSocket Stream
Connected and dedicatedto stream
Connected and dedicatedto stream
Engine
Engine
Engine
Engine
Engine Engine
![Page 21: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/21.jpg)
Supported Direct Connections
Web Sockets
Java Message Service (JMS)
Amazon Simple Queue Service (SQS)
Amazon Simple Notification Service (SNS)
TCP/IP
![Page 22: Real Time Data and FME - Excellence Center for FME€¦ · Two Types of Real-Time Data Event Based or Notification Based Independent discrete events that occur at a rate of: < 1 message](https://reader031.vdocuments.mx/reader031/viewer/2022022519/5b150b437f8b9a8f548d73b9/html5/thumbnails/22.jpg)
JMS / Websocket Demo