exploiting real-time data with arcgis geoevent processor...
TRANSCRIPT
2013 Ohio GIS ConferenceDesigning for the FutureSeptember 11-13, 2013
Exploiting Real-Time Data with ArcGIS GeoEvent Processor for ServerEric J. Rodenberg
GIS data• GIS data typically represents state at a specific
moment in time: “historic”, “current”, or “future”.
Credit: iStockphoto/chris_lemmens
Real-time GIS data
WebDesktopRuntime
Mobile
Applications
FeaturesChallenge #1
Police PersonAmbulance
Police Car
110°
StormWind
TemperatureEarthquake
Wild Fire
Network SensorWarehouse Item
…continuous stream of events flowing from sensors representing the latest state.
Analyzing real-time GIS data
…Are my field personnel working within the designated project area?
WebDesktopRuntime
Mobile
ApplicationsFeaturesEquipment
Alert
Challenge #2
ContinuousAnalysis
BoundaryOutside
Boundary
Analyzing real-time GIS data
• …Tell customer when their delivery truck is 15 minutes away.
ContinuousAnalysis
WebDesktopRuntime
Mobile
ApplicationsFeaturesDelivery Vehicle
NotificationCustomer AreaEnter
Customer Area
Challenge #3
ArcGIS supports real-time GIS
Real-time data
ArcGIS Online /Portal for ArcGIS
OperationsDashboard
Collector
ArcGIS Server
GeoEvent Processor
ArcGIS GeoEvent Processor for Server• Receives real-time streaming data
• Performs continuous processing and analysis
• Sends updates and alerts to anyone on any device
Continuous Processingand Analysis
Continuous Processingand Analysis
Connectors
Connectors
im
ws://
Alerts
Real-Time Data FeaturesWebDesktop
Runtime
Mobile
ApplicationsArcGIS Server
GeoEvent Processor
Working with real-time data
You can add your own connectors.
Receiving real-time data• You can easily integrate real-time data with ArcGIS
by using a connector that meets your needs.
Input connectors…
Real-time dataReal-time data
ArcGIS for Server
GeoEvent Processor
Receive NMEA
Receive Sierra Wireless
Receive Tweets
Receive Instagram
Receive Trimble
Receive GPX
NMEA
GPX Receive Vessels
Receive Geomessages
Receive Air Traffic Control
Receive Cursor-on-Target
Receive VMFCoT
VMF
Message Geo
Watch a folder for new Files
Receive RSS
Receive from a Socket
Receive from a Web Socket
Receive on a REST Endpoint
Poll an ArcGIS Server
Poll an external website
ws://
http://
http://
Receive RSS
Receive from a Socket
Receive from a Web Socket
Receive on a REST Endpoint
ws://
http://
Receive from a Socket
Receive from a Web Socketws://
DemonstrationTwitter monitoring
Sending real-time data• You can easily send resulting streams to anyone on any device using a
connector.
Output connectors…
WebDesktopRuntime
MobileArcGIS for Server
GeoEvent ProcessorReal-time dataReal-time data
You canadd your
ownconnectors
Send to RabbitMQ
Send to ActiveMQ
Send to HornetQ
Write to Hadoop
Write to MongoDB
Send a Tweet
Send to CESIUM
im
ws://
Send an Instant Message
Send an email
Update a Feature
Add a Feature
Send to Tracking Analyst
Send a Text Message
Publish to REST Endpoint
Send to a Web Socket
Send to a Socket
Write to a File
im
ws://
Send an Instant Message
Send an email
Update a Feature
Add a Feature
Send to Tracking Analyst
Send a Text Message
im
Update a Feature
Add a Feature
Send to Tracking Analyst
Update a Feature
Add a Feature
ArcGIS for Server
Sending real-time data to featuresUsing local feature services
GeoEvent Processor
Filters Processors
Inpu
ts
Out
puts
GeoEvent Services
Update a FeatureUpdate a Feature
Add a FeatureAdd a Feature
Operations Dashboard for ArcGIS
ArcGIS Online / Portal
operation view
web map
Your DashboardsYour
ApplicationsYour
Applications
Web APIsJavaScript
Flex
Silverlight/WPF
Mobile GISiOS
Android
Windows Phone
RuntimesWindows Store
Mac OS X
Java
Qt
Real-timedata
Real-timedata
feature layersfeature layers
YourApplications
YourApplications
Web APIsJavaScript
Flex
Silverlight/WPF
Mobile GISiOS
Android
Windows Phone
RuntimesWindows Store
Mac OS X
Java
Qt
ArcGIS Online / Portal
operation view
web map
Sending real-time data to featuresUsing remote feature services…
ArcGIS for Serverfeature layersfeature layers
GeoEvent Processor
ArcGIS for Server
Filters Processors
Inpu
ts
Out
puts
GeoEvent Services
Update a FeatureUpdate a Feature
Add a FeatureAdd a Feature
Operations Dashboard for ArcGIS
Your Dashboards
Real-timedata
Real-timedata
YourApplications
YourApplications
ArcGIS Online / Portal
operation view
web map
Sending real-time data to featuresUsing ArcGIS Online feature services…
feature layers
GeoEvent Processor
ArcGIS for Server
Filters Processors
Inpu
ts
Out
puts
GeoEvent Services
Update a FeatureUpdate a Feature
Add a FeatureAdd a Feature
Web APIsJavaScript
Flex
Silverlight/WPF
Mobile GISiOS
Android
Windows Phone
Operations Dashboard for ArcGIS
Your Dashboards
RuntimesWindows Store
Mac OS X
Java
Qt
Real-timedata
Real-timedata
Real-timedata
Sending real-time data to big data stores
• GIS Tools for Hadoop
- http://github.com/Esri/gis-tools-for-hadoop ArcGIS for DesktopGeoprocessing
GIS Tools for HadoopGIS Tools for Hadoop
2013/03/06/10/vehicles-2013-03-06-10.json2013/03/06/10/vehicles-2013-03-06-10.json2013/03/06/11/vehicles-2013-03-06-11.json2013/03/06/11/vehicles-2013-03-06-11.json2013/03/06/12/vehicles-2013-03-06-12.json2013/03/06/12/vehicles-2013-03-06-12.json2013/03/06/13/vehicles-2013-03-06-13.json2013/03/06/13/vehicles-2013-03-06-13.json
2013/03/06/10/vehicles-2013-03-06-10.tsv2013/03/06/10/vehicles-2013-03-06-10.tsv2013/03/06/11/vehicles-2013-03-06-11.tsv2013/03/06/11/vehicles-2013-03-06-11.tsv2013/03/06/12/vehicles-2013-03-06-12.tsv2013/03/06/12/vehicles-2013-03-06-12.tsv2013/03/06/13/vehicles-2013-03-06-13.tsv2013/03/06/13/vehicles-2013-03-06-13.tsv
GeoEvent Processor
ArcGIS for Server
Filters Processors
Inpu
ts
Out
puts
GeoEvent Services
Write to HadoopWrite to Hadoop
Write to MongoDBWrite to MongoDB
Write to a Hadoop Distributed File System (HDFS)Write to a MongoDB Document Store
Performing continuous processing and analysis
WebDesktopRuntime
Mobile
im
ws://
Continuous processing and analysis• A GeoEvent Service configures the flow of GeoEvents
- the Filtering and GeoEvent Processing steps to perform- what input(s) to apply them to- and what outputs(s) to send the results to
GeoEvent Services…
ArcGIS for Server
GeoEvent Processor
Real-time dataReal-time data
Twitter Input Add Tweet FeatureFilterGeolocated
Filter
Write Tweets to Hadoop
Twitter Monitor (GeoEvent Service)Twitter Monitor (GeoEvent Service)
Continuous processing and analysis•Calculate new fields on a geoevent: GeoTagger , Field Calculator•Modify a geoevent: Field Enricher , Field Reducer•Derive a new geoevent: Field Mapper , Incident Detector
GeoEvent ServiceGeoEvent Service
GeoTagger
Field Calculator
Field Enricher
Field Reducer
Field Mapper
Incident Detector
Input 1 Output 1
ArcGIS Server with GeoEvent Processor
Processors…
Continuous processing and analysis
• An Incident Detector processor- creates an incident upon an opening condition being met,- maintains state for the duration of the incident,- closes the incident based on a closing condition or expiration .
GeoEvent ServiceGeoEvent Service
Incident Detector
91909265689091909281736866
CloseIncident
81
OpenIncident
90noiseDecibel >= 90
Opening Condition
Input 1 Output 1
Derive a new geoevent…
DemonstrationNoise incident detection
Demo
GeoEvent Processor
ArcGIS for Server
GeoEvent ServiceGeoEvent Service
ws:// ws://JSON
GeoEvent Processor
ArcGIS for Server
GeoEvent ServiceGeoEvent Service
ws:// feature
external internal
featureincident detectorNoise App
Solutions and sample applications• A number of sample applications and solutions leverage GeoEvent
Processor to enable real-time GIS capabilities within them including: - Defense and Intelligence: http://resources.arcgis.com/en/communities/defense-and-intelligence/
- ArcGIS for the Military- ArcGIS for the National Guard- ArcGIS for Intelligence
- Asset Monitor- Route Monitor
Applying real-time GIS
ArcGISfor the Military
ArcGIS forIntelligence
RouteMonitoring
AssetMonitoring
DemonstrationVehicle monitoring
Demo
Real-time GIS with GeoEvent Processor• ArcGIS is a dynamic platform that enables real-
time visualization, continuous analysis, and understanding of our world.
• GeoEvent Processor allows you to:- be alerted when interesting events occur- react and make smarter decisions faster- to know what is happening, as it happens
• Product Page- http://pro.arcgis.com/share/geoevent-processor
Summary