rafael gimenez – scaling up in a world of geolocated data - nosql matters barcelona 2014
TRANSCRIPT
Ciudad 2020
Exploratory lines and further work
Joana Simoes, BDigital
27/05/2014
Scaling up a in a world of geolocated dataRafael Giménez, BDigital Technology Centre
Our team
Our work
A world of geolocated data
Applications
Spatial data analytics
Spatial analysis or spatial statistics includes any ofthe formal techniques which studies entities usingtheir topological, geometric or geographicproperties
Spatial data analytics
Basic Spatial Types
Line Point Polygon
* plus others
Spatial data analytics
Spatial Types
Spatial data analytics
Operations
Contains Within
Spatial data analytics
Operations
Equals Disjoint
Spatial data analytics
Operations
Crosses
Touches Overlaps
Spatial data analytics
Operations
Distance
Spatial data analytics
Operations
Union Difference
Spatial data analytics
Operations
Intersection Symmetric Diff
Spatial data analytics
Operations
Buffering
Convex Hull
Spatial data analytics
Operations
Area
Spatial data analytics
Geospatial data mining techniques
Density-based clustering Hierarchy-based clustering
Spatial data analytics
Geospatial data mining techniques
Heatmaps
Spatial data analytics
Geospatial data mining techniques
Trajectory mining
Spatial data analytics
Geospatial data mining techniques
Geospatial querying
Spatial anomalies
Geographically weighted regressions
Self-organizing Maps
Agent-based modeling
Our Use Cases
Credit card
operations
Where does people
buy?
What is the profile of
the customer?
Transit
Could you predict
the traffic status?
Could you predict
the traffic
incidences?
Spatial data analytics
Our Datasets
Twitter (Point)
Meteo (Polygon)
Traffic status (Multi-Line-String)
Traffic incidence (Multi-Point)
Cards (Multi-Point)
Demographic (Point & Polygon)
Shapefiles (Multi-Polygon)
Spatial data analytics
Our Tools
Queries
Clustering
Heat maps
TrajectoryAnomaly detection
Spatial data analytics
Our Stacks
Old School Stack - Why Not?
PostGIS Hadoop + GIS Tools ElasticSearch
Kibana
Spatial data analytics
Hadoop Stack - The new Classic
PostGIS Hadoop + GIS Tools ElasticSearch
Kibana
Spatial data analytics
Complete Stack - Big Data GIS
PostGIS Hadoop + GIS Tools ElasticSearch
Kibana
Spatial data analytics
Do’s and Don’ts
Geo Batch
Near Real-Time
Basic Geo Operations
Workflow Composition
Geo Streams
Real-Time
Advanced Geo Op.
Unattended Workflow
Spatial data analytics
What’s
next?
RFC ;)
Spatial data analytics
