big data workshops: analytics and models por esteban moro y alejandro llorente
DESCRIPTION
Big Data Workshops: Analytics and Models por Esteban Moro y Alejandro LlorenteTRANSCRIPT
Esteban MoroAlejandro Llorente
Analytics & Models
INNOVA CHALLENGE Taller 8 Octubre
① Introduction to cartographic data
② Getting Points of Interest
③ Extracting data from Innova Challenge API
④ Merging activity and cartography
⑤ Building a recommender system
⑥ From analytics to the app: RShiny
Index
Workshop30thOctober
Introduction to cartographic data in R
INNOVA CHALLENGE Taller 8 Octubre
Loading and filtering Shapefiles
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
plot(map) plot(mapMadrid)
Loading and filtering Shapefiles
Workshop30thOctober
Getting points of interest
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Parameters
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Obtaining places information
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Obtaining POI around Puerta del Sol and color them by type
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Using Google Maps as background
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Google Points Of Interest
Workshop30thOctober
Extracting data fromInnova Challenge API
INNOVA CHALLENGE Taller 8 Octubre
Connecting to the API
Parameters
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Extracting data
Connecting to the API
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Building the adjacency list
Connecting to the API
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Building and plotting the graph
Connecting to the API
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Connecting to the API
Workshop30thOctober
Merging activity andcartography
INNOVA CHALLENGE Taller 8 Octubre
Data + Cartography
Reading files
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Merging & plotting data and maps
Data + Cartography
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Data + Cartography
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Building our own polygons: a regular grid
Data + Cartography
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Data + Cartography
Workshop30thOctober
Building a recommender system
INNOVA CHALLENGE Taller 8 Octubre
Recommending by profile
?
????
???
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Getting data from the API
Recommending by profile
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Reading and preprocessing data
Recommending by profile
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Parameters
Result of preprocessing
Recommending by profile
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Recommending by profile
Recommendation map
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Recommending by profile
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Recommending by origin postal code
? ???
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Getting data from the API
Recommending by origin postal code
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Analogous data preprocessing and visualizing results
Recommending by origin postal code
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Combining classifiers
+
Geographic and demographic based recommender system
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Combining classifiers
Getting and merging recommendations
Workshop30thOctober
INNOVA CHALLENGE Taller 8 OctubreWorkshop
30thOctober
Combining classifiers
From analytics to the app:RShiny
INNOVA CHALLENGE Taller 8 Octubre
What’s RShiny
1 Web development framework with R.
2 Declarative user interface definition.
3 Server processing as servlets.
4 Agile prototyping.
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Installing Shiny
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Shiny project structure
ui.R: definition of user interface.• Layout• Plots• Control panels and filters• Tabs
server.R: definition of functions that generate the output to visualize in ui.R
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Our Goal
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Our Goal
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Our Goal
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
User interface definition
Requirements
1. Title of the application
2. Tabs to handle visualizations
3. Conditional panels
4. Filters: radio buttons, sliders and selectors
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
ui.R
Layout, title and beginning of the control panel
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Control panel definition
ui.R
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
Main panel definition
ui.R
Workshop30thOctober
Control panel definition
INNOVA CHALLENGE Taller 8 Octubre
server.R
Importing modules and first line
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
server.R
Output definitions
Workshop30thOctober
INNOVA CHALLENGE Taller 8 Octubre
And it works!
Recommender system
@estebanmoro [email protected]@llorentealex [email protected]
Workshop30thOctober