big data meets scalable visualizations by javier de la torre at big data spain 2013
DESCRIPTION
The power of visualizing time-series data derived from remote sensing products can not be overestimated. Visualization can give scientists, policy makers, journalists and others immediate insights into how the landscape and environment is changing over time and can lead to quicker understanding and action.TRANSCRIPT
![Page 1: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/1.jpg)
Big data meets scalable visualizations
JAVIER DE LA TORRE
![Page 2: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/2.jpg)
���2Javier de la Torre - @jatorre
Big data meets scalable visualizations
![Page 3: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/3.jpg)
�3
picture on big data awesomeness
Big data awesomeness!!!!
![Page 4: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/4.jpg)
�4
![Page 5: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/5.jpg)
�5
![Page 6: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/6.jpg)
�6
![Page 7: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/7.jpg)
Big data without data visualization
= #fail
![Page 8: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/8.jpg)
Maps are the most popular type of data visualization
Everything happens somewhere !Where are your clients? IP=location !So everything can be analyzed and visualized on maps
![Page 9: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/9.jpg)
Everybody wants to see data on maps,
But making good maps is very hard!
Ugly map!
![Page 10: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/10.jpg)
Making maps is hard because…
Tools are not there yet. They are for GIS experts !Handling 100 points is easy, 1Million is hard !Data chages! Is not about printing maps online!
![Page 11: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/11.jpg)
�11
Demo on meteorites
![Page 13: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/13.jpg)
Big data analysis and reporting tool - UNEP Carbon calculator
![Page 14: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/14.jpg)
Narrative maps / Story telling - The Hobbit filming Locations map
![Page 15: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/15.jpg)
Narrative maps / Story telling - The Rolling Stones tour maps
![Page 16: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/16.jpg)
German elections real time maps
![Page 18: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/18.jpg)
Animated geotemporal maps. Everything happens somewhere and at some time. Navy of WWI map
![Page 19: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/19.jpg)
Visual analysis - Economic impact of the Mobile World Congress 2012 in Barcelona
![Page 20: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/20.jpg)
All meteorites fallen on earth
![Page 22: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/22.jpg)
Mobile ready.
![Page 23: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/23.jpg)
�23
![Page 24: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/24.jpg)
Big data analysis of deforestationHow we can track deforestation on real time Global Forest Watch
![Page 25: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/25.jpg)
![Page 26: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/26.jpg)
![Page 27: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/27.jpg)
![Page 28: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/28.jpg)
![Page 29: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/29.jpg)
![Page 30: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/30.jpg)
![Page 31: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/31.jpg)
![Page 32: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/32.jpg)
![Page 33: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/33.jpg)
![Page 34: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/34.jpg)
![Page 35: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/35.jpg)
![Page 36: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/36.jpg)
![Page 37: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/37.jpg)
![Page 38: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/38.jpg)
![Page 39: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/39.jpg)
![Page 40: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/40.jpg)
![Page 41: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/41.jpg)
![Page 42: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/42.jpg)
![Page 43: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/43.jpg)
![Page 44: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/44.jpg)
![Page 45: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/45.jpg)
![Page 46: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/46.jpg)
http://en.wikipedia.org/wiki/Bakun_Dam
![Page 47: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/47.jpg)
Most people don’t need Big Data technologies
But when you can’t…. when it really explodes…
You just need to start collecting and analyzing data. Don’t focus on technology, probably your database can already do it !You are not Facebook, don’t be cheat
![Page 48: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/48.jpg)
Foreign Data wrappersConnect PostgreSQL to almost anything
Oracle Hadoop MySQL MongoDB CouchDB Redis …. Twitter Email S3
![Page 49: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/49.jpg)
�49
CartoDB Hadoop HBase
![Page 50: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/50.jpg)
Geo-temporal visualizationsCartoDB and Torque
![Page 51: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/51.jpg)
Friday, 28 September 12
![Page 52: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/52.jpg)
WITH%hgrid%%%%%%AS%(SELECT%Cdb_rectanglegrid(Cdb_xyz_extent(8,%12,%5),%%%%%%%%%%%%%%%%%Cdb_xyz_resolution(5)%*%4,%%%%%%%%%%%%%%%%%%%%%%%%%%%%Cdb_xyz_resolution(5)%*%4)%AS%cell)%SELECT%x,%%%%%%%%y,%%%%%%%%Array_agg(c)%vals,%%%%%%%%Array_agg(d)%dates%FROM%%%(SELECT%St_xmax(hgrid.cell)%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%x,%%%%%%%%%%%%%%%%St_ymax(hgrid.cell)%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%y,%%%%%%%%%%%%%%%%Count(i.cartodb_id)%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%c,%%%%%%%%%%%%%%%%Floor((%Date_part('epoch',%built)%Q%Q10418716800%)%/%32837875)%d%%%%%%%%%FROM%%%hgrid,%%%%%%%%%%%%%%%%us_po_offices%i%%%%%%%%%WHERE%%St_intersects(i.the_geom_webmercator,%hgrid.cell)%%%%%%%%%GROUP%%BY%hgrid.cell,%%%%%%%%%%%%%%%%%%%Floor((%Date_part('epoch',%built)%Q%Q10418716800%)%/%32837875)%%%%%%%%)%f%GROUP%%BY%x,%%%%%%%%%%%y
Friday, 28 September 12
![Page 53: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/53.jpg)
{%%rows:%[%%{%%%%x:%0,%%%%y:%0,%%%%vals:%[2],%%%%dates:%[457]%%},%%{%%%%x:%1,%%%%y:%0,%%%%vals:%[1,1,4],%%%%dates:%[2,3,4]%%%%}%%]}
Friday, 28 September 12
![Page 54: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/54.jpg)
1
10
100
1000
3mb 70mb 300mb1.5
21.2
300
70
3
Raw Datacube
Payload sizes
Friday, 28 September 12
![Page 55: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/55.jpg)
Think on the value of location on your data, and use it!
Is very likely you have geospatial data already !Complete the big data cycle: Don't forget data visualization !Find the stories inside the data and show them!
![Page 56: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/56.jpg)
���56Javier de la Torre - @jatorre
Thanks!!
![Page 57: Big data meets scalable visualizations by JAVIER DE LA TORRE at Big Data Spain 2013](https://reader034.vdocuments.mx/reader034/viewer/2022051014/549a0f9bb4795963768b4643/html5/thumbnails/57.jpg)