get big geo data

Download Get Big Geo Data

Post on 21-Jan-2017

1.672 views

Category:

Education

4 download

Embed Size (px)

TRANSCRIPT

Get Big Geo Data Now

GETBIG GEO DATA (now) ! #gimaday

1

Get BIG geo data!The data explosion has enabled GIS on the Web to grow into new application areas. The Internet of Things, the Sensorweb and open data repositories are leading us into an era of big geodata. Apart from the amount of data, the role of data in GIS and our concept of data are also changing. This presentation explains a few of these developments. It calls for students to pay closer attention to the data aspect of GIS and to gain experience with big geodata. The presentation ends with a few tips for (eternal) students.

GIMA day, Wageningen U, April 6th 2016

Not-a-placeA-good-place

Port of Rotterdam(2001)

M A P S

Pictures of the way things are?

moments in the process of decision making*

Maps are changing..

*Bertin, as quoted in The Power of Maps, Dennis Wood. P. 1855

GET (1)Understand

Real-Time3DVisualizationAnalyticsAppsMobileCollaborativeApplicationsOpenConfigurableAgileEasierReady to UseImplementationGPSUAVsLidarReal-TimeCrowdsourcingSensorsScientific DataRemote SensingField SurveySocial MediaContentFaster ComputingBig DataDistributed ProcessingCloudVirtualizationIoTConsumerizationSmart DevicesTechnologyIntegrating Many InnovationsA Whole New Pattern Is EmergingGIS Is Evolving

Web GIS

8

Data is/wascollected by expertsconsciouslyclosedstaticstructurecreated by softwaresubset of realitysend as input to an analytical processon your computerIgnoring the quantitative view

Data is/becomingcollected by a crowdunconsciouslyopenreal-timeno-structurecreated by datathe analytical process is send to the datacloser to realitythink clusters and cloud

10

#open

#3D

Step 2: betere data, visualiastie afhankelijk van intensiteit (voorbeeld een verschijnsel uit de ondergrond, maar bovengronds gevisualieersd)

14

#crowd

When data turns into BIG data15

BIG#BIG

In 48 minutes on 120 machines

16

#realtime

Realtime data for emergency response. Allows for the most optimal use of police and ambulances. 17

When data turns into BIG data II (not the slider on the bottom)

18

160 000 datapoints per minuteDuur10.000 features/minuut10.000 features/minuut data opslag160 000 features160 000 features/minuut dataopslag1 minuut10 0000.0007 GB160 0000.01 GB1 uur600 0000.04 GB9.6 mljn0.64 GB1 dag14,4 miljoen1 GB230 mljn16 GB1 week100 miljoen7 GB1,6 mljd112 GB4 weken400 miljoen28 GB6,8 mljd448 GB1 jaar5,2 mljd364 GB83 mljd5,8 TB1052 mljd3,4 TB830 mljd54.4 TB

Credit: Boudewijn BoogaardAverage speedIn one minuteMotorized vehiclesLength over 12,80 mIn lane 3

20

Realtime NDW (vrijdag 18 maart 2016)22

#on-the-fly aggregation

50 miljoen waarnemingen 4 dagenOn-the-fly aggregatie

23

BIG DATA WHAT IT IS ABOUTGuide us to different insights about our worldWhy? Lower costs. Improved decision making. Innovation of products and services.Real-time data. Stored. Streams. Unstructured (..)Fairly big

Big data at work, T. Davenport

GET (2)Collect

Sensing the CityThe main dataset used in this research is the sensed data retrieved by van der Hoeven and Wandl (2015) for the Hotterdam project. In the summer of 2014, they measured the temperature in Rotterdam by using sensors. About 1300 sensors were distributed.

Be like Iris Theunisse! (check out her thesis).

28

Start a small project working with realtime data28

M A P S

Becoming better models of reality!

But still limited by that model ... and the maker of the model

29

A FEW TIPS

Mind yr T-shaped profile

Follow a MOOC, read a book

Take a deep dive into spatial temporal land

Recommended readingBooksBig data at Work, Thomas Davenport, Harverd Busines Review PressBig Data, Viktor Mayer-Schnberger, Kenneth Cukier, HMHSocial Physics, Alex Pentland, Penguin Press

MOOCsUnlock Value in Massive Datasets, UC San Diego, CourseraKnowledge Management and Big Data in Business, HK Poly U, Edx

PapersDo pm me if you are considering to include Big data / GeoAnalytics in your thesis!

Esri : Discover great value from your big data (here)

31

Get BIG Geo Data!GIMA Day 2016 @ Wageningen U(GIS on the Web)Jan Willem van Eck