Visualizing Bogots dynamics with Big Data

Tools and ArcGISDiana Figueroa CeferinoDiego Pajarito Grajales

@dianazul@diegopajarito

Big Data Tools

- Twitter API- Geonames API

- Python- CSV File

- ArcMap XY Events- ESRI Heatmap

Word.le Word Count Patience

What we asked Twitter?

Tweets located 100km from Bogot

Bogot67,000 Tweets in 3 Days

Tweets per Day

0

5

10

15

20

25

30

35

2/06/2015 3/06/2015 4/06/2015 5/06/2015

K

0

5

10

15

20

25

30

35

2/06/2015 3/06/2015 4/06/2015 5/06/2015

K

Tweets per Day

00.20.40.60.8

11.21.41.61.8

2

23 1 3 5 7 9 11 13 15 17 19 21 23 1 3 5 7 9 11 13 15 17 19 21 23 1 3 5 7 9 11

2/06/2015

3/06/2015 4/06/2015 5/06/2015

K

Where location comes from?

geonames38%

none50%

twitter12%

Geo ??Actually it was

Tweets of Bogot - Worldwide

Tweets of Bogot - Worldwide0 50 100 150 200 250 300

United StatesMexico

United KingdomBrazil

RussiaArgentina

ChinaVenezuela

CanadaDominican Republic

SpainItaly

AngolaFrance

EthiopiaFalkland Islands (Islas Malvinas)

UkraineHonduras

IndiaEcuador

Costa RicaBangladesh

Tweets of Bogot - Regional

Tweets of Bogot - Regional

0 100 200 300 400 500

SOACHACAJIC

ZIPAQUIRCHA

MOSQUERAFUNZA

FUSAGASUGFACATATIV

TENJOGIRARDOT

TOCANCIPSOPONILO

MADRIDCOTA

SUBACHOQUEANAPOIMA

LA\VEGALA\CALERA

SIBATEL COLEGIO

TABIOCQUEZALA\MESA

Tweets of Bogot Urban Area

Tweets of Bogot Urban Area

Tweets of Bogot Urban Area

6-9 11-14 19-23

Users

Who Tweets about Bogot ?0 100 200 300 400 500 600 700 800

trendinaliaCOTatisCd

LuchoJacobsenMarynLima

stephaniemm19JennRousesalejo_zepol

MabeelTorres__MDRE

JohnAArangoDiegoACristC

trampastejoAnitha_331

Prensa_AlcaldiaMimamamemima_11

MadsxbieberSaraDFlorezCanoAlekos

Doncabron___Sanchez02_JenniferMyMs

numeral767Eninglishplis

ErikaTatiana_DTpaulitaamayas

Who Tweets about Bogot ?

Prensa_Alcaldia 119 numeral767 109 BogotaGay 76 TrendsBogota 55 radionica 49 urnadecristal 41 CAR_Cundi 35 PrensaLaNacion 35 umvbogota 31

Oitbogota 28 igacColombia 24 uldaricorape 24 AmbienteBogota 21

diegopajarito 2 Dianazul 0 EsriCol 1

What they Tweet about ?

What they Tweet in the morning?

What they Tweet in lunch time?

What they Tweet at night ?

What multimedia they share?

To ImproveUse it !!!

Big Data Tools - Pros and Cons

Are they representative of reality ? Do they show any relevant trending ? More Social Networks must be included Do local authorities care about this tools ?

- I.E. Bogot is working with linked data

Big Data Technology - Pros and Cons

Is not all about Volume (Velocity and Variability)

CSV Storage problems with Special Characters ( , \n . ) Date format and time zone

- Directly to Geodatabase

Word Count API is not fully developed- Code it

Graphs and maps does not show the hole history- Try, Try, Try, .

Future Works

Linked Data for interoperability GIS to RDF translation (@dianazul) Multiple City Estimation and Comparison Business Model for consultancy ArcGIS Toolbox like spatio-temporal cubes Zoning and grid processing Share and test this development

Visualizing Bogots dynamics with Big Data

Tools and ArcGISDiana Figueroa CeferinoDiego Pajarito Grajales

@dianazul@diegopajarito

Visualizing Bogots dynamics with Big Data Tools and ArcGISBig Data ToolsWhat we asked Twitter?BogotTweets per DayTweets per DayWhere location comes from?Geo ??Tweets of Bogot - WorldwideTweets of Bogot - WorldwideTweets of Bogot - RegionalTweets of Bogot - RegionalTweets of Bogot Urban AreaTweets of Bogot Urban AreaTweets of Bogot Urban AreaUsersWho Tweets about Bogot ?Who Tweets about Bogot ?What they Tweet about ?What they Tweet in the morning?What they Tweet in lunch time?What they Tweet at night ?What multimedia they share?To ImproveBig Data Tools - Pros and ConsBig Data Technology - Pros and ConsFuture WorksVisualizing Bogots dynamics with Big Data Tools and ArcGIS