how can you use fme to power your open data initiative?

15
CONNECT. TRANSFORM. AUTOMATE. Use FME to power your Open Data Initiative Brett Lord-Castillo GIS Programmer, St Louis County

Upload: safe-software

Post on 10-May-2015

412 views

Category:

Technology


0 download

DESCRIPTION

Presented by Brett Lord‐Castillo, St. Louis County Police See more FME World Tour 2014 presentations at www.safe.com/recap2014

TRANSCRIPT

Page 1: How Can You Use FME To Power Your Open Data Initiative?

CONNECT. TRANSFORM. AUTOMATE.

Use FME to power yourOpen Data InitiativeBrett Lord-CastilloGIS Programmer, St Louis County

Page 2: How Can You Use FME To Power Your Open Data Initiative?

Open Data Definitions

Open Licensing Machine Readable Open Format Bulk Access Discoverable (http://okfn.org/opendata/) (http://opendefinition.org/od/)

Page 3: How Can You Use FME To Power Your Open Data Initiative?

Open Formats

Shapefile

CSV

GeoJSON

TopoJSON?

(Yes, there are other options)

Page 4: How Can You Use FME To Power Your Open Data Initiative?

Bulk Access

Self-Host

Socrata

CKAN/DKAN

GitHub? Yes, GitHub

Page 5: How Can You Use FME To Power Your Open Data Initiative?

File Geodatabase to Socrata

Writing to https://communities.socrata.com/catalog/rhok-st-louis

Just a reader and a writer Edit writer feature types Pay attention to your geometry column

Page 6: How Can You Use FME To Power Your Open Data Initiative?

We get a little bit crazy

Three different datasets

Vague attribute names

Some records are in the wrong projection!

Page 7: How Can You Use FME To Power Your Open Data Initiative?

This is Not Alternative UniverseSt Louis County

Page 8: How Can You Use FME To Power Your Open Data Initiative?

File Geodatabase to GeoJSON

Live Demo!

Live Demo!

Live Demo!

Page 9: How Can You Use FME To Power Your Open Data Initiative?

ArcSDE to GeoJSONWe get more than a little bit crazy

One Writer to rule them all

Remove all sorts of attributes

Use fme_feature_type to fanout

(Not crazy enough to do this live)

Page 10: How Can You Use FME To Power Your Open Data Initiative?

But we can do this live!

Modify ToSocrata workbench to write GeoJSON1. Copy transformers and dynamic GeoJSON writer

from last workbench2. Remove the SubstringExtractor3. Edit writer Advanced Properties

Destination Fanout Attribute

4. Run?

Page 11: How Can You Use FME To Power Your Open Data Initiative?

So you have an error…

Remember to set your Dynamic Properties too!

This error fixed by adding Schema Sources

Page 12: How Can You Use FME To Power Your Open Data Initiative?

Bringing into GitHub (simple)

Go to GitHub repository online

Create a new file

It’s text! Copy-paste!

Save with .json extension

Go to your file and see the pretty!

Page 13: How Can You Use FME To Power Your Open Data Initiative?

Bringing into GitHub (less simple)

Use a client

https://windows.github.com/

https://mac.github.com/

Or use git

Zip big files! (or post-process with TopoJSON)

https://github.com/mbostock/topojson

Page 14: How Can You Use FME To Power Your Open Data Initiative?

Wishlist

Publish to GitHub API Git?

README.md writer Write a text file in markdown

TopoJSON writer Publish Metadata to Socrata

Might be a bit more complicated

Page 15: How Can You Use FME To Power Your Open Data Initiative?

Thank You!

Questions?

For more information: Brett Lord-Castillo:[email protected] St Louis County Emergency Management @blordcastillo http://github.com/blordcastillo http://github.com/marigolds6