dchc mpo open data implementation · 2009 memorandum for the heads of executive departments and...

DCHC MPO Open Data Implementation

Durmus Cesur, Ph. D., PMP, PE, GISP, ITIL-F… DCHC MPO

Application Support Manager Email: durmus.cesur@durhamnc.gov

Tel: (919) 560-4366- ext. 36461 Felix Nwoko, Ph.D.

MPO Manager/Executive Director Email: felix.nwoko@durhamnc.gov

Tel: 919-560-4366-36424

Outline Open Government

Open Data

ArcGIS Open Data

MPO ArcGIS Open Data

DCHC MPO Open Data Benefits

DCHC MPO Open data Implementation Plan

Progress (Present)

Benefits

Challenges

Future

Conclusions

Open Government 1996 Freedom of Information Act (FOIA) (http://www.gpo.gov/fdsys/pkg/STATUTE-80/pdf/STATUTE-80-Pg250.pdf ) Allows for the full or partial disclosure of previously unreleased information and documents controlled by the United States government 2009 Memorandum for the Heads of Executive Departments and Agencies Government entities (https://www.whitehouse.gov/the_press_office/transparencyandopengovernment/)

Should be transparent Should be participatory Should be collaborative

2009 Memorandum for the heads of executive Departments and Agencies Steps toward the goal of creating a more open government (Open Data Directive) (https://www.whitehouse.gov/open/documents/open-government-directive )

Publish Government Information Online Improve the Quality of Government Information Create and Institutionalize a Culture of Open Government

Open Data Make the public data broadly

Discoverable

Accessible

Analyzable

Usable

by people and other compatible systems, free of any:

Technological

Legal

Usability barriers

City of Durham currently implementing Open Data!!

Open Data – General Benefits Provide real-time information with quality using various

formats, and channels/mechanisms to public/partners

Improve transparency, readability

Improve accountability and governance of the agencies

Promote connection with citizens /public /partners

Enhance citizen engagement/collaboration in decision making to improve plans, policies, and actions

Especially for MPOs directly supports: “3-C planning principles” - The transportation planning processes and their products are greatly improved when implemented through a comprehensive, cooperative, and continuous approach”

Open Data – Value

Open Data makes Regional Government Entity, MPO, work better with partners and public in collaboration

Creation of new management tools

Streamlining the data supply chain

Programs and services collaboration to gather data

Produce multichannel enriched data in real-time

De-silo programs and services

Accountability and Value for Money

Create data driven “dashboards” for fact-based decisions and performance

Strengthen the involvement of the civil servants in their daily work

Open Data - Data Publishing Process Data readiness assessment: informal discussion among

organizational people regarding data to be opened to public Data inventory: Listing of the data products produced that

comply with open data and data restriction policies and noting the data lifecycle cycle

Data staging: Data are mined and checked for personally identifiable information and any constraints and staged on the data portal as a restricted dataset

Data QA: Data stewards (SMEs) is engaged to preview the data and make any recommendations regarding the fitness of the data for publication

Data Release: Data Steward agree on release date working with Application Support Team and data is released to the public on agreed date

Data Refresh Cycle: Data is refreshed according to the latest datasets available based on data lifecycle

MPO: Impact

Identify data stewards for datasets

Only data that matches the open data definitions will be allowed

NO data exposing a personal identity information

NO data that compromises public safety or MPO operations

High value open datasets in machine readable format

Cooperation in building and maintaining a comprehensive data catalog

ArcGIS Open Data A platform:

Provide the public with open access to the organizational geospatial data

Have configurable/customizable web interface Share specific items with Open Data groups Be used by public/partners to search, to view, analyze/filter,

and download data Users:

Discover, explore, download data, or share a link to an interesting datasets

Analyze/Filter data through charts, tables, and maps Organizations:

Set up customized website and share the authoritative data with public

Allow anyone to search, view, analyze, download the data in multiple formats and share links to filtered datasets

MPO ArcGIS Open Data • To make the MPO geospatial data easy to discover, explore,

analyze, download and share with partners and public

• To leverage existing infrastructure/systems of the MPO which are formed by enterprise GIS, ArcGIS Online and others

• To provide real-time data updates in a consistent manner with quality

• To avoid duplication and associated efforts caused by the other methods/mechanisms of data deliveries (zipping, ftp, email etc.)

• To complement City of Durham’s Open Data Initiative by providing geospatial data accessibility

Implement ArcGIS Open Data

DCHC MPO Open Data Implementation Benefits

Expose DCHC MPO data leveraging existing enterprise infrastructure and ArGIS Online

Provide real time data updates to partners and public as it pertains to MPO planning, modeling and operational activities

Enable public and partners to visualize, explore, filter, and download the data

Avoid data zipping and other duplicative work to provide data over the web

Provide better streamlined access to data resources of the MPO

DCHC MPO ArcGIS Open Data Implementation ArcGIS Open Data (running on top of AGOL)

Enterprise GIS, and Other Web Services

Enterprise GIS and other Databases and infrastructure

MPO ArcGIS Open Data Implementation Plan

Develop project management plans Set up open data groups with associated privileges to expose data with

associated workflow Customize ArcGIS Open Data site for better access to the data Decide and prioritize geospatial data and non-spatial related tables to be

exposed through ArcGIS Open Data through phased approach Standardize and QA/QC the data and associated services to be exposed using

ArcGIS Open Data Populate services with associated metadata (summary, detailed description),

tags (keywords) , thumbnails, and in case needed register the layers individually as items in ArcGIS online to provide better description/info about each layer and share with open data group(s)

Develop, finalize documentation including procedures, user manual and others.

Implement CKAN (ArcGIS Open Data supports this) to support harvesting (automatically import datasets from other sites supporting CKAN sites/systems) of the data.

Implementation Resources (Stakeholders)

MPO personnel

MPO Partners; cities, counties, and other communities within MPO region

City of Durham TS Department

Assumptions

Complete collaboration by and with end users

Standardized business processes and workflows for data sharing using ArcGIS Open Data

Collaboration by City of Durham Technology Solutions

Collaboration with partners

Progress : ArcGIS Open Data Platform Set up/configured Open Data Set up open data group(s) QA/QC’ed and standardized data/services Populated services with associated metadata and publish

metadata of the datasets as well Customized Open Data web application Shared prioritized/decided data items with the open data

groups Developed documentation Expose Open Data site to the public/partners after internal

review Continually improve by incorporation of new/updated datasets

and enhanced interface based on feedback

Data Layers Exposed through ArcGIS Open Data Comprehensive list of the datasets being exposed

through ArcGIS Open Data

ArcGIS Open Data Standards and Documentation

The standards included the following:

Implementation standards/documents

Metadata Standard

Open Data Standard (includes naming convention and others)

QAQC checklists

Data Migration standards (SOPs)

Others

User Support/Training Support on:

Use of Open Data Platform

Open Data Manual

Others

Technical troubleshooting

Others

Demo

DCHC MPO Open Data

http://data.dchcmpo.opendata.arcgis.com/

DCHC MPO ArcGIS Open Data

Searching for Data

Finding Data Details

Data in tabular format

Analyzing/Charting Data

Generating Embeddable Charts

Data Visualization

Filtering Data based on Map and Attributes

Downloading/Accessing and Sharing Data

Download the Filtered Records

ArcGIS Open Data Benefits Easy discovery, access, and download of the geospatial

data in real time in various formats

Prevent duplicative data compilation efforts

Intuitive easy to use interface

Provide visualization and limited analytical capabilities

Provide attribute and spatial filtering capabilities

Readily incorporates with existing enterprise GIS platform(s) to a degree

ArcGIS Open Data Challenges

Supported for data formats

Data download/View compatibility/consistency on aliases, field names etc. for the download formats

Metadata posting and download

Download of multiple layers

Further visualization capabilities

Implementation of data harvesting on windows platforms

Customization limitations

Others

ArcGIS Open Data Future at DCHC MPO

Customize the site further for easy and streamlined access to data resources of the MPO

Share more data with public and users after QA/QC and standardization

Integrate Open Data with DCHC MPO Website/Portal Continue user support and training Plan for future expansion/extension of Open Data platform for better

data access by the public and the partners

Conclusions ArcGIS Open Data platform for MPO provided:

A way to communicate up-to-date data to public and partners in various formats

Allowed minimal replication/duplication of the data through readily integration with Enterprise GIS background systems/services

Easy to use website interface to discover, view, analyze, filter, download and share data

Thank you !

Any questions ?

Durmus Cesur, Ph. D., PMP, P.E.,…

Email: durmus.cesur@durhamnc.gov

Application Support Manager

Felix Nwoko, Ph.D.

Email: felix.nwoko@durhamnc.gov

MPO Administrator/Executive Director