dchc mpo open data implementation · 2009 memorandum for the heads of executive departments and...
TRANSCRIPT
DCHC MPO Open Data Implementation
Durmus Cesur, Ph. D., PMP, PE, GISP, ITIL-F… DCHC MPO
Application Support Manager Email: [email protected]
Tel: (919) 560-4366- ext. 36461 Felix Nwoko, Ph.D.
MPO Manager/Executive Director Email: [email protected]
Tel: 919-560-4366-36424
Outline Open Government
Open Data
ArcGIS Open Data
MPO ArcGIS Open Data
DCHC MPO Open Data Benefits
DCHC MPO Open data Implementation Plan
Progress (Present)
Benefits
Challenges
Future
Conclusions
Open Government 1996 Freedom of Information Act (FOIA) (http://www.gpo.gov/fdsys/pkg/STATUTE-80/pdf/STATUTE-80-Pg250.pdf ) Allows for the full or partial disclosure of previously unreleased information and documents controlled by the United States government 2009 Memorandum for the Heads of Executive Departments and Agencies Government entities (https://www.whitehouse.gov/the_press_office/transparencyandopengovernment/)
Should be transparent Should be participatory Should be collaborative
2009 Memorandum for the heads of executive Departments and Agencies Steps toward the goal of creating a more open government (Open Data Directive) (https://www.whitehouse.gov/open/documents/open-government-directive )
Publish Government Information Online Improve the Quality of Government Information Create and Institutionalize a Culture of Open Government
Open Data Make the public data broadly
Discoverable
Accessible
Analyzable
Usable
by people and other compatible systems, free of any:
Technological
Legal
Usability barriers
City of Durham currently implementing Open Data!!
Open Data – General Benefits Provide real-time information with quality using various
formats, and channels/mechanisms to public/partners
Improve transparency, readability
Improve accountability and governance of the agencies
Promote connection with citizens /public /partners
Enhance citizen engagement/collaboration in decision making to improve plans, policies, and actions
Especially for MPOs directly supports: “3-C planning principles” - The transportation planning processes and their products are greatly improved when implemented through a comprehensive, cooperative, and continuous approach”
Open Data – Value
Open Data makes Regional Government Entity, MPO, work better with partners and public in collaboration
Creation of new management tools
Streamlining the data supply chain
Programs and services collaboration to gather data
Produce multichannel enriched data in real-time
De-silo programs and services
Accountability and Value for Money
Create data driven “dashboards” for fact-based decisions and performance
Strengthen the involvement of the civil servants in their daily work
Open Data - Data Publishing Process Data readiness assessment: informal discussion among
organizational people regarding data to be opened to public Data inventory: Listing of the data products produced that
comply with open data and data restriction policies and noting the data lifecycle cycle
Data staging: Data are mined and checked for personally identifiable information and any constraints and staged on the data portal as a restricted dataset
Data QA: Data stewards (SMEs) is engaged to preview the data and make any recommendations regarding the fitness of the data for publication
Data Release: Data Steward agree on release date working with Application Support Team and data is released to the public on agreed date
Data Refresh Cycle: Data is refreshed according to the latest datasets available based on data lifecycle
MPO: Impact
Identify data stewards for datasets
Only data that matches the open data definitions will be allowed
NO data exposing a personal identity information
NO data that compromises public safety or MPO operations
High value open datasets in machine readable format
Cooperation in building and maintaining a comprehensive data catalog
ArcGIS Open Data A platform:
Provide the public with open access to the organizational geospatial data
Have configurable/customizable web interface Share specific items with Open Data groups Be used by public/partners to search, to view, analyze/filter,
and download data Users:
Discover, explore, download data, or share a link to an interesting datasets
Analyze/Filter data through charts, tables, and maps Organizations:
Set up customized website and share the authoritative data with public
Allow anyone to search, view, analyze, download the data in multiple formats and share links to filtered datasets
MPO ArcGIS Open Data • To make the MPO geospatial data easy to discover, explore,
analyze, download and share with partners and public
• To leverage existing infrastructure/systems of the MPO which are formed by enterprise GIS, ArcGIS Online and others
• To provide real-time data updates in a consistent manner with quality
• To avoid duplication and associated efforts caused by the other methods/mechanisms of data deliveries (zipping, ftp, email etc.)
• To complement City of Durham’s Open Data Initiative by providing geospatial data accessibility
Implement ArcGIS Open Data
DCHC MPO Open Data Implementation Benefits
Expose DCHC MPO data leveraging existing enterprise infrastructure and ArGIS Online
Provide real time data updates to partners and public as it pertains to MPO planning, modeling and operational activities
Enable public and partners to visualize, explore, filter, and download the data
Avoid data zipping and other duplicative work to provide data over the web
Provide better streamlined access to data resources of the MPO
DCHC MPO ArcGIS Open Data Implementation ArcGIS Open Data (running on top of AGOL)
Enterprise GIS, and Other Web Services
Enterprise GIS and other Databases and infrastructure
MPO ArcGIS Open Data Implementation Plan
Develop project management plans Set up open data groups with associated privileges to expose data with
associated workflow Customize ArcGIS Open Data site for better access to the data Decide and prioritize geospatial data and non-spatial related tables to be
exposed through ArcGIS Open Data through phased approach Standardize and QA/QC the data and associated services to be exposed using
ArcGIS Open Data Populate services with associated metadata (summary, detailed description),
tags (keywords) , thumbnails, and in case needed register the layers individually as items in ArcGIS online to provide better description/info about each layer and share with open data group(s)
Develop, finalize documentation including procedures, user manual and others.
Implement CKAN (ArcGIS Open Data supports this) to support harvesting (automatically import datasets from other sites supporting CKAN sites/systems) of the data.
Implementation Resources (Stakeholders)
MPO personnel
MPO Partners; cities, counties, and other communities within MPO region
City of Durham TS Department
Assumptions
Complete collaboration by and with end users
Standardized business processes and workflows for data sharing using ArcGIS Open Data
Collaboration by City of Durham Technology Solutions
Collaboration with partners
Progress : ArcGIS Open Data Platform Set up/configured Open Data Set up open data group(s) QA/QC’ed and standardized data/services Populated services with associated metadata and publish
metadata of the datasets as well Customized Open Data web application Shared prioritized/decided data items with the open data
groups Developed documentation Expose Open Data site to the public/partners after internal
review Continually improve by incorporation of new/updated datasets
and enhanced interface based on feedback
Data Layers Exposed through ArcGIS Open Data Comprehensive list of the datasets being exposed
through ArcGIS Open Data
ArcGIS Open Data Standards and Documentation
The standards included the following:
Implementation standards/documents
Metadata Standard
Open Data Standard (includes naming convention and others)
QAQC checklists
Data Migration standards (SOPs)
Others
User Support/Training Support on:
Use of Open Data Platform
Open Data Manual
Others
Technical troubleshooting
Others
Demo
DCHC MPO Open Data
http://data.dchcmpo.opendata.arcgis.com/
DCHC MPO ArcGIS Open Data
Searching for Data
Finding Data Details
Data in tabular format
Analyzing/Charting Data
Generating Embeddable Charts
Data Visualization
Filtering Data based on Map and Attributes
Downloading/Accessing and Sharing Data
Download the Filtered Records
ArcGIS Open Data Benefits Easy discovery, access, and download of the geospatial
data in real time in various formats
Prevent duplicative data compilation efforts
Intuitive easy to use interface
Provide visualization and limited analytical capabilities
Provide attribute and spatial filtering capabilities
Readily incorporates with existing enterprise GIS platform(s) to a degree
ArcGIS Open Data Challenges
Supported for data formats
Data download/View compatibility/consistency on aliases, field names etc. for the download formats
Metadata posting and download
Download of multiple layers
Further visualization capabilities
Implementation of data harvesting on windows platforms
Customization limitations
Others
ArcGIS Open Data Future at DCHC MPO
Customize the site further for easy and streamlined access to data resources of the MPO
Share more data with public and users after QA/QC and standardization
Integrate Open Data with DCHC MPO Website/Portal Continue user support and training Plan for future expansion/extension of Open Data platform for better
data access by the public and the partners
Conclusions ArcGIS Open Data platform for MPO provided:
A way to communicate up-to-date data to public and partners in various formats
Allowed minimal replication/duplication of the data through readily integration with Enterprise GIS background systems/services
Easy to use website interface to discover, view, analyze, filter, download and share data
Thank you !
Any questions ?
Durmus Cesur, Ph. D., PMP, P.E.,…
Email: [email protected]
Application Support Manager
Felix Nwoko, Ph.D.
Email: [email protected]
MPO Administrator/Executive Director