dkan: the drupal open data distribution (presented at sandcamp san diego drupalcamp)
DESCRIPTION
Presentation about DKAN, the open data distribution of Drupal, given at San Diego Drupalcamp in January 2014.TRANSCRIPT
2013 US Federal Project Open Data
2009 Data.gov
2009 Data.gov.uk
Facili&es
2012 Local Laws....
Facili&es
Resulting in New Open Data Portals
Open Data: Government Opera/ons Innova/on
Facili/es
Open Data: Civic Empowerment
Facili/es
Open Data: Economic Development
Facili/es
(Shout-‐Out: Portland CivicApps <-‐-‐> CitySync)
2013 Civic Open Data Ecosystem: 100s of Companies, 1000s of Governments, 10,000s of Apps, 1,000,000s of Data Sets...
San Diego is Next!
Proprietary SaaS Open Data Portal Market Leaders
CKAN: Open Source Market Leader
More About CKAN
Python
Javascript
ORM: Pylons web framework & SQLAlchemy
PostgrSQL
Jinja2 Template Engine
SOLR
Modular; ~40 extensions
In 2012 CKAN Broke Out...
CKAN In the US
CKAN Worldwide
• No vendor lock-In / choice of consultants / ability to build in-house capacity • Collaborate w/ our peers (White House)
• Security transparency (US DoD is a major consumer for this reason)
• Open-Source platforms often pay more heed to open formats and standards (e.g.: DCAT, RDFa, OData, JSON vs Shapefiles, PDF, etc.)
• Innovation: healthy open-source projects can aggregate more engineering effort than proprietary alternatives, propagate great new extensions faster
• Freedom of Hosting Options: consume as a cloud-hosted service today, change our mind and host in-house tomorrow, etc.
Why Open-Source Matters...
http://flickr.com/photos/rocketqueen/1573565705/
But Data.gov.uk, Data.gov, HealthData.gov, OpenGovPlaKorm, etc. all added Drupal to CKAN
If you Already Use Drupal, Do You Really Need CKAN?
With DKAN Distro, Drupal Itself Now Also Becoming a Public Sector Data Management System (“DMS”)
• Manage content, data, permissions through same platform
• Single software stack to maintain
• Single site to design & theme
• Easy to extend with social features
• Transparent, well-governed upgrade path of Drupal • Extensive Drupal ecosystem of civil service talent, consultants, hosting, support
Why DKAN Instead of Drupal+CKAN?
• MATURE: >1 million sites (2% of all sites), 3,718 Code commits/wk, 6,388 issue comments/wk • IN-‐HOUSE SKILLS: 24% of .gov sites
• EXTENSIBLE: 18,489 Modules, 1,512 Themes, 21,009 Contributors
• FISMA-‐Cer&fied Cloud Hos&ng Op&ons
• INTEGRATES easily w/ public websites lots of de facto data is already published as content
Why Drupal?
Why Drupal? Open Content since 2009...
24
WhiteHouse.gov
NYSenate.gov
h_p://flickr.com/photos/rocketqueen/1573565705/
Content = Data (Legislative Committees)
Open Data Sets Catalog
Custom Search for Special Data Types
http://flickr.com/photos/rocketqueen/1573565705/
Allow Data to be Augmented
Make it Easily Discoverable...
31
And Accessible Everywhere...
http://flickr.com/photos/rocketqueen/1573565705/
...And Easily Shared
Drupal “DKAN” Distribu&onOpen-‐Source Data Management System (DMS)
+ Content Management System (CMS) = Streamlined Data Collabora&on
Open Data is Just “Sharing Your Files”
• Datasets are collec&ons of resources, with some descrip&ve metadata
• Resources are just files. They can be any kind of file, but ohen they are CSV files, spreadsheets or some other kind of tabular data file.
• Organiza&ons create datasets and upload resources.
• Data consumers can browse datasets and some&mes see visualiza0ons of resources.
34
DKAN• Fully functional data portal housing datasets, Solr search, accessible via JSON and RDF; csv or xml files uploaded through Drupal, stored in *SQL, visualized through Recline.js
• Seeks to replicate CKAN 2.0 functionality, design, standards, & API
• Reuses CKAN components wherever possible (e.g.: Recline.js)
• Built with support and input from the Open Knowledge Foundation
• Fully open project, with code on Drupal.org/project/DKAN
• DKAN Distribu&on
DKAN Datasetmodule
DKAN Datastoremodule
DKAN Components
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
DKAN Walkthrough
Early Returns: Cologne, Germany
Early Returns: Puerto Rico
Early Returns: CivicInfo British Columbia
Early Returns: Data Wisconsin
• Adding feedback on datasets, other social features
• Support for addi&onal file types
• Adding DKAN_DataSet & DKAN_DataStore modules to other Distros like OpenCivic
•Offering enterprise support & hosted OpenSaaS DKAN
Ongoing Development
• NuData = our DKAN as a turnkey hosted 24/7 supported sohware-‐as-‐a-‐service
• Governments like SaaS like Socrata because it’s quick, affordable, and no technology burden on exis&ng staff
• Governments like open-‐source (e.g.: CKAN) because they’re in control-‐-‐ no vendor lock-‐in, ability to customize, innovate
• OpenSaaS = the best of both worlds; SaaS but truly open-‐-‐ you can take your app and your data with you with minimal switching cost
• Drupal is excep&onally well posi&oned to enable OpenSaaS businesses
“NuData DKAN” OpenSaaS Offering
Drupal Open Data Policy Compliance Recipesadd /data.html & /data.json pages
to existing Drupal site with new Open
Data Module? (sandbox project)
add data management &
publishing features to a Drupal site with
DKAN Data Set & DKAN Data Store
Modules
deploy new Open Data Catalog / Portal
with the DKAN Distribution, on your
own, or as SaaS
Followup
Project Page: http://drupal.org/project/DKAN
“Fully Made” DKAN w/ .js libraries: https://github.com/nuams/dkan
Marketing Site: http://nucivic.com/dkan/
[email protected] | @ahoppin | nuams.com | nucivic.com