Open Data and Big DataJohn van Echtelt

Business Model Innovator

2013 ConferenceWarsaw, Poland

22 February 2013

2

Raw Data

It is NOT about the kind of DATA

Open Closed

Big Little

Linked

3

It is about HOW to create VALUE

Wisdom

Knowlegde

Information

Data

Valu

e

4

It is about new BUSINESS MODELS, ...

…about TRANSFORMATION…

5

Small, medium and large

companies

Civil Society organizations

Knowledge institutes

Governments

People

Cross sector

Cross border

Open Data Maturity Model 6

Scattered spreadsheets and PDFs online

Clumsy custom web apps

Basic catalog of downloadable files (CSV, XLS, SHP, ZIP, PDF)

Expensive custom web apps

Manual data publishing

Interactive data tables, basic data visualizations (charts & maps), Social sharing,

Manual data publishing

Consumer-style web experiences

Apps, mashups,dashboards, data-driven storytelling

Custom APIs and developer docs

Automated data publishing, federation and distribution

Web and mobile experience design

Data for fact-based decisions and performance

Embedded data experiences (Yelp, Google)

Crowd-sourced data: human sensor network

Plug-and-play apps

Real-time, data ecosystems and industry exchanges

Internal data collaboration hubs

Organization’s Open Data Maturity Level

7

Socrata Customer Case Studies

8

Medicare Data Unleashed 8

Challenges:

• Hard to find data

• Inaccessible datasets

• No data-sharing infrastructure

Socrata Provides:• Cloud-based infrastructure• Full data lifecycle management• Interactive exploration• Live data distribution• Automatic API access• Usage and analysis metrics• Federation to data.govResults (since 8/31/10):• 10+ million page views• 1,460% YoY growth• 2.7 Terabytes served• 420 datasets• Private providers using the data via API

9

Health Indicators Visualized 9

Challenges:

• Present metrics quantifiably

• Provide public data consumption

• Legacy BI platform rigid & expensive

Socrata Provides:• Cost-effective data warehouse• Advanced metadata management• Enriched visualizations• Configurable web experience Results:• Half the cost of alternatives• Makes BI licenses obsolete• Expanded reach• Visualized U.S. healthcare system• Easy data maintenance

10

Access to Healthcare Mobilized 10

Challenges:

• Provide help anytime, anywhere

• Reach teens

• Multiple fragmented databases

• 24x7 call center operations

Socrata Provides:• 100% cloud-based infrastructure• Full data lifecycle management• Interactive data discovery• APIs to enable unlimited reuse of data• Maps & charts on the web• Federation to data.gov Results:• One consolidated “logical” database • Extend reach of treatment facilities• Low cost self-service capabilities

11

Energy Efficiency Data Consumerized

Challenges:

• Empower consumers

• Comply with new regulations

• Hard to enable partners

• Slow & costly

• Build-it-yourself too expensive

Socrata Provides:• 100% turnkey cloud-based solution• Easily create consumer web interfaces• Developer-ready API for product catalogs• Easy visualization of efficiency ratingsResults:• Easy to use “Product Finder” Apps• System supports complex data analysis • Automatic product status updates via API• Repeatable process applied to 60 product

catalogs

think bigdata. start smartdata. scale fastdata

Uses CasesTurn data into apps & speed-up pace of innovation

Smart citiesInternet of things

Ecomobility

Crowdsourcing

Predictiveanalytics

M2M

All industries come to deliver smart services

« Open data strategy should be a top priority for any organization that uses the Web as a channel for delivering goods and services …

Open data APIs are a lightweight approach to data exchange.

Their use is now considered a best practice for opening data and functionality to developers and other businesses. »

(Gartner – août 2012)

IT paradigm has changed towards apps model(internet-based, data-driven, cloud-based)

We need to unlocking (open) all data fields opportunities

CUSTOMERS USE CASES

• Industry & Services sensors + open data + API open data easy preparation & publishing open data + crowdsourcing platform

• Government open data V2 (API-fication, linked data) tourism data management (Wordpress, Drupal …)

Collaborative Data ManagementAn open data project is notan open data portal projectIT’S ALL ABOUT WEB & API

Utilities – Real-time geo-mashuping

Data sources• open data

(files from the web)• sensors data

(internal network data)• real time data

(web API e.g. weather)

Utilities - Crowdsourcing

Open cities – Smart solutions

Open cities – Decision making