linked open govt data - sem tech east
DESCRIPTION
Keynote talk at 2011 Semantic Technology and Business conference - Washington DC, November 30, 2011. This updates my earlier slideshare talk on linked open govt data - new slides from slide 17 on.TRANSCRIPT
![Page 1: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/1.jpg)
Tetherless World Constellation
Linking Open Government Data
http://logd.tw.rpi.edu
Jim HendlerTetherless World Professor of Computer and Cognitive Science
Assistant Dean of Information Technology and Web Science
Rensselaer Polytechnic Institutehttp://www.cs.rpi.edu/~hendler
@jahendler (twitter)
![Page 2: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/2.jpg)
Tetherless World Constellation
Government Data on the Web
![Page 3: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/3.jpg)
Tetherless World Constellation
Government Data SharingJa
nu
ary
1,
20
09
“Openness will strengthen our democracy and promote efficiency and effectiveness in Government.”
--- President Obama
Putting Govt Data online-Data.gov.uk beta
Ma
y 2
1,
20
09
Jan
ua
ry 1
9,
20
10
data.gov.uk online
Ma
y 2
1,
20
10
data.gov online data.gov relaunchwith semantic webfeatured
Jun
e3
0,2
00
9
De
cem
be
r 8
, 2
00
9
“Open GovernmentDirective” released
2009 2010 …
57 Data Sets
~6000 Data Set
~2000 Data Sets
>305,000 Data Sets
![Page 4: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/4.jpg)
Tetherless World Constellation
Important to the citizens: eg. Education
Data.gov.ukRPI NYS demos
![Page 5: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/5.jpg)
Tetherless World Constellation
Moving data.gov to linked data (UK)
• Built around “linked data” from the start
• Authorization for this from the Prime Minister
![Page 6: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/6.jpg)
Tetherless World Constellation
Moving data.gov to linked data (US)
• Third parties (like RPI) translate the government datasets into linked data formats
• US Data.gov hosts 6.4B RDF triples 5/21/2010• Semantic Web community hosted • http://data.gov/semantic
![Page 7: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/7.jpg)
Tetherless World Constellation
Linked data lets us create “Data” Mashups
More than 50 of these at http://logd.tw.rpi.edu(and lots more at data.gov.uk)
![Page 8: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/8.jpg)
Tetherless World Constellation
Data.gov + epa.gov
![Page 9: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/9.jpg)
Tetherless World Constellation
![Page 10: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/10.jpg)
Tetherless World Constellation
Adding some Web magic
Web Analytics
Social Data Networks
External Links
![Page 11: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/11.jpg)
Tetherless World Constellation
Linking GDP of the US and China
GDP of China (Billion Chinese Yuan )
GDP of the US (Billion Dollar)
[Temporal Mashup] bea.gov + federalreserve.gov +stats.gov.cn
![Page 12: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/12.jpg)
Tetherless World Constellation
Linking GDP of the US and China
GDP of China (Billion Chinese Yuan )
GDP of the US (Billion Dollar)
[Temporal Mashup] bea.gov + federalreserve.gov +stats.gov.cn
This mashup was built in less than 4 hours – including conversion of data, web interface, and visualization!
![Page 13: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/13.jpg)
Tetherless World Constellation
Govt systems can use linked data web for context
Datasets: acres burned, and agency budgetsDbpedia: wikipedia descriptions of major US fires
![Page 14: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/14.jpg)
Tetherless World Constellation
Integrate with Social media
![Page 15: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/15.jpg)
Tetherless World Constellation
Combining data from different data sharing sites
![Page 16: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/16.jpg)
Tetherless World Constellation
RPI workflow enhances raw RDF w/useful URIs
Convert
derive derive
create
derive
revision
Access
Enhance
Version
SemDiff
![Page 17: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/17.jpg)
Tetherless World Constellation
http://logd.tw.rpi.edu demos, tutorials, RDF-ized datasets, and more
![Page 18: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/18.jpg)
Tetherless World Constellation
![Page 19: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/19.jpg)
Tetherless World Constellation
Government Data in the linked open data cloud
http://linkeddata.org/
Government Data is currently over ½ the cloud in size (~17B triples), 10s of thousands of links to other data (within and without)
![Page 20: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/20.jpg)
Tetherless World Constellation
URI design
• URI design is crucial to govt data sharing – esp. within govts– Whether your goal is linked data or not
• UK Government has designed and made great use of standard URI practices in their linked data – US exploring URI design schemes
• Join the community at Semantic.data.gov and participate!
![Page 21: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/21.jpg)
Tetherless World Constellation
Instance Hub
![Page 22: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/22.jpg)
Tetherless World Constellation
Example: US States
![Page 23: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/23.jpg)
Tetherless World Constellation
Example: US Govt Agencies
![Page 24: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/24.jpg)
Tetherless World Constellation
Etc.
![Page 25: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/25.jpg)
Tetherless World Constellation
Metadata design
• Metadata design is crucial to govt data sharing– Needed for search and federation in large data
sharing efforts
• International data sharing will be a crucial next step– W3C Govt Linked Data Working Group– Need for vocabularies within govt sectors
• Esp for cross-langauge use
![Page 26: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/26.jpg)
Tetherless World Constellation
International Open Government Data Search
![Page 27: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/27.jpg)
Tetherless World Constellation
There’s lots of data out there!!
![Page 28: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/28.jpg)
Tetherless World Constellation
Searching for data
• Faceted browser with– Keyword search– Catalogs– Countries– Agencies– Categories– (in any order)
![Page 29: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/29.jpg)
Tetherless World Constellation
Details and download…
http://logd.tw.rpi.edu/demo/international_dataset_catalog_search
![Page 30: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/30.jpg)
Tetherless World Constellation
Research remains to be done…(it ain’t all hackathons and contests)
• Trust– Government data is controversial, and potentially biased
• How do we confirm or dispute?
• Combination– When we combine data we need to keep the provenance of
information (see trust)• How can we show and use?
• Scaling– Our project has already converted 9.9B triples from only >2,000
of the 440,000 government databases we can identify (116 catalogs, 38 countries, 16 languges)
• Versioning and updating• Archiving• Visualization• …
![Page 31: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/31.jpg)
Tetherless World Constellation
Exploring new visualizations
Data from http://littlesis.org
![Page 32: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/32.jpg)
Tetherless World Constellation
Summary
• Open Govt data is a critical resource– Government data released as RDF (UK)– Government data converted to RDF (US)– Government data that can be found in many forms and used
or converted (WWW)
• Government transparency comes through in the “mashing up” of data from many datasets– Key to linked data
• An amazing opportunity for technologists (public and private) to play in an important area of the public good– Innovation needed!
![Page 33: Linked Open Govt Data - Sem Tech East](https://reader034.vdocuments.mx/reader034/viewer/2022042814/554d96d6b4c90567188b554b/html5/thumbnails/33.jpg)
Tetherless World Constellation
Questions?
http://logd.tw.rpi.edu