Download - The Web of Data emerging industries
![Page 1: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/1.jpg)
The Web of Data emerging industries
Michalis Vafopoulos,
vafopoulos.org 2014
Creative Commons LicenseThis work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
![Page 2: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/2.jpg)
![Page 3: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/3.jpg)
Contents
① The Web of documents vs. Web of data– Some technology– Some economics– ..and action
② PSNET project ③ and more…
3
![Page 4: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/4.jpg)
The Data trilogy
① Open: access
everyone to use and republish
② Big: scale
high volume, velocity and variety
③ Linked: use
publish once, use as many times
![Page 5: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/5.jpg)
The Web of Documents
• Simple, big and unstructured• Organized in Silos
But humans:• are interested in Things,no documents & these Things might be in docs or elsewhere
• Limited capacity to extract meaning...
5
![Page 6: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/6.jpg)
The Web of Data• Analogy: a global file system ----> global database• Designed for: human consumption ->machines first, humans
later
• Primary objects: documents --> things (or descriptions of things)
• Links between: documents --> things • Degree of structure in objects: fairly low ---> high• Semantics of content and links: implicit --> explicit
(Tom Heath)6
![Page 7: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/7.jpg)
The Web of Data: why?
7
encourages reuse reduces redundancy maximizes its (real and potential)
inter-connectedness enables network effects to add value
to data
![Page 8: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/8.jpg)
The Web of Data: how?
8
– current state on the Web• Relational Databases• APIs• XML• CSV• XLS
Computers can’t consume data because:• Different formats & models• Not inter-connected
![Page 9: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/9.jpg)
The Web of Data: how?
9
– we need to create a standard way of publishing Data on the Web (like HTML for docs)
This is the Resource Description Framework
(RDF)
(a simple example here from Juan F. Sequeda), more next semester!)
![Page 10: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/10.jpg)
Resource Description Framework (RDF)
• A data model – A way to model data– Inspired form Relational databases and
Logic
• RDF is a triple data model• Labeled Graph (semantic networks)• Subject, Predicate, Object<Isidoro> <was born in> <Chios><Chios> <is part of> <Greece>
![Page 11: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/11.jpg)
Example: Document on the Web
![Page 12: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/12.jpg)
Databases back up documents
Isbn Title Author PublisherID ReleasedData
978-0-596-15381-6
Programming the Semantic Web
Toby Segaran
1 July 2009
… … … … …
PublisherID PublisherName
1 O’Reilly Media
… …
This is a THING:A book title “Programming the Semantic Web” by Toby Segaran, …
THINGS have PROPERTIES:A Book as a Title, an author, …
![Page 13: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/13.jpg)
Data representation in RDF
book
Programming the Semantic
Web
978-0-596-15381-6
Toby Segaran
Publisher O’Reilly
title
name
author
publisher
isbn
Isbn Title Author PublisherID
ReleasedData
978-0-596-15381-6
Programming the Semantic Web
Toby Segaran
1 July 2009
PublisherID
PublisherName
1 O’Reilly Media
![Page 14: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/14.jpg)
Everything on the web is identified by a
URI!
![Page 15: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/15.jpg)
link the data to other data
http://…/
isbn978
Programming the Semantic
Web
978-0-596-15381-6
Toby Segaran
http://…/
publisher1
O’Reilly
title
name
author
publisher
isbn
![Page 16: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/16.jpg)
consider the data from Revyu.comhttp://
…/isbn978
http://…/
review1
Awesome Book
http://…/
reviewer
Juan Sequed
a
hasReview
reviewer
description
name
![Page 17: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/17.jpg)
start to link data
http://…/
isbn978
Programming the Semantic Web
978-0-596-15381-6
Toby Segaran
http://…/publisher
1O’Reilly
title
name
author
publisher
isbn
http://…/
isbn978
sameAs
http://…/
review1
Awesome Book
http://…/
reviewer
Juan Sequeda
hasReview
hasReviewer
description
name
![Page 18: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/18.jpg)
Juan Sequeda publishes data too
http://juansequeda.com/id
livesIn
Juan Sequedaname
http://dbpedia.org/Austin
![Page 19: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/19.jpg)
Let’s link more datahttp://
…/isbn978
http://…/
review1
Awesome Book
http://…/
reviewer
Juan Sequeda
http://juansequeda.com/id
hasReview
hasReviewer
description
name
sameAs
livesIn
Juan Sequedaname
http://dbpedia.org/Austin
![Page 20: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/20.jpg)
Linked data = internet + http + RDF
http://…/
isbn978
Programming the Semantic
Web
978-0-596-15381-6
Toby Segaran
http://…/
publisher1 O’Reilly
title
name
author
publisher
isbn
http://…/
isbn978
sameAs
http://…/
review1
Awesome Book
http://…/
reviewer
Juan Sequed
a
http://juansequeda.com/id
hasReview
hasReviewer
description
name
sameAs
livesIn
Juan Sequedaname
http://dbpedia.org/Austin
![Page 21: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/21.jpg)
Linked data = internet + http + RDF
![Page 22: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/22.jpg)
Linked Data Principles
1. Use URIs as names for things2. Use URIs so that people can
look up (dereference) those names.
3. When someone looks up a URI, provide useful information.
4. Include links to other URIs so that they can discover more things.
![Page 23: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/23.jpg)
Web as a database
Linked Data makes the web exploitable as ONE GIANT HUGE GLOBAL DATABASE!
Is there any query language like SQL?
SPARQL…
![Page 24: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/24.jpg)
Is it working?
• Current Employee Names, Salaries, and Position Titles
• The Open Database Of The Corporate World
• Crime map• NHS efficiency savings: the role of p
rescribing analytics• where public money goes worldwide
![Page 25: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/25.jpg)
Examples
Can you find the famous persons born in Beirut before 1900?
Or if the Greek Government buys sperm?
![Page 26: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/26.jpg)
Examples
#anoixtigenia, @vafopoulos
![Page 27: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/27.jpg)
Examples
#anoixtigenia, @vafopoulos
![Page 28: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/28.jpg)
May 2007
![Page 29: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/29.jpg)
![Page 30: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/30.jpg)
What is a Linked Data application/service?
Software system that makes use of data on the Web from multiple datasets and that
benefits from links between the datasets
![Page 31: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/31.jpg)
Characteristics of Linked Data Applications
• Consume data that is published on the web following the Linked Data principles: an application should be able to request, retrieve and process the accessed data
• Discover further information by following the links between different data sources: the fourth principle enables this.
• Combine the consumed linked data with data from sources (not necessarily Linked Data)
• Expose the combined data back to the web following the Linked Data principles
• Offer value to end-users
![Page 32: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/32.jpg)
the 5 stars of open linked data
★make your stuff available on the Web (whatever format)
★★make it available as structured data (e.g. excel instead of image scan of a table)
★★★non-proprietary format (e.g. csv instead of excel)
★★★★use URLs to identify things, so that people can point at your stuff★★★★★link your data to other people’s data to provide contexthttp://lab.linkeddata.deri.ie/2010/star-scheme-by-example/
![Page 33: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/33.jpg)
Two magics of Web Science: the case of Linked Data
![Page 34: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/34.jpg)
![Page 35: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/35.jpg)
The (practical) question
contextualized & hands-on experience in Semantic Web & Business 3.0 on a unique, fast evolving and semantified dataset
35
![Page 36: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/36.jpg)
PSNET project: the answer
The first attempt to generate, curate, interlink and distribute daily updated public spending data in LOD formats that can be useful to both expert (i.e. scientists and professionals) and naïve users.
36
![Page 37: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/37.jpg)
The context first…
37
![Page 38: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/38.jpg)
Research question
Web economy: from potential to actual
Enable new virtuous cycles in the economy through Linked Open Data
38
![Page 39: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/39.jpg)
EU Unification: the institutions
Best in theory – poor in practicea (complicated) market example• monetary policy, currency,
eurozone • European Single Market • fiscal policy FORTHCOMING
39
![Page 40: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/40.jpg)
EU Unification: the technology
Linked Data or Web of data• “publish once, use many times”. • different consumers extract
different slices of the data for different purposes
• publish in context: value & “meaning”
40
![Page 41: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/41.jpg)
EU Unification: the technology
• Linked Data (LD) + Open Data =LOD
• Economic LOD as “data currency”
41
![Page 42: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/42.jpg)
Why LOD?
• Transparency & innovation
Network effects: enabling users to • bidirectional & massively processable
interconnections among data • re-using the existing infrastructure in
the government and business spheres
42
![Page 43: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/43.jpg)
Economic LOD: the story so far
• Isolated/fragmented behind technological & institutional barriers
• General statistics: Eurostat etc. • LOD2 case • Some isolated projects
43
![Page 44: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/44.jpg)
budget
tenders
spending
business informatio
n
users
remix
analyze
prices
LOD graph
Follow public money all the way
![Page 45: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/45.jpg)
Economic LOD: use cases
• Business applications on top• Users: citizens, gov., EU, business• track the life-cycle of every financial
flow: evaluate budget allocation, tenders, spending and their efficiency
• pre-allocate resources on provisional public works
• receive & submit information in real-time
45
![Page 46: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/46.jpg)
Economic LOD: engineering
46
![Page 47: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/47.jpg)
Government Budget• heterogeneous repositories & methods
(mainly PDF)
47
![Page 48: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/48.jpg)
Tenders • Closed data in HTML• Public Contracts Ontology (PCO), e.g. – pco:Contract and pco:AwardCriterion
• Common Procurement Vocubulary• now working on linking our ontology
to:– Payments Ontology – GoodRelations – FOAF
48
![Page 49: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/49.jpg)
Spending • most dynamic & open part• increasing number of countries/cities• raw & structured data• leader: the Greek Clarity project• spending decisions ex-ante to
execution• Actually every decision
49
![Page 50: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/50.jpg)
Business Information
• Registries: mainly closed• Key standards– Classification of Products by Activity (CPA)– eXtensible Business Reporting Language
(XBRL)
CHECK OD BAROMETER – OD INDEX
50
![Page 51: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/51.jpg)
Business Information
51
![Page 52: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/52.jpg)
The Transparency program in Greece (2010-2014)
oA revolution in open governmentoex-ante reporting of every state
decision oparadigm shift for 40K public
servants
52
![Page 53: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/53.jpg)
The Transparency program in Greece
omanifests the value of procrastination principle (again)
ostrong rival to the Clientelistic state
oThe new version under beta testing (delivery: in 10 days!)
53
![Page 54: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/54.jpg)
publicspending.net
2011: I believed that the Transparency program is the open data “gold” (& persuaded 7 more people)
54
![Page 55: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/55.jpg)
publicspending.net
2012: …with some dust and rocks in a deep goldmine
55
![Page 56: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/56.jpg)
2013: time to chisel some jewelry2014: open data everywhere
56
![Page 57: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/57.jpg)
Why public spending LOD
omore & better information o objective and processable
information for economic/political “dialogue”
• to promote competition• to decrease cost • to judge the efficiency of policy
mixtures• to enable participation
57
![Page 58: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/58.jpg)
LOD in Greece
• in its infancy – few Apps yet• 2-3 stars• Open not Linked• limited public awareness
58
![Page 59: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/59.jpg)
LOD in Greece: why it is important
• quality of information during economic crisis
• transparency & efficiency in funding development
59
![Page 60: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/60.jpg)
Issues
ohow can we initiate the virtuous cycle of creation?
demonstrate LOD’s added value
ohow to get the most out of data?local & global interconnections
60
![Page 61: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/61.jpg)
In few words,
Apps, Apps, Apps…..
61
![Page 62: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/62.jpg)
Indexing, searching, global comparisons
![Page 63: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/63.jpg)
Indexing, searching, global comparisons
![Page 64: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/64.jpg)
Indexing, searching, global comparisons
![Page 65: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/65.jpg)
Indexing, searching, global comparisons
![Page 66: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/66.jpg)
Interlinking in global scale
![Page 67: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/67.jpg)
Interlinking in global scale
![Page 68: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/68.jpg)
The future of the Web
• Data.gov: a paradigm shift• Policy challenges are related to
data• Freedom, Privacy, Creativity
![Page 69: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/69.jpg)
Policy framework
① Processing power② Storage③ Network access④ Online data &
services⑤ Privacy
Personal grid workspace (g-work)
for every citizen
![Page 70: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/70.jpg)
New analysis: Web science
• a trans-disciplinary field –Web as its primary object of study–Web= techno-social artifact
• positive or negative?Transformative!
3/18
![Page 71: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/71.jpg)
Web science
The envelope question
what technological and other changes need to be made in order for the Web to work better for more people?
3/18
![Page 72: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/72.jpg)
The Web as a social machine
![Page 73: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/73.jpg)
Being protected by digitizing
73
![Page 74: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/74.jpg)
…challenges the basic aspects of human nature:
o Technologyo Bodyo Moral Valueso Socialityo Generations o Economy
![Page 75: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/75.jpg)
Humanizing the Web Webizing Humanity
Successful business & science facilitate this dialogue
Not only answers but make the questions more concrete
![Page 76: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/76.jpg)
Global initiatives
76
• OGP how it works• GIFT• IBP - OBS Tracker• Web index
![Page 77: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/77.jpg)
Let us talk about projects
77
![Page 78: The Web of Data emerging industries](https://reader036.vdocuments.mx/reader036/viewer/2022070419/56815b60550346895dc946c1/html5/thumbnails/78.jpg)
References
• Weaving the Economic Linked Open Data• The Web Economy: Goods, Users, Models, an
d Policies
• Public Spending: Interconnecting and Visualizing Greek Public Expenditure Following Linked Open Data Directives
• A Framework for Linked Data Business Models
78