Mantas Zimnickas

atviriduomenys.lt

OpenCon 2016 Lithuania

What is open?

“Open means anyone can freely access, use, modify, and share for any purpose.”

– opendefinition.org

What is open data?

5stardata.info

Open data status in Lithuania

http://ivpk.lrv.lt/lt/ivpk-leidiniai/atliktas-galimybiu-tyrimas-skirtas-apibrezti-atviru-duomenu-iniciatyvos-igyvendinimo-lietuvoje-architekturos-modeli

What atviriduomenys.lt is about?

Dataproviders Data Projects

provides are used by

needsimportance

Users

likes

are used by

atviriduomenys.lt

Data packages

CSV/JSON RDF/DCAT

'2016-11-12' "2016-11-12"^^xsd:date

Datapackage

date(2016, 11, 12)

frictionlessdata.io/data-packages/

HTML data to download first page

extract links

download all links

extract data

transform data

with index.download('http://opendata.gov.lt/'):

with urls.select('table td[3] a@href'):

with pages.download():

with raw_data.select(row.key, [ 'table xpath:tr[count(td)=2]', ('td[1]:content', 'td[2]:content'), ]):

data.call( lambda x: (x.key, dict(x.value)) )

data.export('opendatgovlt.csv')export data

atviriduomenys.lt/data

Data to

Rawvalues

UniformResourceIdentifier

LRS

ld:orgs/gov/42

Canonicalobject

registry

LietuvosRespublikos

SeimasSeimas

LR Seimas

Aliases andtemplates

Lietuvos Respublikos {name} LR{name|abbr} {name} LR {name}

https://github.com/sirex/databot-bots/tree/master/index

Technology moves forwardpeople don’t

225 yearslater

A4 paper data format

Writes onA4 paper

ReadsA4 paper

In a perfect world...

Createsontologies

Createstemplates

Fills intemplateswith data

HTMLrepresentation

Printingon paper

Smartphoneapp

Single source

publishing

WYSIW

YM

Context

Real world examples

AbbyeFormFiller

Akoma Ntoso(LegalDocML)

LegisProBy Xcential

Word processortemplates with

fields

Text data to

Textstream

Patternrecognition

engineTemplates Data

Field: value N-gram magic Field: {value} {'Field': 'value'}

automatization

Text data to

Textsamples

Training Data

big trees machine learning forest

NLP

a tree

Manuscript to

epaveldas.lt

Thank you!

● https://github.com/sirex/atviriduomenys.lt● https://github.com/sirex/databot/● https://github.com/sirex/databot-bots● https://github.com/sirex/gramtool● https://bitbucket.org/sirex/morfologija● https://github.com/frictionlessdata/

Source code of atviriduomenys.lt and related projects: