open data white paper(1)

Upload: abdelgader-mahmoud

Post on 01-Jun-2018

217 views

Category:

Documents


0 download

TRANSCRIPT

  • 8/9/2019 Open Data White Paper(1)

    1/52

    Open Data

    White PaperUnleashing the Potential

    #opendata@uktransparency @cabinetofficeuk 

    http://twitter.com/#!/UKTransparencyhttp://twitter.com/#!/cabinetofficeukhttp://twitter.com/#!/cabinetofficeukhttp://twitter.com/#!/UKTransparency

  • 8/9/2019 Open Data White Paper(1)

    2/52

     PresentedtoParliamentby

     theMinisterofStatefortheCabinetOfficeandPaymasterGeneral

    byCommandofHerMajesty

     June2012

    Cm8353 £16.00

  • 8/9/2019 Open Data White Paper(1)

    3/52

     

    ©Crowncopyright2012

    Youmayreusethisinformation(excludinglogos)freeofchargeinanyformatormedium,underthe termsoftheOpenGovernmentLicence.Toviewthislicence,visitwww.nationalarchives.gov.uk/doc/opengovernmentlicence/oremail:[email protected].

     Wherewehaveidentifiedanythirdpartycopyrightinformationyouwillneedtoobtainpermissionfromthecopyrightholdersconcerned.

    Anyenquiriesregardingthispublicationshouldbesenttousatpublicdata@cabinetoffice.gsi.gov.uk .

    Thispublicationisavailablefordownloadatwww.officialdocuments.gov.uk .

    Thisdocumentisalsoavailablefromourwebsiteatwww.cabinetoffice.gov.uk .

    ISBN:9780101835329

    PrintedintheUKforTheStationeryOfficeLimited

    onbehalfoftheControllerofHerMajesty’sStationeryOffice

    IDP002494021 06/12

    Printedonpapercontaining75%recycledfibrecontentminimum.

    http://www.nationalarchives.gov.uk/doc/open-government-licence/http://www.nationalarchives.gov.uk/doc/open-government-licence/mailto:[email protected]:[email protected]://www.official-documents.gov.uk/http://www.official-documents.gov.uk/http://www.cabinetoffice.gov.uk/http://www.cabinetoffice.gov.uk/http://www.nationalarchives.gov.uk/doc/open-government-licence/http://www.cabinetoffice.gov.uk/http://www.official-documents.gov.uk/mailto:[email protected]:[email protected]

  • 8/9/2019 Open Data White Paper(1)

    4/52

     

    3

    Contents

    ForewordbytheRtHon.FrancisMaude 5

    Glossary 7

    1.Buildingatransparentsociety 11 

    2.Enhancedaccess 15 

    MoreOpenData 15

    DeveloperEngagementStrategy 17

    Changingthecultureinthepublicsector 18

    Strengtheningrightstodata 19

    Harnessinguserengagement 21

    Regulatingdata 21

    Strengtheningdatausability 22

    Betteraccesstopublicdata 26

    Openingupaccesstoresearch 27

    3.Buildingtrust 31 

    Openpolicymaking 31

    Gettingthebalanceright 32

    PrivacyImpactAssessments 33

    4.Makingsmarteruseofdata 37 

    Smarteruse–anonymousdata 38

    Youraccesstoyourdata 39

    Breakingdownthebarriers 41

    5.Thefuture–atrulytransparentsociety 45 

    AnnexA–MakingOpenDataReal:Consultationchecklist 47 

    AnnexB–Howtorequestdata 51 

  • 8/9/2019 Open Data White Paper(1)

    5/52

  • 8/9/2019 Open Data White Paper(1)

    6/52

     

    5

    Foreword by the Rt Hon. Francis Maude

    MinisterfortheCabinetOfficeandPaymasterGeneral

    Dataisthe21stcentury’snewrawmaterial.Its

    valueisinholdinggovernmentstoaccount;in

    drivingchoiceandimprovementsinpublicservices;

    andininspiringinnovationandenterprisethat

    spurssocialandeconomicgrowth.

    Inthelast20yearstheworldhasopenedupand

    citizensacrosstheglobeareproclaimingtheirright

     todata;thisWhitePapersetsouthowweintend

     tousethatenergytounlockthepotentialofOpen

    Dataandforthefirsttimethetechnologyexiststo

    makethedemandforgreateropennessirresistible.

     Weareatthestartofaglobalmovementtowards transparency–andtheUKisleadingtheworld

    inmakingdatamorefreelyavailable.Weare

    currentlycochairingtheOpenGovernment

    Partnershipof55governments;thethemeofour

    chairmanshipis‘TransparencyDrivesProsperity’–

    demonstratingthevalueofopengovernanceto

    economicgrowth,inclusivedevelopmentand

    improvedcitizenengagementandempowerment.

    Transparencyisattheheartofouragenda

    forgovernment.Webelievethatopeningupwillempowercitizens,fosterinnovationand

    reformpublicservices.Theregularpublication

    ofgovernmentspendingisholdingourfeetto

     thefireallyearround,notjustatelectiontime.

     We’recreatinganinformationmarketplacefor

    entrepreneursandbusinesses;releasingvaluable

    rawdatafromrealtimetransportinformationto

    weatherdata.Openingupdataisunderpinningour

    publicservicereformsbyofferingpeopleinformed

    choicesthatsimplyhaven’texistedbefore,exposing

    whatisinadequateanddrivingimprovement.Sofar

    we’vereleasedalmost9,000datasetsonourflagship

    dataportalwww.data.gov.uk thatcoverhealth,

    education,transport,crimeandjustice.Peoplecan

    scrutiniselocalcrimestatistics,sentencingrates,

    schoolresults,hospitalinfectionratesandGP

    outcomes.

    Thetransparencystorybynomeansendshere.

    Todaywe’reatapivotalmoment–wherewe

    considertherulesandwaysofworkingina

    datarichworldandhowwecanusethisresource

    effectively,creativelyandresponsibly.ThisWhite

    PapersetsoutclearlyhowtheUKwillcontinueto

    unlockandseizethebenefitsofdatasharinginthefutureinaresponsibleway.

    First,toensurethattherearenoinequalitiesin

     thedatamarketwewillenhanceaccesstodata.

     Weareunflinchinginourbeliefthatdatathat

    canbepublishedshouldbepublished.Aswell

    ascontinuingtoproducestatutorypublication

    schemesundertheFreedomofInformationAct,

    alldepartmentshavenowpublishedtheirfirstever

    OpenDataStrategieswhichincludecommitments

     topublishmoredata.People’srightstoaccessdatahavebeenstrengthenedinlegislation,vehiclesfor

    redresswillalsobeenhancedandstandardsfor

    higherdatausabilityintroduced.

    Second,wewillbuildgreatertrustinpublicdata.

    Thesuccessoftheinformationmarketplace

    hingesonourabilitytosafeguardpeople’sdata

    frommisuseandrigorouslyprotectthepublic’s

    righttoprivacy.Wewillensurethatprivacyisnot

    consideredasanafterthoughtbutatthebeginning

    ofalldiscussionsconcerningthereleaseofanewdataset.Wewillensurethatwekeeppacewiththe

    http://www.data.gov.uk/http://www.data.gov.uk/

  • 8/9/2019 Open Data White Paper(1)

    7/52

    6 OpenDataWhitePaper

    latesttechnologysoanonymiseddatasetsremain

    anonymisedandpersonaldataremainspersonal.

    Third,toensurethatourpublicservicesaremore

    personalisedandefficientinthefuturewemustbemuchsmarterwiththedatapublicbodieshold.

    Inthepastthepublicsectorhasnotbeenclever

    oreffectiveatsharingkeydata.Weare

    determinedtoshiftthecultureofthepublicsector

     toimprovedatasharingwhereitisinthepublic

    interestandwithinlegislativeboundaries,andwe

    willusethelatesttechnologytodeliverthis.

    Thereisnothingeasyabouttransparency.The

    formativeyearsofopengovernmentwillbetricky,

    difficultanduncomfortableattimes.Buttheprizeiseffective,personalised,21stcenturydemocracy.

    It’samoreprosperousUnitedKingdomwhere

     thepublicservicesonwhichweallrelyare

    strengthenedandimproved.Wearedetermined

     toensurethatallofuscanreapthebenefitsof

     transparencyanddatasharinginthefuture.

    ThefuturewillbeOpen.

    FrancisMaude

    MinisterfortheCabinetOffice

    andPaymasterGeneral

  • 8/9/2019 Open Data White Paper(1)

    8/52

     

    7

    Glossary WeacknowledgethattherearedifferencesintheterminologyusedwithintheOpenDatacommunity.For

     thepurposesofthisdocument,thefollowingterminologywillapply.Wehopetogetacollectiveviewon thedefinitionsusedinforthcomingTransparencyandOpenDatapublications–and,aspartofourdriveto

    makepolicymakingmoreaccessible,willconsultonthosedefinitionsthroughanopen,onlineprocess.

    Anonymised data Datarelatingtoaspecificindividualwheretheidentifiershavebeenremovedtopreventidentificationofthatindividual.

    Core-reference data Authoritativeordefinitivedatanecessarytouseotherinformation,producedbythepublicsectorasaserviceinitselfduetoitshigh

    importanceandvalue.

    Customer insightdata

    Dataorinformationrecordingusers’accountsoftheirexperience,withan

    assessmentofpublicserviceproviders.

    Data Qualitativeorquantitativestatementsornumbersthatareassumedtobefactual,andnottheproductofanalysisorinterpretation.

    Data sharing Thetransferofdatabetweendifferentorganisationstoachieveanimprovementintheefficiencyandeffectivenessofpublicservicedelivery.

    Thisdocumentassumesthatdatasharingwillcontinuetooperateinline

    withcurrentdomesticlegislationandtheUK’sinternationalobligations.

    Dataset AsdefinedintheProtectionofFreedomsAct2012.

    De-anonymisation Theprocessofdeterminingtheidentityofanindividualtowhomapseudonymiseddatasetrelates.

    Disclosive Dataispotentiallydisclosiveif,despitetheremovalofobviousidentifiers,characteristicsofthisdatasetinisolationorinconjunctionwithother

    datasetsinthepublicdomainmightleadtoidentificationoftheindividual

     towhomarecordbelongs.

    Information Outputofsomeprocessthatsummarises,interpretsorotherwiserepresentsdatatoconveymeaning.Unlessotherwisestatedinthis

    document,wewillusethetermdatatoincludeinformation.

    Intellectual property Asetofpropertyrightsthatgranttherighttoprotectthematerialscreatedbythem.Intellectualpropertycomprisescopyright,designs,patents,certain

    confidentialinformationandtrademarks.

    Linked data Describedbyanidentifierandaddressestopermitlinkingwithotherrelevantdatawhichmightnototherwisebeconnected,improving

    discoverability.Itmaycontainembeddedlinkstootherdata.

    Mosaic effect Theprocessofcombininganonymiseddatawithauxiliarydatainordertoreconstructidentifierslinkingdatatotheindividualitrelatesto.

    Open access Provisionoffreeaccesstopeerreviewedacademicpublicationstothegeneralpublic.

  • 8/9/2019 Open Data White Paper(1)

    9/52

     

    8 OpenDataWhitePaper

    Open Data Datathatmeetsthefollowingcriteria:

    • accessible(ideallyviatheinternet)atnomorethanthecostof

    reproduction,withoutlimitationsbasedonuseridentityorintent;• in a digital, machine readableformatforinteroperationwith

    otherdata;and

    • free of restriction on use or redistributioninitslicensingconditions.

    Open governmentdata

    PublicSectorInformationthathasbeenmadeavailabletothepublicas

    OpenData.

    Personal data AsdefinedbytheDataProtectionAct1998,datarelatingtoaspecificindividualwheretheindividualisidentifiedoridentifiableinthehandsof

    arecipientofthedata.

    Pseudonymised data Datarelatingtoaspecificindividualwheretheidentifiershavebeenreplacedbyartificialidentifierstopreventidentificationoftheindividual.

    Public data Anonymised,noncorereferencedataonwhichpublicservicesarerunandassessed,onwhichpolicydecisionsarebased,orwhichiscollectedor

    generatedinthecourseofpublicservicedelivery.

    Public SectorInformation

    InformationanddatasubjecttotheFreedomofInformationAct2000

    andtheReuseofPublicSectorInformationRegulations2005;dataand

    informationproduced,collectedorheldbypublicauthorities,aspartof

     theirpublictask.

  • 8/9/2019 Open Data White Paper(1)

    10/52

  • 8/9/2019 Open Data White Paper(1)

    11/52

     

    11

    Chapter 1

    Building a transparent society

    1.1 Transparencyisalreadyradicallychangingthe

    waypeoplelivetheirlivesandruntheirbusinesses

    intheUK.Inthelasttwoyears,theUKhas

    releasedthelargestamountofgovernmentdataof

    anycountryintheworld,enablingpeopletomake

    betterchoicesaboutthepublicservicestheyuse

    andtoholdgovernmenttoaccountonspending

    andoutcomes.Transparencyisalsoprovidingthe

    rawmaterialforinnovativenewbusinessventures

    andforpublicserviceprofessionalstoimprove

     theirperformance.

    1.2 Forinstance,commutersareusingapps

    basedontransportdatareleasedbyrailandbus

    operatingcompaniestoplantheirjourneys–

    usingrealtimeinformationtoadjusttheirtrip

     totakeaccountofdelaysorcongestion.Crime

    mapsbasedonHomeOfficedataareenabling

    communitiestotrackcrimeintheirareaandwork

    withlocalauthoritiestoaddressit.Andvirtuallyall

    localauthoritiesnowpublishspendingtransactions

    over£5001soeveryonecanunderstandand

    challengethespendingdecisionsthatdirectlyaffect

     theirlives.1.3 Sowe’reputtingthedataoutthere.And

    alongsidethisWhitePaperwearealsopublishing

    online2alargecollectionofcasestudiesshowing

    howOpenDatareleasedbygovernmentisbeing

    usedandreusedbythepublic,privateandcivil

    societysectors.Thismaterialcoversbothsuppliers

    andusersofdata,fromlocalauthoritypublishers

    andthecompaniesthatfacilitatedatapublication

    andanalytics,throughtoreusersofpublicdata

    creatingapplicationsanddatabasedservices.1.4 Together,thismaterialstartstoforma

    livinglibraryofinformation,enablingpeopleto

    crowdsourcefurtherevidenceoftheimpact

    ofOpenData.Soweknow,forinstance,that

    whenwepublishoutcomemeasuresforhealth

    providers,weseechangesinbehaviourthatpush

     thosehealthproviderstodoabetterjob.And

    regularpublicationofspendingdatameansthat

    anyoneinthecountryhasthemeanstochallenge

    governmentonhowpublicmoneyisbeing spent.

    1.5 Thisisacompletelydifferentwayofgoverning.

     We’rechoosingtobemoreopenwithourdata–

    workingontheprinciplethatindividualswillknow

    howbesttomakethedecisionsthatshapetheir

    livesorbusinesses,aslongastheyhaveallthe

    informationattheirfingertips.Butweneedtoget

    betteratit.Weneedtomakesurethatpeopleare

    gettingtherightdata–datathat’srelevanttotheir

    livesandbusinesses,andupdatedfrequently.And

    weneedtomakesureit’sintherightformatsoit

    caneasilybeaccessedandused.

    1.6 Sowearegoingtogetmoredatainto

    thepublicdomainandmakesurethatdatais

    trustworthyandeasytouse.Eachgovernment

    departmenthasnowpublisheditsfirsteverOpenDataStrategy3settingoutan

    unprecedentedreleaseofnewdatathatwill

    bepublishedoverthenexttwoyears.

    Departmentswillalsosetouthowtheyare

    goingtostimulateamarketforits use.

    1.7 Allthisnewdatawillbeaccessiblethrougha

    completelyoverhauledwww.data.gov.uk site–

    whichwe’rerelaunchingwithbettersearch

    facilities,simplerwaystoaccessinformation,

    anadvancedGISdatasearch(includingmappreviewing)andbettertoolsfordevelopers,

    suchasAPIaccesstothecatalogueholdings.

    http://tinyurl.com/d7z9bkghttp://tinyurl.com/d7z9bkghttp://www.no10data.gov.uk/open-data-strategieshttp://www.no10data.gov.uk/open-data-strategieshttp://www.data.gov.uk/http://www.data.gov.uk/http://www.no10data.gov.uk/open-data-strategieshttp://tinyurl.com/d7z9bkghttp://www.data.gov.uk/

  • 8/9/2019 Open Data White Paper(1)

    12/52

     

    12 OpenDataWhitePaper

    1.8 Wearealsoannouncingacomprehensive

    andindependentlychairedreviewoftheuse,

    re-use,fundingandregulationofPublicSector

    Information(PSI).It’srightthatwethinkabouttheuseandre-useofPSImorebroadly,giventhe

    paceofchangeandexpandingopportunitiesin

    thisarea.

    1.9 Wecanstartbyusingthedataweholdmore

    effectively,andbypushingthatdataintothepublic

    domain.Thenindividuals,businessesandcivil

    societycanuseittovoteonpublicserviceswith

     theirfeet,tochallengegovernmentiftheysee

    inefficienciesandtodriveprosperitybyusingdata

     todonewandexcitingthings.1.10 Attheheartofmakingtransparencya

    powerfulagentofchangeintheUKistheright

     thatcitizenshavetoaccessandusepublicdata.

    Itisourbeliefthataneffectiverighttodatais

    neitherasinglenorstaticpieceoflegislationbut

    amixofexistinglawsthatcomplementmeasures,

    suchasthoseoutlinedinthisWhitePaper,to

    embedacultureofopennessingovernment.

    Therefore,whilewetakeproactivestepstopush

    moredataoutthere,wearealsoawarethatuptodatelegislationandcommonstandardsfor

     thedatawereleaseareessentialtosupportan

    effectiveOpenData ecosystem.

    1.11 ByrecentlyamendingtheFreedomof

    InformationAct(FOIA)2000,we’veputa

    failsafeinplacetomakesurethat,whereyou

    areentitledtoadataset,youcanaskforitina

    formatthatisuseful.Thechangesthatwehave

    madearegoingtobereflectedintheupcoming

    developmentprocessfortheFOIACodeof

    Practiceand,aspartofourdrivetomakepolicy

    makingmoreaccessible,wearegoingtoopen

    thisuptothepublicandofferanopportunity

    toshapetheguidanceondatasetsusinga

    crowdsourced wiki.

    1.12 Inlastyear’sMakingOpenDataReal

    Consultation4wereceivednearly500responses

    fromavarietyofsectors,raisingmanydiverse

    pointsabouttheworkweareundertaking.

    AnnexAliststhesepointsandhowtheyhave

    beenaddressed.Onerecurrentthemewasthat

     thecostofdataishugelyinfluentialindetermining

    whetherpeopleaccessitornot.Ourgeneral

    principlesfortheuseofPSIarethatdatashouldbe

    providedfreewhereverappropriateandpossible,

    oratafairpricewhereitiscostlyforthepublicsectortoprovideit,orwhereitisfairertotheUK

     taxpayertosecurevaluefromit.

    1.13 Wealsoneedtobesmarterabouthow

    weusedatawithingovernment.Weknowitcan

    befrustratingwhengovernmentdevelopspolicy

     thathasunintendedconsequencesorseems

    badlytargeted.Itisalsotedioustohavetoinform

    differentgovernmentagenciesaboutsimple

    changesinsteadofrelyingontheagenciestoshare

     thatdatawithoneanother.Asensibleapproach tosharingdatawithingovernmentcanhelpusget

    betteratboththosethings.

    1.14 Itisessentialthatweareabletosharedatain

    ordertoanswersomeofthekeypolicyquestions

    ofourtime,suchastherelationshipbetween

    educationandemployment,aswedevelop

    policytoimprovefairnessinsocietyandsocial

    mobility.Sowe’reestablishingaSocialMobility

    TransparencyBoard,chairedbytheMinister

    forUniversitiesandScience,whichwilllookatlinkinganonymiseddatatogenerategreater

    insightinthisarea.Andweareexploringthe

    feasibilityofapilotprojectthatlinksandshares

    anonymisedDepartmentforWorkandPensions

    datatodemonstratethepotentialvalueofthis

    dataforresearchpurposes.

    1.15 Wedon’tunderestimatehowdifficultthisis.

    Therearesubstantialbenefitstobegainedfrom

    sharingdatawithingovernment–butobviously

    weneedtobescrupulousinprotectingindividual

    privacy.Sowewillproceedwithcaution,setting

    ambitiousgoalsbutensuringthatweprotect

    privacyateverystep.

    1.16 Weareannouncingtheappointment

    ofaprivacyexperttothePublicSector

    TransparencyBoardtomakesurewebringin

    thelatestexpertiseonprivacymeasures.More

    broadly,we’remakingsurethatprivacyexperts

    arebroughtintoallsectorpaneldiscussions

    acrossWhitehallwhendatareleasesare

    being considered.

    http://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultation

  • 8/9/2019 Open Data White Paper(1)

    13/52

     

    Chapter1Buildingatransparentsociety 13

    1.17 Wedon’twanttouselegislationtoo

    readily–thatwouldsitatoddswithourcore

    principletoreducebureaucracy–butwedo

    recognisethatclarificationofthelaworthecreationofsensiblemeasurestoensuredata

    sharingcanbehelpful.Wewillconsultahead

    ofbringingforwardanylegislativeproposals.

    1.18 Allthisisjustthebeginning.Wewantto

    movetowardsatrulytransparentsocietyinwhich

    relevantdataisreleased,whoeverholdsit.

     Wecan’tforcethistohappen.Butbyshiningalight

    onforwardthinkingbusinessesororganisations

     thatareopenabouttheirpracticesandpublish

    dataontheiroutcomeswecanusetransparencyitselftohelpdrivethischange.

    1.19 We’realreadymakingprogressonthiswith

    partnersoutsidegovernment:

    • Fromautumn2012,thosedomiciliaryand

    residentialsocialcareproviderswhosignedup

     tothevoluntaryandindustryledTransparency

    andQualityCompactwillpublishacoresetof

    relevantmetrics.Thesemetricswillenablethe

    publictomakemoreinformedchoicesbasedon

    standardisedqualityindicators.

    • WehavealsorecentlyestablishedtheOpen

    BusinessForum,includingrepresentatives

    from21majorcorporations,whoareworking

     towardsreleasingmetricsoncorporate

    responsibility,suchascommunitycontribution

    andenvironmentalimpact,toinformconsumers.

    • Ourworkwithenergyprovidershasresulted

    inmajorcompanies,includingScottishPower,

    committingtoreleasingenergyusagedata,

    makingiteasierforconsumerstocompare

    pricesandswitchcompanies.

    1.20 TheseareimportantchangeswhereBritish

    businessesarejoiningustotransformtherolethat

    dataplaysinimportant,everydaydecisionsthat

    impactonthepublic’swellbeing.Activitylikethis

    getsthedataheldbynotonlythepublicsectorbut

    alsobybusinessesandcharitiesoutintothepublic

    domain.Thisistheshapeofthingstocome–a

     trulytransparentsociety,withthepowerwhereit

    belongs,inthehandsofthepeopleofthiscountry.

    Notes

    1 Tosupportlocalauthoritiesinpublishingdata,

    theDepartmentforCommunitiesandLocal

    Government publishedaCode of Recommended Practicefor Local Authorities on Data Transparency inSeptember

    2011.Alllocalauthoritiesexceptone(NottinghamCity)

    nowpublishspendingtransactionsover£500.

    2 http://tinyurl.com/d7z9bkg

    3 www.data.gov.uk/opendatastrategies

    4 www.cabinetoffice.gov.uk/resourcelibrary/

    makingopendatarealpublicconsultation

    http://tinyurl.com/d7z9bkghttp://www.data.gov.uk/open-data-strategieshttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.data.gov.uk/open-data-strategieshttp://tinyurl.com/d7z9bkg

  • 8/9/2019 Open Data White Paper(1)

    14/52

  • 8/9/2019 Open Data White Paper(1)

    15/52

     

    15

    Chapter 2

    Enhanced access

    Enhanced 

    access Building

     

    trust Smarter

     

    use 

    MoreOpenData

    2.1 Overthelasttwoyears,wehavemadeitsignificantlyeasiertoaccesspublicdata.Inhisletter

     todepartmentsinMay2010,1thePrimeMinister

    commissionedanopeningupoftheinnerworkings

    ofgovernmenttoexternalscrutiny,releasingdata

    onfinance,resources,procurementandtheestate

    inanopen,regularandreusableformat.Asecond

    letterinJuly20112focusedondatareleasesfrom

    keypublicservicesincludinghealth,education,

    crimeandjustice,andtransport,exploring

    waysinwhichsuchtransparencycouldboost

    economicgrowth.

    2.2 Wewillbeunrelentinginoureffortstoget

    moredataout.Typically,governmentsgocoldon

     theideaofopennessandtransparencyaftera

    coupleofyearsinoffice.Wearedeterminedthat

    enhancedaccesstopublicdatawillbeanenduring

    characteristicofthisone.

    2.3 Thiscontinuedcommitmentiskeyasthe

    dataheldbythepublicsectorhasthepotential

     totransformlives.Webelievethatunfetteredaccesstoanonymiseddatashouldbeextendedto

    supportimprovementsinthequality,choiceand

    efficiencyofhealthcare,education,transportand

    awholehostofotherpublicservices.

    2.4 Furthermore,thedataheldbythepublic

    sectorprovidesimportantrawmaterialforexisting

    businessesandstartupstouseinopeningup

    innovativenewmarkets,drivingeconomicgrowth

    andjobcreation.Wehavedemonstratedinour

    OpenDataInnovationCommunity 3

    howthisdatacreatesopportunities;wearecommitted

     tosupportinggrowthbyreleasingmoredata.

    Casestudy–ITOWorldITOWorldLtdisaUKsmalltomedium

    sizedenterprise(SME)thatspecialises

    inmappingandvisualisingtransport

    data.Foundedin2006,thecompany

    hassinceworkedwith,forexample,the

    DepartmentforTransport,NationalRail

    Enquiries,GuardianMediaGroupand

    Vodafone.ITOWorldhasalsoworked

    withGoogle,supportingtheprovision

    ofpublictransportjourneyplanning

    forLondonusingGoogleMaps.This

    servicewasbasedonofficialTransport

    forLondondata,releasedasOpenData.

    InApril2012,ITOWorldagainworked

    withGoogleonintegratingrealtime

    informationaboutdisruptionsonthe

    LondonUndergroundintotheirservice.

    Intheeventofanyserviceinterruption,

     travellersarepresentedwithalternative

    routeoptionsandestimatedtraveltimes

    basedonrealtimedata.ITOWorldhasalsobeeninvolvedinOpenStreetMap

    (www.openstreetmap.org)foranumber

    ofyearsandprovidesasuiteofediting

     toolstoenablethecollectionofenormous

    amountsofcrowdsourceddata.ITOWorld

    processesoverhalfabillionnodesof

    OpenStreetMapdataeachdaytoallowthe

    communitytoremainabreastofongoing

    editsandadditions.

    2.5 TransparencyandOpenDataalsoformed

    akeystrandofthesecondphaseofthe

    Government’sGrowthReview,4publishedin

    http://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-data/http://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-data/http://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-data/http://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-data/http://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-data/http://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-data/http://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-data/http://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-data/http://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-data/http://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-data/http://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-data/http://communities.maven-cast.com/pg/groups/3731http://www.openstreetmap.org/http://www.openstreetmap.org/http://www.hm-treasury.gov.uk/press_135_11.htmhttp://www.openstreetmap.org/http://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-data/http://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-data/http://www.openstreetmap.org/http://communities.maven-cast.com/pg/groups/3731http://www.hm-treasury.gov.uk/press_135_11.htm

  • 8/9/2019 Open Data White Paper(1)

    16/52

     

    16 OpenDataWhitePaper

    November2011.Inthis,weoutlinedplansto

    releasemoreaggregatedataandboosttheUK

    economy’scapabilitytounlockitspotentialby

    announcingthecreationoftheOpenDataInstitute.

    Casestudy–OpenDataInstitute

    TheOpenDataInstitute(www.theodi.org)

    willdemonstratethecommercialvalueof

    OpenDataandworkcloselywiththepublic

    andprivatesectorsaswellasacademiain

    developingitsexploitation.Itwillbeledby

    SirTimBernersLeeandProfessorNigel

    Shadbolt.TheOpenDataInstitutewillhave

    anumberoffacets,including:

    • workingwithbusinessinexploitingopen

    governmentdata;

    • developingandmentoringstartup

    OpenDatacompanies;

    • trainingOpenDatatechnologistsand

    entrepreneurs;

    • workingwiththepublicsectoron

    makingdataavailableandaccessible;

    • assemblingtheevidencebaseonthe

    impactandvalueofOpenData;

    • promotingopenstandardsand

    commissioningresearchrelevantto

    OpenDataexploitation;and

    • developingtheUK’sstandingasan

    internationalleaderinOpenData.

    ThebusinessplanfortheOpenData

    Institutehasbeenapprovedbythe

    TechnologyStrategyBoardandthe

    implementationplanwaspublishedin

    May2012.SirTimBernersLeeand

    ProfessorShadbolthavebeenengaging

    withtheprivateandpublicsectorson

    howtheOpenDataInstitutecanwork

    withthemonthegrowthofOpenData.

     Workisunderwayonthedevelopment

    ofanOpenDatadiploma,anticipatingthe

    firstcohorttocommenceinearly2013.

    TheOpenDataInstitutewillbeformallylaunchedinthe autumnof2012.

    2.6 Aftertwoyearsofbeingledbythecentre

    ofgovernment,governmentdepartmentsare

    nowtakingagreaterroleindrivingforwardthe

    TransparencyProgramme.Alongsidethispaper,eachgovernmentdepartmenthaspublished

     theirfirstOpenDataStrategy.Eachstrategy

    containsadepartment’scommitmentsfor

    proactivelypublishingdataoverthenexttwo

    yearsandwillcomplementtheirexistingstatutory

    publication schemes.

    2.7 Thesestrategiesrepresentanimportant

    stepforwardinthewaywearemakingdata

    readilyandsystematicallyaccessibleandarea

    corerequirementofeachdepartment’sactivity.Despitethis,weshouldneverbecomplacentand

    oneyearfromnow,andeveryyearsubsequentto

     that,alldepartmentswillberequiredtoreporton

    progressmadeontheircommitments.Someof

     thesehighprofilecommitmentsinclude:

    • theCabinetOfficewillincreasetransparency

    ongrantfundingbypublishingdataonwhich

    organisationsreceivepublicmoneyfromcivil

    societyprogrammes;

    • theDepartmentforWorkandPensionswillreleasestatisticsonjoboutcomesand

    sustainmentpaymentsoftheWorkProgramme

    fromautumn2012;

    • theDepartmentforEducationwill,forthe

    firsttime,publishstatisticson‘Educational

    destinations’inJuly2012showingthe

    percentageofpupilsprogressingtofurther

    learninginaschool,furthereducationorsixth

    formcollege,anapprenticeshiporahigher

    educationinstitutionatages16and19.Thesemeasuresaredesignedtoshowhowsuccessful

    schoolsandotherinstitutionsareatpreparing

     theirpupilsforthefuture;

    • theUKBorderAgency(UKBA)andtheBorder

    Forceplantoincreasetherangeofinformation

    abouttheiractivitiesandperformancewhichis

    availabletothepublic.UKBAandtheBorder

    Forcewillalsoexplorewhetheritispossibleto

    allowsponsors,employeesandothercitizens

     tointeractwiththeirsystems.Asteeringgrouphasbeenestablishedtoprovideoversightofthis

    workandtheengagementofallrelevantparts

    ofthe organisation;and

    http://www.theodi.org/http://www.theodi.org/http://www.theodi.org/http://www.theodi.org/

  • 8/9/2019 Open Data White Paper(1)

    17/52

     

    Chapter2Enhancedaccess 17

    • HMTreasurywillproduce(inmachinereadable

    format)datarelatingtothemanagement

    anduseofEUfundsintheUK.Animproved

    statementwillbereadyforreleaseforthefinancialyear2013/14.Thiswillimprove

    accountabilityandencouragebetterfinancial

    managementofEU funds.

    2.8 Thesestrategiesareessentialformakingmore

    publicdataopenlyavailablebut,onoccasion,there

    aredatareleasesthatcutacrosspublicbodies

    orwhosereleaseinvolvesaddressingcomplex

    copyrightissues.Outlinedbelowarethreesuch

    highprofiledatareleases.

    • SportEnglandhasforanumberofyearsmaintainedadatabaseofsportsfacilities–‘Active

    Places’–whichitusesprimarilytosupporta

    numberofbusinesstobusinessapplicationsto

    guidenewinvestmentinto,andrationalisationof,

    sportsfacilities.TheFitnessIndustryAssociation

    workingwithSportEnglandisdevelopinga

    projectutilisingActivePlacestodriveforward

    changeinthemarketplace.Launchinginbeta

     thissummer,www.spogo.co.uk isanew,simple,

    searchledservicetohelppeoplefindand(inthecourseoftime)booksportandfitness

    facilitiesandservicesonlineaseasilyasfinding

    andbookingatrainticketorhotelroom. Spogo

    willencouragethedevelopmentofOpenData

    standardstoenablegreatersharingofdata

    withinthesportandleisuresectorandthe

    openingupofActivePlacesdata,firstlyinCSV

    formatandthenviaAPI.

    • UndertheUKLocationProgramme,5weare

    committedtopublishingawiderangeof

    geospatialdatasetsheldbypublicbodieswithin

    aconsistentframeworkthatallowssharing

    andreuseofdataacrosstheEUunderthe

    INSPIRE(InfrastructureforSpatialInformation

    inEurope)Directive.6Thiswillmeanpublishing

    moregeospatialdataonwww.data.gov.uk ;

    whichprovidestoolstosearchfor,viewand

    downloadthedata.

    • InMay2012,HMRevenueandCustoms

    (HMRC)introducedapersonaltaxcalculator7

    andadownloadablephoneapplicationshowing

    howmuchincometaxandNationalInsurancea

    UKworkercanexpecttopayandanillustration

    ofhowtheirtaxescontributetopublicspending.

    ThedepartmentidentifiesOpenDataasakey

    enablerfortaxtransparency.HMRCalready

    workscloselywiththesoftwareindustryand

    willconductaprogrammeofengagementwithsoftwarefirms,civicmindeddevelopersand

    relatedcommunitiestoenablewiderusesof

     theirpublisheddata.

    DeveloperEngagementStrategy

    2.9 Butitisnotenoughtosimplypushoutdata

    andthenabsentourselvesfromthedebates

    andconversationsthatfollow,notleastbecause

    wecannotalwayspredictwithanydegreeof

    certaintyhowdataisbeingusedinallcasesorhowitisstimulatinggrowthandinnovation.

    Aswithallgovernmentdigitalservices;weneed

     todemonstratearelentlessfocusonuserneed.

    Aswellaspromotingbetter,flexibleandmore

    intelligentITsystems,supportedbytransparent

    contracts,weneedtohaveaclearengagement

    strategywiththosethirdpartiesthatareoften

    ourprimarydatausers.

    2.10 Individualdevelopers,SMEs,citizens,

    academicsandlargecompanieswillallbeusersofgovernmentdataandweneedtoensurethat

    wehaverobustengagementmodelsinplaceto

    allowtwowayconversationstohappen.Thisway,

    aprimaryusercantelluswhatdatasetstheywould

    liketoseereleasedasamatterofpriority,inform

    uswhenthereareanomaliesormistakesinour

    datatohelpustoservethemmoreefficiently,

    andkeepusabreastofusagewhichinturnbuilds

    intoourbodyofresearch.

    2.11 Weneedtoworkcollaborativelytoensure

     thatdevelopersareawareofwhatdatasets

    arebeingreleased,inwhattimeframes,andto

    maintainrelationshipswiththoseatthecutting

    edgeoftechnologywhocanhelpgovernment

    dothingsdifferentlyandinmoreagileways.

    Thiskindofconversationbetweengovernment

    andusersfacilitatescapacitybuildingboth

    waystogreatbenefitforthepublicgood.

    2.12 TheCabinetOfficehasrecentlyreleased

    itsguidanceon theuseofsocialmediaforcivil

    servants8asanacknowledgementofthegrowing

    useandimportanceofthesechannels.Inparticular,

    datausers,developersandSMEsaremorelikely

     tousesocialmediachannelstodiscussandshare

    http://www.spogo.co.uk/http://www.spogo.co.uk/http://location.defra.gov.uk/programme/http://location.defra.gov.uk/wp-content/uploads/2009/12/uk-location-strategy.pdfhttp://location.defra.gov.uk/wp-content/uploads/2009/12/uk-location-strategy.pdfhttp://location.defra.gov.uk/wp-content/uploads/2009/12/uk-location-strategy.pdfhttp://location.defra.gov.uk/wp-content/uploads/2009/12/uk-location-strategy.pdfhttp://location.defra.gov.uk/wp-content/uploads/2009/12/uk-location-strategy.pdfhttp://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/https://esi2calculator.hmrc.gov.uk/hmrctaxcalculator/screen/Personal+Tax+Calculator/en-GB/summary?user=guesthttp://www.civilservice.gov.uk/news/lets-get-socialhttp://www.civilservice.gov.uk/news/lets-get-socialhttp://www.civilservice.gov.uk/news/lets-get-socialhttp://www.civilservice.gov.uk/news/lets-get-socialhttp://www.civilservice.gov.uk/news/lets-get-socialhttp://www.civilservice.gov.uk/news/lets-get-socialhttps://esi2calculator.hmrc.gov.uk/hmrctaxcalculator/screen/Personal+Tax+Calculator/en-GB/summary?user=guesthttp://location.defra.gov.uk/wp-content/uploads/2009/12/uk-location-strategy.pdfhttp://www.spogo.co.uk/http://www.data.gov.uk/http://www.spogo.co.uk/http://location.defra.gov.uk/programme/

  • 8/9/2019 Open Data White Paper(1)

    18/52

     

    18 OpenDataWhitePaper

     theirworkandanydeveloperengagementstrategy

    musttakeasitsstartingpointopenengagement

    onsocialmedia.

    2.13 WewillshortlypublishaGovernmentDeveloperEngagementStrategysettingout

    clearprinciplesforhowindividualgovernment

    departmentsareexpectedtoengagewiththe

    developmentcommunity,outliningminimum

    expectationsforServiceLevelAgreements

    betweendevelopersanddepartments,andmaking

    recommendationsonskillsandcompetencies

    requiredforeffectiveengagementwiththis

    community.TheDeveloperEngagementStrategy

    willalsosetouthowdepartmentswillembed theAPIprinciples,developedaspartofthe

    GovernmentICTStrategy,inthiscontinuous

    dialoguewithdeveloperstosupportthekey

    principlesofrobustnessandconsistency.This

    pieceofworkwillbeledbytheGovernment

    DigitalService.9

    2.14 Atpresent,thedatagatheredbythepublic

    sectorisnotalwaysreadilyaccessibleandon

    occasionthequalityofthedataistoolowfor

    effectiveuse.Intermittentpublicationandalackofcommonstandardsarealsobarriersthatcan

    makeitdifficultforuserstoscrutiniseactivityor

    generateaddedvalue.Thismustchangeandone

    ofthebarrierstochangeiscultural.

    Changingthecultureinthepublicsector

    2.15 Todriveculturalchange,manydepartments

    nowhavededicatedsectorboardswhichare

    continuouslychallenginggovernmenttopublish

    moredataandensurethatdepartments

    understandtheimpactofeachrelease.Thesector

    boardsprovideanavenueforengagementwith

     thewidercommunity,withmanyboardsactive

    ininvitingthosefrombusinesses,academia,civil

    societyandthemediatoinformthemoftheir

    experiencesinusingthedatapublishedbyeach

    sector.Theseboardsareabletofindoutaboutthe

    daytodayissuesaroundthepracticalitiesofOpen

    Dataandworkcollectivelytoovercomebarriers.

    Boardshavealreadybeenestablishedforhealth,

    crimeandjustice,transport,education,welfareandlocalgovernment.HMRChasrecentlycommitted

     tosettingupaTaxTransparencySectorBoard,

    whichwillfacilitatediscussionsonthewiderange

    ofinformationthatHMRCholds.

    2.16 Effectiveculturalchangeisnotjustabout

    releasingpreexistingdata.Responsestolastyear’sMakingOpenDataRealConsultation10argued

    forachangeintheethosintheprocurement

    anddeliveryofITatthestrategiclevelwithin

    governmentifenhancedaccesstodataistobe

    realised.Thedatagovernmentholdsisoften

    lockedintoinflexibleITsystemsandretrieving

     thedataisfrequentlyacostlyexerciserequiringa

    detailedbusinesscaseorcontractualamendments.

    2.17 Better,flexibleandmoreintelligentIT

    systemssupportedbytransparentcontractsarecentraltorespondingtothesearguments

    forchange.TheCabinetOfficeisworkingwith

    departmentstoensurethatfutureITcontracts

    allowforeasyanduninterruptedaccesstodata

    heldonthebehalfofgovernment.

    Casestudy–ContractsFinder

    InFebruary2011,theCabinetOffice

    launchedContractsFinder(www.

    contractsfinder.businesslink.gov.uk) –asinglewebsiteforbusinesstoidentify

    governmentcontractsfortenderandthe

    pipelineforfuturecontracts.Thissitenow

    has97,000viewingsperweekandthe

    latestfiguresshowthat,ofthecontracts

    postedtodate,overathirdhavegoneto

    SMEs.InApril2012,newandupdated

    dataon£70billionofpotentialfuture

    governmentcontractswasreleased.

    Publishingdataonfuturecontracts

    allowsgovernmentandindustrytowork

     togethertospotanyskillsandinvestment

    gapssotheycanacttosafeguardUK

    competitivenessandgrowth.

    2.18 Pushingoutdataisanentirelynewwayof

    conductinggovernmentbusiness–onethatislight

     touchanddoesnothavetorequirelotsofcomplex

    regulation,butinsteadoperatesbyhelpingagreater

    numberofpeopleengagewithdatainawaythatinformsdecisionmaking.However,wealsoneedto

    ensurethatthosewhohavealegitimateneedfor

    dataareabletorequest it.

    http://digital.cabinetoffice.gov.uk/category/gds/http://digital.cabinetoffice.gov.uk/category/gds/http://digital.cabinetoffice.gov.uk/category/gds/http://digital.cabinetoffice.gov.uk/category/gds/http://digital.cabinetoffice.gov.uk/category/gds/http://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://www.contractsfinder.businesslink.gov.uk/http://www.contractsfinder.businesslink.gov.uk/http://www.contractsfinder.businesslink.gov.uk/http://www.contractsfinder.businesslink.gov.uk/http://www.contractsfinder.businesslink.gov.uk/http://www.cabinetoffice.gov.uk/resource-library/making-open-data-real-public-consultationhttp://digital.cabinetoffice.gov.uk/category/gds/

  • 8/9/2019 Open Data White Paper(1)

    19/52

     

    Chapter2Enhancedaccess 19

    Strengtheningrightstodata

    2.19 Themainmechanismforrequestingaccess

     todataaretheFreedomofInformationAct(FOIA)

    200011andtheEnvironmentalInformationRegulations(EIRs)2004.12TheFOIAandtheEIRs

    providethepublicwiththeframeworktoaccess

    informationfromapublicauthorityand,providing

     therequestisnotcoveredbyanexemption

    (includingthepublicinteresttestwhererelevant)or

    ministerialveto,theinformationisreleased.Seven

    yearsonfromcomingintoforce,theFOIAisnow

    undergoingpostlegislativescrutiny(PLS)bythe

     JusticeSelectCommitteetoexplorewhetherit

    workseffectively.TheGovernmentwillrespondto theCommittee’srecommendationsinduecourse

    andwillnotmakeanydecisions,beyondthose

    alreadyannouncedinJanuary2011,13onhowthe

    FOIAshouldoperategoingforwardaheadof

    receivingtheJusticeSelectCommittee’sreport.

    2.20 TheGovernmenthas,however,beenableto

    makeimportantprogressinparalleltoPLS.The

    DatasetsSection14oftheProtectionofFreedoms

    Act,15whichreceivedRoyalAssentinMay2012,

    enhancedaccesstodata.Thisnewsectionpushespublicauthoritiestoconsiderdisclosingdatathatis

    notalreadyroutinelypublishedandsetsoutwhat

    ismeantbyadataset–theraw,factualorsource

    informationbehindapublicfunction–toallow

    forabetterunderstandingbetweentheperson

    requestingthedatasetandthepublicauthority

    holdingthedataofwhatisbeingsought.

    2.21 Thenewsectionmeansthat,wherethe

    FOIArequiresreleaseofadataset,apublic

    authoritywillnowhavearesponsibilitytorelease

     thedatasetinaformthatcanbeusedand

    reusedbyspecifyingthelicenceitcanbeused

    underand,wherereasonablypracticable,ina

    reusableformat.Wehavecreatedtheconditions

    foraccessingraw,unmanipulateddatasetsand,by

    workingtoembedthereleaseofthedatasetin

    apublicauthority’spublicationscheme,wehave

     takenanimportantsteptogivethepublican

    enhancedrighttodata.

    2.22 Toensureacomprehensiveapproachtothe

    commencementoftheDatasetsSectioninthe

    ProtectionofFreedomsAct,wehaveamended

    Section4516oftheFOIAandwillbeexpanding

    itsaccompanyingCodeofPracticespecifically

    inrelationtothenewDatasetsSectionasset

    outabove.TheexpandedCodeofPracticewill

    giveguidancetoapplicantsandpublicauthoritiesonhowtodealwithrequestssuchas:giving

    permissionfordatasetstobereused;therelease

    ofdatasetsinanelectronicformwhichiscapable

    ofreuse;themakingofdatasetsavailablefor

    reuseinaccordancewiththetermsofalicence;

    standardsapplicabletopublicauthoritiesin

    connectionwiththedisclosureofdatasets;and

    otheradministrativeissuesrelatedtomaking

    datasetsavailableforreuse.

    2.23 TheCodewillbeupdatedinawaythatwillsupportthoseitdirectlyaffects.Wewill

    openupthedevelopmentprocesstothepublic

    andofferanopportunitytoshapetheguidance

    usingacrowdsourcedwiki.Thiswillbelaunched

    shortlyonwww.data.gov.uk .Inopeningthe

    revisionforcollaborativecontributions,weexpect

     therevisedCodetobeabletoreflectthereal

    worldexperiencesandfirsthandknowledge

    ofobtainingdatasetscapableofreuse.Weare

    aimingfortherevisedCodetobeinplacebythe

    commencementofthesectionearlynextyear,

    whenitwillbeissuedafterconsultationwiththe

    InformationCommissioner.

    2.24 Thislegislativechangeisentirelycompatible

    withtheCodeofPracticeforOfficialStatistics17

    whichmakesdirectreferencetomakingdatasets

    availableinformsconvenienttousersfortheir

    reuse.Tosupportthis,theNationalStatisticianis

    preparingguidancethatwillstresstheimportance

    ofopeningupdata,reinforcingtherolethat

    statisticianscanplayindeliveringwiderbenefits.Statisticiansacrossgovernmentdepartmentsare

    workingtogethertofreeupmoredataforreuse.

    2.25 TheGovernmentStatisticalServicehas

    alsodevelopedcomputerbasedtrainingtohelp

    statisticiansandothercivilservantstomakethe

    rightdecisionsabouthowtomakedataavailable

    inopenformats.TheOfficeforNationalStatistics

    hasdevelopedconsiderableexpertiseinstatistical

    disclosurecontrol,includingonhowtopreventthe

    identificationofindividualsthroughthecomparisonofdifferentdatasets,whichisanessentialfacetof

    ourTransparencyProgramme.

    http://www.legislation.gov.uk/ukpga/2000/36/contentshttp://www.legislation.gov.uk/ukpga/2000/36/contentshttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/ukpga/2000/36/contentshttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.justice.gov.uk/news/press-releases/moj/press-release-070111ahttp://services.parliament.uk/bills/2010-12/protectionoffreedoms.htmlhttp://services.parliament.uk/bills/2010-12/protectionoffreedoms.htmlhttp://services.parliament.uk/bills/2010-12/protectionoffreedoms.htmlhttp://services.parliament.uk/bills/2010-12/protectionoffreedoms.htmlhttp://services.parliament.uk/bills/2010-12/protectionoffreedoms.htmlhttp://services.parliament.uk/bills/2010-12/protectionoffreedoms.htmlhttp://www.legislation.gov.uk/ukpga/2000/36/section/45http://www.legislation.gov.uk/ukpga/2000/36/section/45http://www.legislation.gov.uk/ukpga/2000/36/section/45http://www.data.gov.uk/http://www.data.gov.uk/http://www.statisticsauthority.gov.uk/assessment/code-of-practice/http://www.statisticsauthority.gov.uk/assessment/code-of-practice/http://www.legislation.gov.uk/ukpga/2000/36/section/45http://services.parliament.uk/bills/2010-12/protectionoffreedoms.htmlhttp://www.justice.gov.uk/news/press-releases/moj/press-release-070111ahttp://www.legislation.gov.uk/uksi/2004/3391/contents/madehttp://www.legislation.gov.uk/ukpga/2000/36/contentshttp://www.data.gov.uk/http://www.legislation.gov.uk/ukpga/2012/9/part/6/enacted

  • 8/9/2019 Open Data White Paper(1)

    20/52

     

    20 OpenDataWhitePaper

    2.26 Legislationandcodesofpracticemust,

    however,bematchedbyaculturethatsupports

    apresumptiontopublish.Thispresumptionmust

    involveachangeofmindsettoapositionwheredataownersinthepublicsectorlooktorelease

     thedatatheyhold,whereitdoesnotimpacton

     theproprietyofthatdata,aspartofbusiness

    asusual.Indoingso,wewillbeabletosupport

    people,businessesandcivilsocietyrepresentatives

     toobtainimportantinformationthatcanimprove

     theiroutcomes.TheInformationCommissioner

    hasanimportantroletoplayinensuringthat

    publicauthoritiesarecomplyingwiththeir

    obligationsandprovidingaccuratesignposting

    ofthedatatheyrelease.

    Casestudy–publicationschemes

    TheInformationCommissioner’sOffice

    (ICO)hasrecentlypublishedanactionplan

     toupdateitsmodelpublicationschemeand

    supplementarysectorguidanceinarolling

    programmeduring2012/13.Apublication

    schemeisalegislativerequirementsetout

    intheFOIAwherebyallpublicauthorities

    undertheActmustsetouttheirhighlevelcommitmenttoproactivelypublish

    information.

    Apublicationschemesetsoutclassesof

    informationapublicauthoritywillpublish,

    explainingthewaytheywillpublishthe

    informationandspecifyinganychargesfor

    makingcertaininformationavailable.Under

     thenewDatasetsSectionintheFOIA,

    apublicauthoritymustconsider,when

    releasingadatasetforaccessandreuse,whetherthatdatasetshouldbeincorporated

    intoitspublicationscheme.Knowingwhat

    dataordatasetapublicauthorityholds

    inatransparentmanneraspartoftheir

    publicationschemecanhelptoenhance

    accessibilitytodata.

    ThenewICOguidancewillcoveropen

    standardformats,reuseofinformation

    publishedaspartofapublicationscheme

    andguidanceonhowapublicauthoritycanincreaseawarenessand‘findability’of

    informationaswellasrecommendations

    formonitoringandmanagingthescheme.

    2.27 Wedonotpretendthatitwillbepossible

     tochangethecultureovernight.Itisessential

     that,whenauseridentifiesadatasetthatthey

    areunabletoaccessorreuse,theyunderstand themechanismsavailabletothemtochallengea

    decisioninlinewiththeprocessesavailableunder

     theFOIAorinrespectofthereuseofPublic

    SectorInformation(PSI).

    2.28 Anoverviewoftheprocesssurroundinga

    FreedomofInformationaccessrequestfordata,

    includingthecomplaintsprocess,isoutlinedin

    AnnexB‘Howtorequestdata’. Thisflowchart

    isnotintendedtobeexhaustivebuttogivean

    overviewofthepotentialstepsinvolvedfromtheperspectiveoftherequestor.

    2.29 Traditionally,providingaccesstoinformation

    hasnotgivenanautomaticrightofreuse.Under

     theamendmenttotheFOIA,datasetsthatare

    accessiblewillbeabletobereusedwithout

    needingtomakeanadditionalrequestforreuse.

    2.30 Theredressmechanismforthereuseof

    PSIisviatheOfficeofPublicSectorInformation

    (OPSI),partoftheNationalArchives.OPSI

    providesaneffectivecomplaintsprocedureundertheReuseofPublicSectorInformation

    Regulations200518whichoffersalowcost,fas t

    alternativetoactionthroughthecourts.If,having

    exhaustedthePSIowner’sinternalcomplaints

    procedure,thecomplainantisstilldissatisfied,the

    complainantmayaskOPSItoinvestigate.OPSI

    willpublishitsrecommendations,setdeadlines

    forthemtobemetandmonitorcompliance

    withthem.OPSImayreferthemattertoan

    independentpanelofexperts19andultimately

     toaMinisterwithintheMinistryofJustice

    (MoJ).ThiscouldresultintheMinisterwriting

     totheappropriateMinisterinaUKgovernment

    departmentrequestingthatthePSIowner

    implementsOPSI’srecommendations.

    2.31 Duringanystageofthisprocess,eitherof

     thepartieshastheoptiontotakejudicialaction

     throughthecourts.WhileOPSIleadsonreuse

    complaints,itinvolvesotherregulatorybodies

    suchastheOfficeofFairTrading,theInformation

    CommissionerortheOfficeoftheScottish

    InformationCommissionerinitsinvestigations

    asappropriate.Althoughthisfullandrobust

    mechanismisinplace,theNationalArchives,

    http://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.nationalarchives.gov.uk/appsi/default.htmhttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.nationalarchives.gov.uk/appsi/default.htm

  • 8/9/2019 Open Data White Paper(1)

    21/52

     

    Chapter2Enhancedaccess 21

    withoutprejudicetopeople’srightstoformally

    complain,offersreusersawiderangeofoptions

    frominterventionstoclarifytheGovernment’s

    informationpolicy,throughtoconveningbrokereddiscussionbetweenaPSIreuserandthePSI

    ownerandstructuredmediation.

    2.32 TheamendmentmadetotheFOIA

    introducedbythenewsectionondatasetswill

    meanthat,infuture,therequestorforadataset(as

    definedbythesection)willapproachtheICOwhen

    seekingredressunderanaccessrequest.Details

    ofthischangeandtheredressmechanismwillbe

    coveredinguidancetobepublishedbytheICO.

    2.33 Sowehaveoutlinedhowlegislation,cultureandcomplaintsarechangingbutwealsowant

     toharnessusers’experiencestodrivethenext

    phaseofreleasingpublicdata.Ineffect,wewant

    demandledtransparencytohelpustobesmarter

    inhowwereleasedata.

    Harnessinguserengagement

    2.34 Earlierthisyear,weannounced20thecreation

    oftheOpenDataUserGroup(ODUG)toadvise

     theDataStrategyBoard(DSB)onpublicdata thatshouldbeprioritisedforreleaseasOpen

    Data.Thedatawillbesourcedprimarilyfromthe

    memberorganisationsofthePublicDataGroup

    (PDG)–currentlytheMetOffice,Ordnance

    Survey,LandRegistryandCompaniesHouse–but

     theODUGwillbefreetoadviseonthereleaseof

    datafromotherpublicsectororganisations.The

    ODUGwillactasastrongmechanismfordriving

    demandledtransparencyinthepublicinterest.

    2.35 TheDSBandPDGarebothpartofalargerpublicdataarchitecture21announcedinthe

    Chancellor’s2011AutumnStatement22toboost

    economicgrowth.Inthisnewstructure,setupto

    createopportunitiesforUKbusinessestodevelop

    andgrowthroughgreateraccesstopublicdata,

     theDSBwillbetaskedwithadvisingonmaximising

     thevalueofdatafromthePDGmembersfor

    longtermeconomicandsocialbenefit.

    2.36 TheDSBandPDG,togetherwiththenew

    ODUG,willbeformallyseparatefromtheexistingPublicSectorTransparencyBoard,whichwill

    continuetooffertheMinisterfortheCabinet

    OfficeadviceonTransparencypolicy.

    2.37 TheChairoftheODUGwasrecruited

     throughafairandopencompetition,andthe

    MinisterfortheCabinetOfficemadethe

    appointment23

    inMay2012.TheChairwillestablish theODUGandcommenceaworkplanwhich

    contributestothedeliveryofthegovernment’s

    widerpolicyobjectivesofeconomicgrowth,data

     transparencyandOpenData.TheChairwilllead

     thegroupinadvisingtheDSBonhowtospendthe

    discreteadditionalfundingtheDSBholdsforOpen

    DatathisSpendingReviewperiod.TheChairand

    groupwillalsoberesponsibleforprovidingthe

    businesscasetotheDSBsettingoutthepriorities

    forfurtherinvestmentinOpenDataatthenext

    SpendingReview.

    2.38 Weacknowledgethat,atpresent,charging

    structuresforpublicdataremainasalientand

    emotiveissueformanyusersbutequallywemust

    ensurethatanychangestoexistingarrangements

    mustbedrivenbythelatestavailableevidenceon

     themostappropriateuseofpublicfunds.

    Regulatingdata

    2.39 TheUKisgenerallyrecognisedbyourEuropeanpeersasbeingattheforefrontof

    promotingthereuseofPSIand,sincethe

    introductionoftheReuseofPublicSector

    InformationRegulations,wehaveputinplac e

    manyinitiativestosupportandencourage

    reuse.ImplementingtheEuropeanPublic

    SectorInformationDirectiveinJuly2005,the

    PSIRegulationshavebeensuccessfulinthe

    developmentof:

    • theUKGovernmentLicensingFramework 24and

     theOpenGovernmentLicence;

    • astatutorycomplaintsprocessintheUK

    Regulations;

    • theInformationFairTraderSchemeregulatory 

    framework ;25

    • anannualreport26onUKPSI;

    • proactivereleasesofdatasetsthrough

    www.data.gov.uk ;and

    • existingchargingpoliciesforreuse.27

    2.40 Latelastyear,theEuropeanCommission

    publisheditsproposalstoamendtheDirective,

    https://update.cabinetoffice.gov.uk/resource-library/data-strategy-board-public-data-group-and-open-data-user-group-resourceshttp://www.bis.gov.uk/assets/biscore/growth/docs/12-673-terms-reference-data-strategy-board-and-public-data-grouphttp://www.hm-treasury.gov.uk/d/growth_review_phase1update_291111.pdfhttp://www.cabinetoffice.gov.uk/news/chair-open-data-user-group-appointedhttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.nationalarchives.gov.uk/information-management/uk-gov-licensing-framework.htmhttp://www.nationalarchives.gov.uk/information-management/ifts.htmhttp://www.nationalarchives.gov.uk/information-management/ifts.htmhttp://www.nationalarchives.gov.uk/information-management/ifts.htmhttp://www.nationalarchives.gov.uk/information-management/ifts.htmhttp://www.nationalarchives.gov.uk/information-management/ifts.htmhttp://www.nationalarchives.gov.uk/information-management/legislation/directive-and-regulations.htmhttp://www.data.gov.uk/http://www.data.gov.uk/http://www.nationalarchives.gov.uk/information-management/ifts/cost-pricing.htmhttp://www.nationalarchives.gov.uk/information-management/ifts.htmhttp://www.legislation.gov.uk/uksi/2005/1515/contents/madehttp://www.cabinetoffice.gov.uk/news/chair-open-data-user-group-appointedhttp://www.data.gov.uk/http://www.nationalarchives.gov.uk/information-management/ifts/cost-pricing.htmhttp://www.nationalarchives.gov.uk/information-management/legislation/directive-and-regulations.htmhttp://www.nationalarchives.gov.uk/information-management/uk-gov-licensing-framework.htmhttp://www.hm-treasury.gov.uk/d/growth_review_phase1update_291111.pdfhttp://www.bis.gov.uk/assets/biscore/growth/docs/12-673-terms-reference-data-strategy-board-and-public-data-grouphttps://update.cabinetoffice.gov.uk/resource-library/data-strategy-board-public-data-group-and-open-data-user-group-resources

  • 8/9/2019 Open Data White Paper(1)

    22/52

     

    22 OpenDataWhitePaper

    Communication on Open Data: An engine for

    innovation, growth and transparent governance ,28

    formingpartoftheEU’s2020Strategy 29to

    promotegrowthinEurope’seconomies.2.41 TheCommissionbelieves30thatadopting

    OpenDataprinciplesandremovingbarriersto

    reusecangenerateeconomicbenefitsinthe

    orderof£33billionayear.FollowingfromtheUK’s

    example,theEuropeanCommissionbelievesthat

    openinguppublicdataleadstogreatertransparency

    inpublicadministrationandpromotessocialand

    politicalengagement.Thelastkeythemeofthe

    Commission’sproposalscentresarounditsstrong

    beliefthatincreasingtheavailabilityofEUwidepublicdatawillleadtobetterevidencebasedpolicy

    makingacrossthepublicsector,resultinginmore

    efficientandeffectivepublicservices.

    2.42 Currently,theUKisnegotiatingtherevision

     tothePublicSectorInformationDirectiveand,

    whilewefirmlybelievethatgreateropennessand

    availabilityofdataforreuseacrossEuropeare

    essential,wearemindfulthatthismustbedonein

    apragmaticandaffordablewaywhichdoesn’tadd

    unnecessaryburdens(orpotentiallossofrevenue)onpublicauthoritiestowhomtheresultingrevised

    Regulationswillapply.

    2.43 Weintendtoundertakeacomprehensive

    andindependentlychairedreviewoftheuse,

    reuse,fundingandregulationofPSI.Wewill

    publishdetailsofthisreviewintheautumnof

    2012.Inundertakingthisreview,weareableto

    guaranteethatrobustevidenceisatthecentreof

    decisionmakinginthisareaandthatitisfocused

    onmaximisingthebenefitofPSItothewholeof

     theUK,ratherthanjustitsuseby government.

    Strengtheningdatausability

    2.44 Itisvitalthatwepublishdatainwayswhich

    allowpeopletouseiteasilyandreliably.Doing

    soenablesdatatobeusedwidely,reducesthe

    barrierstoinnovationandeliminatesunnecessary

    costsforbusinessesusingthedata.

    2.45 AtthestartoftheTransparencyProgramme,

    weestablishedthePublicSectorTransparencyBoardandaskedittogiveadviceongeneral

    principlesregardinghowtomakepublisheddata

    asusefulaspossible.InJune2010,wepublished

     theBoard’sPublicDataPrinciples31andthese

    have,forthepasttwoyears,beenafoundation

    stonetoguidethepublicsectorinpublishingdata. Wehaveseenthesedraftprinciples,alongwith

     theInformationPrinciples,32embeddedwithin

    departmentalOpenDataStrategies.Datausers

    werealsoinvitedtocommentontheprinciples

    andhowtheycouldbeimproved.Nowisthe

    righttimetomakesurethattheprincipleshave

    becomeafundamentalpartoftheprocessof

    datapublication.Theannouncementthatwe’ve

    adoptedtheseasgovernmentpolicy,andthatthe

    CabinetOfficeiscommittingtoprovidingawritten

    ministerialstatementfourtimesayeartoreportoncompliance,isevidenceofthis.

    2.46 Theprinciples,drawnupbythePublicSector

    TransparencyBoardandrevisedastheresultof

    consultation,areasfollows.

    (1) Publicdatapolicyandpracticewillbe

    clearlydrivenbythepublicandbusinesses

    thatwantandusethedata,includingwhat

    dataisreleasedwhenandinwhatform

    ThisisattheheartoftheGovernment’sapproach.Ourproposalsfordelivering

    enhancedaccesstodataaredetailed

     throughoutthischapter.

    (2) Publicdatawillbepublishedinre-usable,

    machine-readableform

    Thedefinitionsofreusablemachine

    readablearecoveredbytheFiveStar

    Schemeoutlinedlaterinthischapter.

    (3) Publicdatawillbereleasedunderthesameopenlicencewhichenablesfreere-use,

    includingcommercialre-use

    ForfreeUKGovernmentdata,thiswillbe

     theOpenGovernmentLicence33prepared

    bytheNationalArchives–theOpen

    GovernmentLicencewillbeusedforfree

    datathroughoutgovernment.

    (4) Publicdatawillbeavailableandeasytofind

    throughasingle,easy-to-use,onlineaccess

    point(www.data.gov.uk )

    ThismeansthatallgovernmentOpenData

    willbeaccessiblethroughwww.data.gov.uk –

    http://ec.europa.eu/information_society/policy/psi/docs/pdfs/directive_proposal/2012/open_data.pdfhttp://ec.europa.eu/information_society/policy/psi/docs/pdfs/directive_proposal/2012/open_data.pdfhttp://ec.europa.eu/eu2020/http://ec.europa.eu/information_society/policy/psi/docs/pdfs/opendata2012/reports/Vickery.docxhttp://data.gov.uk/blog/new-public-sector-transparency-board-and-public-data-transparency-principleshttp://www.nationalarchives.gov.uk/information-management/projects-and-work/information-principles.htmhttp://www.data.gov.uk/http://www.data.gov.uk/http://www.nationalarchives.gov.uk/information-management/projects-and-work/information-principles.htmhttp://data.gov.uk/blog/new-public-sector-transparency-board-and-public-data-transparency-principleshttp://www.data.gov.uk/http://www.data.gov.uk/http://ec.europa.eu/information_society/policy/psi/docs/pdfs/opendata2012/reports/Vickery.docxhttp://ec.europa.eu/eu2020/http://ec.europa.eu/information_society/policy/psi/docs/pdfs/directive_proposal/2012/open_data.pdf

  • 8/9/2019 Open Data White Paper(1)

    23/52

     

    althoughitmaybehostedondepartmental

    websitesandmayalsobeaccessiblethrough

    otheraccesspoints(forinstancetheUK

    NationalStatisticsPublicationHub),forexampleforservicetoaspecialistcommunity.

    (5) Publicdatawillbepublishedusing

    openstandards,andfollowingrelevant

    recommendationsoftheWorldWideWeb

    Consortium(W3C)

    ThisprincipleappliestopublishedOpenData

    butitisofcoursewhollyconsistentwiththe

    Government’soverallpolicyapproachon

     theuseofopenstandardsingovernmentIT

    moregenerally,onwhichaconsultationhasrecentlyconcluded.

    (6) Publicdatafromdifferentdepartments

    aboutthesamesubjectwillbepublishedin

    thesame,standardformatsandwiththe

    samedefinitions

    TheGovernmenthasalreadyapplied

     thisprincipleintheformatsusedforthe

    publicationofkeytransparencydata,including

    spendingbycentralandlocalgovernmentandonorganisationaldata,workingwith

     theindividualdataownersandtheLocal

    GovernmentAssociationtoagreestandard

    formatswhichareeasyandcosteffective

     to produce.

    (7) PublicdataunderlyingtheGovernment’s

    ownwebsiteswillbepublishedinre-usable

    form

    ThiscomplementstheGovernment’s

    approachtodigitalservicesfollowing thereportbyMarthaLaneFox.34The

    Governmentshouldnothaveamonopoly

    ontheprovisionofwebservicesandmobile

    applications;itshouldinsteadmakethedata

    andAPIsavailablesothatotherscanproduce

    alternative,innovativeviewsofgovernment

    dataandaccesstogovernment services.

    (8) Publicdatawillbetimelyandfine-grained

    TheGovernment’sapproachtoOpenData

    isnotlimitedtothepublicationofaggregate

    datalongaftertheeventstowhichitrelates.

    So,forinstance,theGovernmentisalready

    Chapter2Enhancedaccess 23

    publishingindividualspendingitemswithin

    15workingdaysoftheendofthemonthin

    whichtheywerepaid;andtheGovernmentis

    alreadypublishingweatherforecastdatafrom thePublicWeatherServicefor5,000UK

    locationsonanhourlybasis.

    (9) Releasedataquickly,andthenworkto

    makesurethatitisavailableinopen

    standardformats,includinglinked

    dataforms

    TheGovernment’sspecificproposalsonthe

    FiveStarSchemeandonadoptingalinked

    dataapproachareoutlinedlaterinthischapter.

    (10) Publicdatawillbefreelyavailabletouse

    inanylawfulway

    TheOpenGovernmentLicencealready

    incorporatesthisprinciple.Applicationsare

    abletousethedatainanylawfulwaywithout

    havingtoinformorobtainthepermissionof

     thepublicbodyconcerned.

    (11) Publicdatawillbeavailablewithout

    applicationorregistration,andwithout

    requiringdetailsoftheuser

    ItisanimportantpartoftheGovernment’s

    approachtoOpenDatathatpeopleshould

    beabletousetherawdatafreely,and

    requiringapplication,registrationorpersonal

    detailsmilitatesagainstthis.However,both

     theGovernmentandtheTransparencyBoard

    recognisethat,incertaintechnicalsituations

    (suchasAPIs),developerkeyswouldbe

    neededincertaincircumstancesbutthat

     thesemustbereadilyandquicklyavailablewithoutdiscrimination,andthatthedatathey

    accessmustbeavailableundertheOpen

    Government Licence.

    (12) Publicbodiesshouldactivelyencourage

    there-useoftheirpublicdata

    TheGovernmentregardsitasimportant

     thatindividualdepartmentsencourage

     thereuseoftheirOpenData,including

    workingwithbusinessestohelpgrownew,

    innovativeusesofdataandtogenerate

    economicbenefit.Departmentsarealready

    doingthisthroughtheSectorTransparency

    Boards,bymakinginformationandsupport

    http://www.cabinetoffice.gov.uk/news/digital-default-proposed-government-serviceshttp://www.nationalarchives.gov.uk/doc/open-government-licence/http://www.nationalarchives.gov.uk/doc/open-government-licence/http://www.cabinetoffice.gov.uk/news/digital-default-proposed-government-services

  • 8/9/2019 Open Data White Paper(1)

    24/52

     

    24 OpenDataWhitePaper

    available,byholdingdepartmental‘hackdays’

    andthroughothermeans.Inaddition,the

    GovernmentisestablishinganOpenData

    InstitutetopromotethereuseofOpenData,toshareknowledgeandapplicationsin

     theuseofOpenData,andtodeveloplinks

    betweengovernmentandbusinessesaround

    Open Data.

    (13) Publicbodiesshouldmaintainandpublish

    inventoriesoftheirdataholdings

    (14) Publicbodiesshouldpublishrelevant

    metadataabouttheirdatasetsandthis

    shouldbeavailablethroughasingleonline

    accesspoint;andtheyshouldpublishsupportingdescriptionsoftheformat

    provenanceandmeaningofthedata

    www.data.gov.uk alreadyincludesbasic

    metadataaboutallitsdatasets,including

     timingandgeographicalscope,andwill

    publishextendedmetadataabout

    geospatiallyrelateddatasetstowhichthe

    INSPIREDirectiveapplies.www.data.gov.uk

    alsoprovidesalinktoadepartmentally

    supplieddescriptionofthedataanddetailsof

    acontactpointwithinthedepartmentwhodatauserscanaskforfurtherdetails.

    2.47 Werecognisethattheseprinciplesmay

    notbeimmediatelypossibleforalldatasetsin

    allbodies.However,weregarditasessentialto

    haveaclear,unqualifiedstatementofprinciplesto

    whichallbodiescanaspire.Individualgovernment

    departments,workingwiththeCabinetOffice

    TransparencyTeam,willproduceplansto

    worktowardstheseprinciplesaspartofthe

    implementationoftheirOpenDataStrategies.2.48 WealsoregarditasessentialthatOpen

    Dataisasreusableaspossible.In2010,SirTim

    BernersLeeproposedaFiveStarScheme35for

    assessingthedegreetowhichindividualdatasets

    arereusable.Anexpandedversionofhisscheme

    forfreedataisasfollows.

    Level Format Licence

    ★  Makeyourdataavailableontheweb(inanyformat) and OpenLicence

    ★★ Makeitavailableasstructureddata(forexample,

    MicrosoftExcelinsteadofimagescanofatable)

    and OpenLicence

    ★★★ 

    Makeitavailableinanopen,nonproprietary

    format(forexample,CSVorXMLinsteadof

    Microsoft Excel)

    and OpenLicence

    ★★★★ 

    Inadditiontousingopenformats,useUniform

    ResourceLocators(URLs)toidentifythingsusing

    openstandardsandrecommendationsfromW3C,

    sothatotherpeoplecanpointatyourstuff

    and OpenLicence

    ★★★★★ 

    InadditiontousingopenformatsandusingURLsto

    identifythings,linkyourdatatootherpeople’sdata

     toprovidecontext

    and OpenLicence

    http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.w3.org/DesignIssues/LinkedData.htmlhttp://www.data.gov.uk/http://www.data.gov.uk/http://www.w3.org/DesignIssues/LinkedData.html

  • 8/9/2019 Open Data White Paper(1)

    25/52

     

    Chapter2Enhancedaccess 25

    2.49 TheGovernmentintendstoadopttheFive

    StarSchemeasameasureoftheusabilityofits

    OpenData.Weknowthatnotallourdataisof

     thehighestlevelofusabilitybut,throughusingtheFiveStarSchemeforlabellingdatasets,weare

    workingtowardsimprovingthedatalandscape.

     Wearenotsettingtargetsfordatausability;

    responsibilityforevaluatingthecostsandbenefits

    ofenhancingdatausabilitywillbedevolvedtodata

    ownersineachpublicauthority.Departmental

    engagementwithusers,akeyrequirementof

     theOpenDataStrategies,willbeessentialin

    determiningwhetherthebenefitsofimproving

    datausabilityjustifyanyassociatedcost.

    2.50 Thathavingbeensaid,theGovernment’s

    overallpreferenceforopenstandardsandthe

    factthattheOpenGovernmentLicencealready

    applies,meansthatitisexpectedthatalmostall

    datasetswillreachatleastThreeStarstandard.

    2.51 However,thereisagrowingrealisationof

     thepoweroflinkeddataforexposing,sharing

    andconnectingpiecesofdataandinformation

    usingUniformResourceIdentifiers(URIs)to

    realiseefficienciesinthepublicsector.Linkeddataunderpinsotherinitiatives,particularlythoseofa

    crosscuttingnaturesuchastheaforementioned

    INSPIREDirective.

    2.52 Acrossthepublicsector,pocketsof

    knowledgeabouttheunderpinningtechnologies

    oflinkeddataandthebenefitsthattheyenable

    havebeenestablished.Overthelastyear,wehave

    beenreviewingwhatisrequiredtoencourage

    furtherdatalinkageinthepublicsector,following

     thesuccessofsomelinkeddataworkinggroupsin

    specificdomainsandthegrowinginterestthatthey

    havehadfromthoseoutsidethosedomains.

    Casestudy–www.legislation.gov.uk

    TheavailabilityoflegislationasOpenData

    onwww.legislation.gov.uk hasenabled theNationalArchivestodevelopanew,

     transferableoperatingmodelforupdating

    governmentdatabases.Ahighqualitydata

    interfacemakesiteasyforanyonetoaccess

    legislationdatabyadding/data.xmlor/data.

    rdftoanywebpagecontaininglegislation,

    or/data.feedtoanylistorsearchresults.

    Datacanbereusedfreeofchargeunder

     theOpenGovernmentLicence.

    Thishasenabledthedevelopmentofseveralthirdpartyapplications,including

     twosmartphoneappsandaserviceforlaw

    lecturerstocreateandselfpublishrelevant

    extractsoflegislationfortheircourses.

    Throughanexpertparticipation

    programme,OpenDataishelpingto

    bringmoreexpertisetobear,withpeople

    employedandfundedbytheprivatesector,

     toworkonupdatingtheGovernment’s

    legislationdatabase.Qualityismaintained throughtrainingoneditorialpracticeand

    a stringentprocessofreview.

    www.legislation.gov.ukgivesbusinesseseasy

    accesstolegislationdata,whichtheycan

    includeintheirownproductsandservices.

    Thepublicbenefitsfrommoreuptodate

    legislation,whilebusinessbenefitsfrom

    developingvalueaddedproductsand

    services.Allthedataisofconsistentlyhigh

    quality,remainingpublic,openandfree.

    2.53 AnewcrossgovernmentLinkedData

     WorkingGroupwillbeestablishedoverthe

    comingmonths.Thiswillleadthecreationand

    maintenanceoftheunderpinningtechnologies

    withinthepublicsectorandpromotethebenefits

    acrossthepublicsector.Akeyroleforthegroup

    willbetoworkwithdataowners,datausersand

    bodiessuchastheW3CGovernmentLinkedData

     WorkingGroup,topromoteandsetstandardsfor theadoptionofcommonURIsacrossgovernment.

    Thisprovisionofacoreofauthoritativeidentifiers

    (forinstanceforbusinesses,contracts,postcodes

    http://www.legislation.gov.uk/http://www.legislation.gov.uk/http://www.legislation.gov.uk/http://www.legislation.gov.uk/http://www.legislation.gov.uk/http://www.legislation.gov.uk/http://www.legislation.gov.uk/

  • 8/9/2019 Open Data White Paper(1)

    26/52

     

    26 OpenDataWhitePaper

    andgeospatialentitiessuchasroadsandbus

    stops)willbethekeytoconnectingdataacrossthe

    informationeconomyandallowingbusinessesto

    addvalueandtoexchangeinformationreliablyin thedigitalworld.

    Casestudy–Departmentfor

    CommunitiesandLocalGovernment

    (DCLG)

    DCLGistriallingaselectionofitshousing,

    localgovernmentfinanceanddeprivation

    statisticsintheFiveStarform.Thedatasets

    areavailableinanewdemonstration

    ‘OpenDataCabinet’(http://opendatacommunities.org),which

    waslaunchedinApril2012.

    TheDepartmentisworkingclosely

    withasmallgroupoflocalauthorities

    andvoluntaryorganisationstotestand

    demonstratethepowerandpotentialof

    linkingDCLGandthirdpartysourcesover

     theweb,usingopenstandards.Earlyresults

    arehighlyencouraging.

    Alongsidethedatacabinet,DCLGhaslaunchedademonstrationLocalAuthority

    Dashboard(http://opendatacommunities.org/

    dashboard).Thishasprovedhighly

    successfulasameanstoshowcaseand

    promoteOpenDataandstandardsto

    anontechnicalaudience.Ittherefore

    strengthensengagementwithusers,to

    helptoshapetheDepartment’smove

     towardsroutinelyreleasingalldatainopen,

    accessibleandreusableforms.

    2.54 Drivinguptheusabilityandconsistencyof

    datamadeavailablebypublicauthoritiesisonly

    beneficialiftheuserisabletofindthedatain

     thefirstplace.Inrecentmonths,wehavemade

    importantprogresswithwww.data.gov.uk .

    Betteraccesstopublicdata

    2.55 Weputmuchofourdataonwww.data.gov.uk

     –butweknowthatusershavefoundthesitehard tonavigate.Sowe’vecompletelyoverhauledit:

    www.data.gov.uk nowhasbettersearchfacilities,

    simplerwaystoaccessinformation,anadvanced

    GISdatasearch(includingmappreviewing)and

    bettertoolsfordevelopers,suchasAPIaccessto

     thecatalogueholdings.We’vebeentestingthe

    changeswithusersforsometimenowandfeedbackhasbeenstronglypositive,allowingusto

    launchthenewsitewiththisWhitePaper.We

    wouldwelcomemoreviewsonhowthesitecan

    befurtherimproved;thereisafacilityonthesite

    whereuserscangivefeedback.

    2.56 Thesite’snewstructurewillalsofacilitate

     theestablishmentofagovernmentdata

    inventorylookingacrosspublisheddataand

    otherdepartmentalholdings,tofacilitatefuture

    publicationandprovideanopportunitytoallowforprioritisationofthosedatasets,ineitherrawor

    processedform,thatareofmostvaluetousers.

    2.57 Aspartofthedevelopmentofadata

    inventory,wewillexplorehowbestthepubliccan

    requestdatathroughthesite,complementingthe

    moreformalrouteofFreedomofInformation

    requests.Alongsidethis,departmentswilldevelop

    aframeworkthatoutlinesthebestmethods

    forreleasingandpublishingrequesteddataas

    partoftheirongoingstrategytodeliveronthepresumptiontopublish.

    2.58 Wearealsoworkingactivelytorationalise

    ourdataholdingsandestablishdifferentavenues

    forgovernmentdatathathasbeencleansedby

    externalpartiestoreturntothedataownerfor

    consideration.Asnewinfrastructuresforhandling

    dataareimplementedacrossgovernment,a

    mechanismtofeeddatabacktoitsownerwill

    beintegratedintodata.gov.uk inthecoming

    months.

    2.59 Therearealsovariousdatasetswhichare

    regulatedtoensureaccess;oneoftheseisthe

    PostcodeAddressFile (PAF) producedbythe

    RoyalMail.It isanimportant inputtomany private

    sector productsandservices,anditsvalue now

    goesfarbeyondits original purposeasatoolto

    enabledeliveryofthemail.Itisalsoacriticalpart

    oftheNationalAddressGazetteer(NAG), which

    isthedefinitivesingleaddressregisterandis

    partof considerationsto developplansfor

    arolling census.

    2.60 ThePAFisregulatedby Ofcomto ensure

     thatitismaintainedandmadeavailabletoall

    http://opendatacommunities.org/http://opendatacommunities.org/dashboardhttp://opendatacommunities.org/dashboardhttp://opendatacommunities.org/dashboardhttp://opendatacommunities.org/dashboardhttp://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://www.data.gov.uk/http://opendatacommunities.org/dashboardhttp://opendatacommunities.org/http://www.data.gov.uk/

  • 8/9/2019 Open Data White Paper(1)

    27/52

     

    Chapter2Enhancedaccess 27

    usersonreasonableterms. Ofcomiscurrently

    reviewingthisregulatoryframeworktoensure

     thatitincentivisestakeupofthePAF,thatthe

    dataismadeeasilyaccessibleonreasonabletermsandthatitalsodrivestheefficientmaintenance

    ofthePAF.Thereviewwillconsiderthecostsof

    maintainingthePAFandtheassociated licensing

    andpricingstructures. Overthenextsixmonths,

     theGovernmentwillalso lookatoptionstoensure

     thattheUKasawholecontinuestogetthebest

    benefitfromthePAF,andthatthePAFcontinues

     tobeakeypartofthesingledefinitiveaddress

    register(theNAG).

    2.61 Greateraccesstopublicdatathroughdata.gov.uk isanessentialpartofourstrategyfor

    makingthemosteffectiveuseofdata.However,

    wemustalsoconsiderhowweopenuppublicly

    fundedresearchdatainawaythatmaximises

    publicbenefit.

    Openingupaccesstoresearch

    2.62 TheGovernment,initsInnovation and 

    Research Strategy for Growth ,36hascommitted

     totheprinciplethatpubliclyfundedacademicresearchisapublicgoodproducedinthepublic

    interestandthat,whileintellectualpropertymust

    beprotectedandcommercialinterestsconsidered,

    itshouldbemadeopenlyavailablewithasfew

    restrictionsaspossible.Inthisway,wewillmore

    effectivelyrealisethesocialandeconomicbenefits

    ofspreadingknowledge,raisingtheprestigeofUK

    researchandencouragingtechnologytransfer.

    2.63 Fundingagenciesshouldhaveclear,

    enforceableopenaccessarrangementsforthe

    disseminationofpublishedresearchfindingsaswell

    asensuringthattheassociateddataisalso,where

    appropriate,madeavailableandshared.

    AnindependentWorkingGroupchairedbyDame

     JanetFinchhasrecentlyreported37onhowwe

    canensuregreateraccesstopublishedresearch

    findings,whiletheRoyalSociety’sScience as an 

    Open Enterprise38reportdiscussedhowtoimprove

     thesharinganddisclosingofresearchdata,both

    withintheresearchcommunityandbeyond.

    2.64 Forsmallbusinessesinparticular,relevant

    researchisoftendifficulttofindandexpensive

     toaccess,limitingthespreadofknowledgeand

    innovation.Toaddressthis,ResearchCouncils

    willinvest£2millionintheGatewaytoResearch

    projectwhichwilllaunchinDecember2013.This

    willprovideasinglepointofaccesstoallaspects

    ofUKpubliclyfundedresearch.ItwillserveasanetworkingtoolforusebySMEs,entrepreneurs,

    intermediariesandotheradvisorsinthefield.

    ResearchCouncilsarecurrentlyontrackto

    developaprototypedemonstratorportalby

    November2012.

    2.65 Theconcernsofuniversitiesthatpremature

    disclosureofresearchdatamightdamagetheir

    abilitytocompetewithinternationalrivalsand

     tocollaboratewithindustryaroseinourMaking

    OpenDataRealConsultation.SuchconcernshavealsobeenraisedinevidencetotheJustice

    SelectCommitteeduringpostlegislativescrutiny

    oftheFOIA.TheGovernmentwillconsiderthe

    Committee’srecommendationsontheoperation

    oftheFOIAbeforebringingforwardanyproposals

    forfuturepolicy.

    2.66 Tofurtherdevelopgovernmentpolicyon

    accesstoresearch,wearealsoestablishinga

    ResearchTransparencySectorBoard,chairedby

     theMinisterforUniversitiesandScience,whichwillconsider waysinwhichtransparencyinthe

    areaofresearchcanbeadriverforinnovation.

    Recognisingthatresearchdataisdifferenttoother

    PSI,theBoardwill considerhowtoimplement

     transparencymeasuresrelatingtoresearchin

    amannerwhichprotectstheintegrityofthe

    researchandassociatedintellectualproperty,

    whileensuringaccesstoresearchforthoseSME

    entrepreneursvitalfordrivinggrowth.Thiswill

    helptorealisethefullbenefitsforsocietyasa

    whole.TheResearchTransparencySectorBoardwillconsistofgovernmentdepartments,funding

    agenciesandrepresentativesfromuniversities

    andotherstakeholders,andamongthefirstof

    itstaskswillbetoconsiderhowtoactonthe

    recommendationsoftheRoyalSocietyreport.

    2.67 Governmentdepartmentsarealso

    committedtoopeninguptheirownresearch

    dataandplacingitinthepublicdomainasquickly

    andinasmuchdetailaspossible,subjecttolegal

    andconfidentialityrestraints.TheGovernmentSocialResearchServiceiscurrentlyworkingonan

    initiativetoputpolicyandpracticeinplacethat

    willenableroutinearchivingofresearchdataand

    releasetobonafideexternalresearchers.

    http://data.gov.uk/http://www.bis.gov.uk/assets/biscore/innovation/docs/i/11-1387-innovation-and-research-strategy-for-growth.pdfhttp://www.bis.gov.uk/assets/biscore/innovation/docs/i/11-1387-innovation-and-research-strategy-for-growth.pdfhttp://www.bis.gov.uk/assets/biscore/innovation/docs/i/11-1387-innovation-and-research-strategy-for-growth.pdfhttp://www.bis.gov.uk/assets/biscore/innovation/docs/i/11-1387-innovation-and-research-strategy-for-growth.pdfhttp://www.bis.gov.uk/assets/biscore/innovation/docs/i/11-1387-innovation-and-research-strategy-for-growth.pdfhttp://www.bis.gov.uk/assets/biscore/innovation/docs/i/11-1387-innovation-and-research-strategy-for-growth.pdfhttp://www.researchinfonet.org/wp-content/uploads/2012/06/Finch-Group-report-FINAL-VERSION.pdfhttp://royalsociety.org/uploadedFiles/Royal_Society_Content/policy/projects/sape/2012-06-20-SAOE.pdfhttp://royalsociety.org/uploadedFiles/Royal_Society_Content/policy/projects/sape/2012-06-20-SAOE.pdfhttp://royalsociety.org/uploadedFiles/Royal_Society_Content/policy/projects/sape/2012-06-20-SAOE.pdfhttp://royalsociety.org/uploadedFiles/Royal_Society_Content/policy/projects/sape/2012-06-20-SAOE.pdfhttp://royalsociety.org/uploadedFiles/Royal_Society_Content/policy/projects/sape/2012-06-20-SAOE.pdfhttp://royalsociety.org/uploadedFiles/Royal_Society_Content/policy/projects/sape/2012-06-20-SAOE.pdfhttp://data.gov.uk/http://royalsociety.org/uploadedFiles/Royal_Society_Content/policy/projects/sape/2012-06-20-SAOE.pdfhttp://www.researchinfonet.org/wp-content/uploads/2012/06/Finch-Group-report-FINAL-VERSION.pdfhttp://www.bis.gov.uk/assets/biscore/innovation/docs/i/11-1387-innovation-and-research-strategy-for-growth.pdf

  • 8/9/2019 Open Data White Paper(1)

    28/52

     

    28 OpenDataWhitePaper

    2.68 Thischapteroutlinedourintentionsto

    releasemoreOpenDataandalsosupport

    OpenDatausers,aspartofourdrivetounlock

     thebenefitsoftransparency.Aswereinforcethepresumption to publishinthepublicsector

    throughthemeasuresoutlinedabove,wemust

    bevigilantthattrustisretainedatthesame

    timeaspublicdataismademoreopen.The

    nextchapterconsidershowwecanstrikethe

    right balance.

  • 8/9/2019 Open Data White Paper(1)

    29/52

     

    Chapter2Enhancedaccess 29

    Notes

    1 www.number10.gov.uk/news/lettertogovernment-

    departmentsonopeningupdata

    2 www.number10.gov.uk/news/lettertocabinet-

    ministersontransparencyandopendata

    3 http://communities.mavencast.com/pg/groups/3731

    4 www.hmtreasury.gov.uk/press_135_11.htm

    5 http://location.defra.gov.uk/programme/

    6 http://inspire.jrc.ec.europa.eu/

    7 http://esi2calculator.hmrc.gov.uk/hmrctaxcalculator/

    screen/Personal+Tax+Calculator/enGB/

    summary?user=guest

    8 www.civilservice.gov.uk/news/letsgetsocial

    9 http://digital.cabinetoffice.gov.uk/category/gds/

    10 www.cabinetoffice.gov.uk/resourcelibrary/making-

    opendatarealpublicconsultation

    11 www.legislation.gov.uk/ukpga/2000/36/contents

    12 www.legislation.gov.uk/uksi/2004/3391/contents/

    made

    13 www.justice.gov.uk/news/pressreleases/moj/press-

    release070111a

    14 www.legislation.gov.uk/ukpga/2012/9/part/6/enacted15 http://services.parliament.uk/bills/201012/

    protectionoffreedoms.html

    16 www.legislation.gov.uk/ukpga/2000/36/section/45

    17 www.statisticsauthority.gov.uk/assessment/codeof-

    practice/

    18 www.legislation.gov.uk/uksi/2005/1515/contents/

    made

    19 TheAdvisoryPanelonPublicSectorInformation(APPSI),

    www.nationalarchives.gov.uk/appsi/default.htm

    20 http://update.cabinetoffice.gov.uk/resourcelibrary/datastrategyboardpublicdatagroupandopendata-

    usergroupresources

    21 www.bis.gov.uk/assets/biscore/growth/docs/12673-

    termsreferencedatastrategyboardandpublicdata-

    group

    22 www.hmtreasury.gov.uk/d/growth_review_

    phase1update_291111.pdf

    23 www.cabinetoffice.gov.uk/news/chairopendatauser-

    groupappointed

    24 www.nationalarchives.gov.uk/information-

    management/ukgovlicensingframework.htm

    25 www.nationalarchives.gov.uk/information-

    management/ifts.htm26 www.nationalarchives.gov.uk/information-

    management/legislation/directiveandregulations.htm

    27 www.nationalarchives.gov.uk/information-

    management/ifts/costpricing.htm

    28 http://ec.europa.eu/information_society/policy/psi/

    docs/pdfs/directive_proposal/2012/open_data.pdf

    29 http://ec.europa.eu/eu2020/

    30 http://ec.europa.eu/information_society/policy/psi/

    docs/pdfs/opendata2012/reports/Vickery.docx

    31 http://data.gov.uk/blog/newpublicsector-

    transparencyboardandpublicdatatransparency-

    principles

    32 http://www.nationalarchives.gov.uk/information-

    management/projectsandwork/information-

    principles.htm

    33 www.nationalarchives.gov.uk/doc/opengovernment-

    licence/

    34 www.cabinetoffice.gov.uk/news/digitaldefault-

    proposedgovernmentservices

    35 www.w3.org/DesignIssues/LinkedData.html

    36 www.bis.gov.uk/assets/biscore/innovation/docs/i/11-

    1387innovationandresearchstrategyforgrowth.pdf

    37 http://www.researchinfonet.org/wpcontent/

    uploads/2012/06/FinchGroupreportFINAL

    VERSION.pdf

    38 http://royalsociety.org/policy/projects/sciencepublic-

    enterprise/

    http://ec.europa.eu/information_society/policy/psi/docs/pdfs/directive_proposal/2012/open_data.pdfhttp://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-datahttp://www.number10.gov.uk/news/letter-to-government-departments-on-opening-up-datahttp://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-datahttp://www.number10.gov.uk/news/letter-to-cabinet-ministers-on-transparency-and-open-datahttp://communities.maven-cast.com/pg/groups/3731http://www.hm-treasury.gov.uk/press_135_11.htmh