scottish government data how can we make it really useful? peter winstanley lhd-12 boston, ma....
TRANSCRIPT
![Page 1: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/1.jpg)
Scottish Government Data
How can we make it really useful?
Peter Winstanley LHD-12 Boston, MA. 2012-11-12
![Page 2: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/2.jpg)
We publish loads of data!!• Agriculture, Fisheries and Rural • Business, Enterprise and Energy • Children and Young People • Crime and Justice • Economy • Environment • Health and Community Care • Housing and Regeneration • Labour Market • Lifelong Learning • Local Government Finance • Planning • Population and Migration • School Education • Social and Welfare • Tourism and Culture • Transport and Travel
![Page 3: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/3.jpg)
…but not in easily reusable formats
![Page 4: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/4.jpg)
…spreadsheets with formats & text
![Page 5: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/5.jpg)
PDFs….so let’s find the raw data…
![Page 6: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/6.jpg)
…with difficulty….
Users of Firefox or Chrome may also experience issues with the SCROL Analyser service. These issues can be resolved by switching to another browser.
![Page 7: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/7.jpg)
…but with success in sight…
Download
![Page 8: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/8.jpg)
Reach for BeautifulSoup… it’s HTML
![Page 9: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/9.jpg)
And when I do find CSV …
![Page 10: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/10.jpg)
.. it is interspersed with text
All Persons
Males
Females
![Page 11: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/11.jpg)
It is not all this bad ….
![Page 12: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/12.jpg)
It is not all this bad ….XML & CSV download of all the data
http://www.sns.gov.uk
![Page 13: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/13.jpg)
… even Linked Data!!
http://cofog01.data.scotland.gov.uk/datasets
![Page 14: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/14.jpg)
We are dedicated to publishing data…
So:
• Given that there is no magic wand,
• what are the most effective things we can do to make the data more re-usable?
![Page 15: Scottish Government Data How can we make it really useful? Peter Winstanley LHD-12 Boston, MA. 2012-11-12](https://reader035.vdocuments.mx/reader035/viewer/2022062716/56649ddc5503460f94ad35e6/html5/thumbnails/15.jpg)
Thoughts …
• Do we…..
• Publish terminologies (data dictionaries)?
• Publish URI sets for ‘things’ -- real-world things and concepts?
• Focus on a few datasets and make them perfect? [what is perfect?]