irail and opendata
DESCRIPTION
Presentation at the first HackDemocracy meetup in Brussels, December 2010. Presented by @pietercolpaertTRANSCRIPT
![Page 1: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/1.jpg)
iRail and open data@pietercolpaert
Hack democracy
![Page 2: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/2.jpg)
5 minutes
● Scraping● The law● Project problems
![Page 3: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/3.jpg)
Why?
![Page 4: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/4.jpg)
Really no other option?
DON'T wait● For big forms to be filled in● For officials to respond
DON'T talk too much about your ideas
DO
![Page 5: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/5.jpg)
A Lot Of Laws
![Page 6: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/6.jpg)
Different explanations for scraping
● Legal: «show data, differently» (~Browser)● +/-: «already public data»● Illegal: «steal data»
![Page 7: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/7.jpg)
Public transport: iRail
● Second database law● Result of activity = no copyright
● Others don't agree?● iRail vzw/asbl/npo supports you!
![Page 8: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/8.jpg)
But!
Who cares about laws?
![Page 9: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/9.jpg)
Web2.0: If people like it
It's okay!
Just be awesome
![Page 10: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/10.jpg)
Design problems
![Page 11: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/11.jpg)
So much choice!
● Java servlets● PHP● Perl● Python● ...
![Page 12: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/12.jpg)
![Page 13: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/13.jpg)
?
● Limit dirtiness?● How modular?● Reusability?
![Page 14: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/14.jpg)
Help each other!
● API● one time job● Open source
– Everyone helps fixing
● Patch «the» system!
![Page 15: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/15.jpg)
Conclusion
● SCRAPE● When no other possibility
● WORK● Together!
● QUICK & DIRTY● But clean it up
![Page 16: iRail and OpenData](https://reader034.vdocuments.mx/reader034/viewer/2022051411/546b966db4af9f932c8b4c8a/html5/thumbnails/16.jpg)
Q&A
@pietercolpaertProject.iRail.be
Github.com/iRail