iRail at hack democracy
0 likes279 views
This document discusses scraping public transportation data and developing open data projects. It addresses legal issues around scraping, recommends scraping only when necessary and with legal justification. It also discusses design challenges for such projects and encourages collaborating openly and fixing issues together. The overall message is to scrape responsibly when needed, work together as a community, and focus on quick solutions that can be improved over time.
1 of 16
Download to read offline
iRail at hack democracy
- 1. iRail and open data @pietercolpaert Hack democracy
- 2. 5 minutes ● Scraping ● The law ● Project problems
- 3. Why?
- 4. Really no other option? DON'T wait ● For big forms to be filled in ● For officials to respond DON'T talk too much about your ideas DO
- 5. A Lot Of Laws
- 6. Different explanations for scraping ● Legal: «show data, differently» (~Browser) ● +/-: «already public data» ● Illegal: «steal data»
- 7. Public transport: iRail ● Second database law ● Result of activity = no copyright ● Others don't agree? ● iRail vzw/asbl/npo supports you!
- 9. Web2.0: If people like it It's okay! Just be awesome
- 10. Design problems
- 11. So much choice! ● Java servlets ● PHP ● Perl ● Python ● ...
- 13. ? ● Limit dirtiness? ● How modular? ● Reusability?
- 14. Help each other! ● API ● one time job ● Open source – Everyone helps fixing ● Patch «the» system!
- 15. Conclusion ● SCRAPE ● When no other possibility ● WORK ● Together! ● QUICK & DIRTY ● But clean it up