Swib12 workshop lod_beginners
2 likes556 views
This presentation discusses catalog enrichment using Linked Open Data. It begins with defining catalog enrichment as any addendum to catalog records, such as links to full texts or subjects. It then discusses techniques for enrichment including matching catalog records to external data sources and linking the records. The presentation demonstrates an implementation of catalog enrichment by linking records to data sets like DBpedia, Project Gutenberg and Open Library. It concludes that while catalog enrichment is possible without Linked Open Data, using LOD makes the process easier.
Swib12 workshop lod_beginners
- 1. Pascal Christoph Catalog enrichment à la Linked Open Data SWIB12, Cologne, 2012-12-26 Workshop: Introduction to Linked Open Data
- 2. License 2 This presentation – inclusive the graphics made by the author, are licensed CC0: https://creativecommons.org/about/cc0 Pictures from http://www.istockphoto.com/ at slides 5, 7, 8 and 41 are licensed CC-BY-ND: http://creativecommons.org/licenses/by-nd/3.0/de/ Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod- cloud.net/ Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 3. Overview 3 Catalog enrichment Definition Technique Matching Linking Implementation demo Conclusion Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 4. Overview 4 Catalog enrichment Definition Technique Matching Linking Implementation demo Conclusion Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 6. Catalog enrichment: definition 6 Any addendum to the records: linksto fulltexts/webpages/... subjects, tags, recensions covers ... The source of the addendum does not matter (users, libraries, companies...) New features: only indirect Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 9. Overview 9 Catalog enrichment Definition Technique Matching Linking Implementation demo Conclusion Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 10. Catalog enrichment: methods 10 Sourtce of the pictures :http://findicons.com/about database vs. mashup Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 11. methods 11 locale DB: dynamic mashup: + elaborated combination of the + data always up-to-date data + relatively easy to integrate the data + data can be used to search and browse and other features - needs (performant) API - continously high effort to - no search etc. integrate the data Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 12. infrastructure 12 RDF based storing with SPARQL endpoint: Easy to add data Open to be used by customer Self-describing data SPARQL is a (too?) powerful API Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26
- 13. Overview 13 Catalog enrichment Definition Technique Matching Linking Implementation demo Conclusion Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 14. 14 Source of the picture: http://www.flickr.com/photos/jhsum-commons/4419490136/
- 15. lobid.org 15 triple store with SPARQL Endpoint: 4store open data from the hbz union catalog 16 M records <=> 1 B Triple links to: • 5.500 Projekt Gutenberg • 1.250.000 Open Library • 12.000 DBpedia • 700.000 ZDB • 70.000 b3kat • 800.000 LOC Iso-639-2 • 200.000 Dewey Decimal Class. • 22.000.000 gnd authority file • 270.000 DNB Nationalbiografie • 32.000.000 lobid-organisations • 420.000 OCLC Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 16. Software 16 Silk Culturegraph Google-refine Hadoop ... Christoph - Catalog-enrichment à à la Linkedmit LOD Jansen / Christoph KataloganreicherungOpen Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 17. Matching algorithms 17 depending on the data Interestingdata reside „elsewhere“ => other cataloging rules DBpedia example: Creator, ISBN etc. are often missing => only title constraints: german DBpedia category:Literarisches_Werk , category:Lexikon,_Enzyklopädie Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 18. Problem: disambiguation 18 matching is to blurry Post processing: Allow only bundle with same creator Christoph - Catalog-enrichment à à la Linkedmit LOD Jansen / Christoph KataloganreicherungOpen Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 19. Bundle having the same creator 19 Christoph - Catalog-enrichment à à la Linkedmit LOD Jansen / Christoph KataloganreicherungOpen Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 20. Bundle having different creators 20 Christoph - Catalog-enrichment à à la Linkedmit LOD Jansen / Christoph KataloganreicherungOpen Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 21. LOW-HANGING FRUIT Kai Schreiber, „Reiche Ernte” 7. August 2005 via Flickr CC BY-SA 2.0
- 22. Overview 22 Catalog enrichment Definition Technique Matching Linking Implementation demo Conclusion Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 23. triplification 23 Find predicates or mint them yourself rdrel:workManifested => Triple: <lobid-resource> <rdrel:workManifested> <dbpedia-resource> Christoph - Catalog-enrichment à à la Linkedmit LOD Jansen / Christoph KataloganreicherungOpen Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 24. indexing 24 What is the license ? Import triples into the SPARQL-Endpoint own „named graph“ has advantages: Easilyremovable/changeable Provenience is stored Query specific named graphs Christoph - Catalog-enrichment à à la Linkedmit LOD Jansen / Christoph KataloganreicherungOpen Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 25. Named Graphs 25 Christoph - Catalog-enrichment à à la Linkedmit LOD Jansen / Christoph KataloganreicherungOpen Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 26. What we achieved 26 12.000 „sure“ links to 4.000 DBpedia resources => 4.000 new „Work“-levels (21.000 discared links) average size of a bundle: 3 links to freebase: 3.000 0.1 % enrichment Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 27. What we achieved 27 5.500 links zu 400 Project Gutenberg ressources (fulltexts in differnet formats) => 0.05% enrichment 1.200.000 links to the work level of the Open Library => 12.5% enrichment Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 28. What we achieved 28 Sir Tim Berners Lee: Source of picture: http://www.w3.org/DesignIssues/LinkedData.html Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 2012-12-26 2012-09-27
- 29. LOW-HANGING FRUIT Kai Schreiber, „Reiche Ernte” 7. August 2005 via Flickr CC BY-SA 2.0
- 30. What we achieved 30 DBpedia example: „Die Heilige Johanna der Schlachthöfe“ Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 34. What we achieved 34 Open Library example: „With reference to reference“ Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 36. Linking Example: LODUM 36 Christoph - Catalog enrichment à à la Linked Open Data Kataloganreicherung la Linked Open Data 24.05.2012 2012-12-26 2012-09-27
- 37. Integration into the catalog 37 What is allowed ? What should be integrated, what not? Human readable presentation of the links/URIs (some) data should be indexed locally (e. g. to be able to search) ... Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 38. Overview 38 Catalog enrichment Definition Technique Matching Linking Implementation demo Conclusion Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 39. Implementation demo 39 Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 40. Implementation demo 40 Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 41. Overview 41 Catalog enrichment Definition Technique Matching Linking Implementation demo Conclusion Christoph - Catalog enrichment à la Linked Open Data 2012-12-26
- 43. 43 Bildquelle: http://www.flickr.com/photos/library_of_congress/4037490394/
- 44. conclusion 44 Everything that's possible with LOD could also be achieved without LOD. It's just easier with LOD. Christoph - Kataloganreicherung à la Linkedmit LOD Jansen / Christoph -enrichment à la Linked Open Data Catalog Kataloganreicherung Open Data 24.05.2012 2012-09-27 2012-12-26
- 45. LOD - Definition „linked“ 45 Ad astra ? Addata ! ? Ad astra Ad data ! To boldly go where no data has gone before. To boldly go where no data has gone before . Source of the picture:http://hubblesite.org/gallery/album/star/pr2006050d Christoph - Kataloganreicherung à la Linked Open Data 2012-09-27
- 46. Open source 46 http://sourceforge.net/projects/culturegraph/ http://4store.org/ https://github.com/lobid/ Silk https://www.assembla.com/spaces/silk Christoph - Catalog enrichment à la Linked Open Data
- 47. 47 Thank you ! Pascal Christoph christoph@hbz-nrw.de semweb@hbz-nrw.de
- 48. 48 list of references - KiM: Empfehlungen zur Öffnung bibliothekarischer Daten https://wiki.d-nb.de/pages/viewpage.action?pageId=45419980 - Till Kreutzer (2010): Open Data – Freigabe von Daten aus Bibliothekskatalogen http://www.hbz-nrw.de/dokumentencenter/veroeffentlichungen/open-data-leitfaden.pdf - Adrian Pohl (2010): Open Data im hbz-Verbund. Erschienen in: ProLibris. 3. Preprint: http://www.hbz-nrw.de/dokumentencenter/produkte/lod/aktuell/pohl_2010_open-data.pdf - Tim Berners Lee's talk of Open Data (2010): http://www.youtube.com/watch?v=3YcZ3Zqk0a8 - Jansen / Christoph: Dynamische Kataloganreicherung auf Basis von Linked Open Data http://de.slideshare.net/h_jansen/dynamische-kataloganreicherung-auf-basis-von-linked-open-data - Blog post: First results using SILK to link to DBpedia https://wiki1.hbz-nrw.de/display/SEM/2012/05/03/First+results+using+SILK+to+link+to+DBpedia - Blog post: 1.2 M links to Open Library https://wiki1.hbz-nrw.de/display/SEM/2012/05/23/1.2+M+links+to+Open+Library - Oliver Flimm (2010): LOD und die Open Library http://de.slideshare.net/flimm/lod-openlibrary20100512 - Directory of data „thedatahub“ aka CKAN: http://www.thedatahub.org/ - 49 bibliographic data sources as LODhttp://thedatahub.org/group/bibliographic?tags=lod