LOD2 Webinar Series: 3rd relase of the Stack
Download as PPTX, PDF3 likes3,938 views
The LOD2 project, co-funded by the European Commission, focuses on integrating linked open data technologies across 12 countries to enhance applications in media, corporate data, and eGovernment. The third release of the LOD2 stack introduced 47 components and provided tools for managing and publishing linked data. The project also includes a series of webinars to educate users on linked data lifecycle tools and foster knowledge sharing among researchers and developers.
LOD2 Webinar Series: 3rd relase of the Stack
- 1. Creating Knowledge out of Interlinked Data EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 1 http://lod2.eu
- 2. Creating Knowledge out of Interlinked Data LOD2 is a large-scale integrating project co-funded by the European Commission within the FP7 Information and Communication Technologies Work Programme. This 4-year project comprises leading Linked Open Data technology researchers, companies, and service providers. Coming from across 12 countries the partners are coordinated by the Agile Knowledge Engineering and Semantic Web Research Group at the University of Leipzig, Germany. LOD2 will integrate and syndicate Linked Data with existing large-scale applications. The project shows the benefits in the scenarios of Media and Publishing, Corporate Data intranets and eGovernment. EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 2 http://lod2.eu http://lod2.eu
- 3. Creating Knowledge out of Interlinked Data Once per month the LOD2 webinar series offer a free webinar about tools and services along the Linked Open Data Life Cycle. Stay with us and learn more about acquisition, editing, composing, connected applications – and finally publishing Linked Open Data. EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 3 http://lod2.eu http://lod2.eu
- 4. Creating Knowledge out of Interlinked Data Third release of LOD2 Stack Presented by Bert Van Nuffelen & Karel Kremer, TenForce EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 4 http://lod2.eu http://lod2.eu
- 5. Creating Knowledge out of Interlinked Data Presentation Overview A. LOD2 Stack Release 3.0 overview B. Connecting the dots: Workbench for Statistical Office EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 5 http://lod2.eu
- 6. Creating Knowledge out of Interlinked Data LOD2 STACK RELEASE 3.0 EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 6 http://lod2.eu
- 7. Creating Knowledge out of Interlinked Data LOD2 stack progress Release 1: 25 components/Packages Release 2: 37 components/Packages Release 3: 47 components in LOD2 stack release 3 • 10 new components/Packages • Of which 44 are available as a Debian package • Of which 24 are available through a graphical user interface in the demonstrator and/or the statistical workbench EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 7 http://lod2.eu
- 8. Creating Knowledge out of Interlinked Data LOD2 Stack 3.0 Silk Limes OntoWiki RDFAuthor LOD2 Authentication WebID Component SIREn rdf-dataset-integration Virtuoso 7 RDF Store (conductor, sparql, isparql, ods) PoolParty Dbpedia (source) CKAN (source) Sparqlify Interlinking/ Fusing Manual revision/ authoring Sieve dl-learner Classification/ Enrichment LOD2 Provenance Component SPARQLed lodms sparqlproxy Storage/ Querying Virtuoso 6.1.x RDF Store (conductor, sparql, isparql, ods) ORE LOD2 stat. Workbench Virtuoso sponger PoolParty Extractor Data Cube Validation Tool Quality Analysis LOD2 demonstrator Mondeca Sparql Endpoint Status CSVImport Silk-latc Data Cube Merging Tool Evolution / Repair Extraction LOD-refine Dbpedia Spotlight UI stanbol R2R D2R Search/ Browsing/ Exploration Dbpedia Spotlight valiant Semantic Spatial Browser SigmaEE lod2webapi EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 8 CubeViz Sindice (source) Data Cube Slicing Tool Facete http://lod2.eu
- 9. Creating Knowledge out of Interlinked Data Virtuoso 7 Universal Server (1/10) • A Column store implementation • Queries up to three times as fast as latest major version • Many other improvements Interlinking/ Fusing Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on e.g. to load times and parallellization • Benchmarking: BSBM results: http://wifo5-03.informatik.uni-mannheim.de/bizer/berlinsparqlbenchmark/results/V7/ http://virtuoso.openlinksw.com/ EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 9 http://lod2.eu
- 10. Creating Knowledge out of Interlinked Data Rdf dataset integration (2/10) • Easy integration of RDF datasets as dependencies for debian packages • Allows packages to provide example data in an easy way Interlinking/ Fusing Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on RDF dataset https://github.com/AKSW/rdf-dataset-integration EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 10 http://lod2.eu
- 11. Creating Knowledge out of Interlinked Data Sparqlify (3/10) Interlinking/ Fusing • Scalable SPARQL-SQL rewriter, Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying • Query an SQL database as if it were a RDF store. Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on { SPARQL } { SQL } Sparqlify Relational Database http://aksw.org/Projects/Sparqlify.html EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 11 http://lod2.eu
- 12. Creating Knowledge out of Interlinked Data SIREn (4/10) Interlinking/ Fusing • Semantic Information Retrieval Engine Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying • Lucene/SOLR extension Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on • Transformation of RDF graphs into trees to allow very efficient querying and search http://siren.sindice.com/ EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 12 http://lod2.eu
- 13. Creating Knowledge out of Interlinked Data R2R Framework (5/10) • RDF vocabulary mapping framework Interlinking/ Fusing Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying • Defines mapping language from one vocabulary to another Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on • Automatic Execution of mapping rules http://wifo5-03.informatik.uni-mannheim.de/bizer/r2r/ EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 13 http://lod2.eu
- 14. Creating Knowledge out of Interlinked Data DBpedia Spotlight UI (6/10) • Lightweight Frontend for remote DBpedia Spotlight Instance • User interface to extract Dbpedia Entities from text Interlinking/ Fusing Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on https://github.com/AKSW/dbpedia-spotlight-ui EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 14 http://lod2.eu
- 15. Creating Knowledge out of Interlinked Data LOD Manager Suite (7/10) Interlinking/ Fusing • quickly set up pipelines for transforming linked data Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying • many extensions Quality Analysis Extractio n • Extract RDF from other types of data. Evolution / Repair Search/ Browsing / Explorati on http://www.semantic-web.at/linked-open-data-management-suite-lodms EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 15 http://lod2.eu
- 16. Creating Knowledge out of Interlinked Data Facete (8/10) • Generic Facetted Browser for RDF data • Supports any remote SPARQL endpoint • Automatically visualize RDF on a map • Permalink functionality for sharing Interlinking/ Fusing Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on http://aksw.org/Projects/Facete.html EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 16 http://lod2.eu
- 17. Creating Knowledge out of Interlinked Data CubeViz (9/10) • Facetted Browser for Data Cube Vocabulary Interlinking/ Fusing Classification/ Enrichme nt Manual revision/ authoring Storage/ Querying Quality Analysis • Many different visualizations available Extractio n • Supports more advanced features like slices Evolution / Repair Search/ Browsing / Explorati on • Support for RDF export and Permalinks http://aksw.org/Projects/CubeViz.html EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 17 http://lod2.eu
- 18. Creating Knowledge out of Interlinked Data CSV Import (10/10) Interlinking/ Fusing Classification/ Enrichme nt Manual revision/ authoring • Transforms CSV files to RDF Storage/ Querying • Supports transformation to Data Cubes Quality Analysis Extractio n Evolution / Repair Search/ Browsing / Explorati on • Template reuse supported http://aksw.org/Projects/CSVImport.html EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 18 http://lod2.eu
- 19. Creating Knowledge out of Interlinked Data Demonstrating interaction between components • LOD2 demonstrator: ‘intelligent bookmark service’ for stack http://demo.lod2.eu/lod2demo • LOD2 statistical office workbench: deeper integration in the context of statistical data http://demo.lod2.eu/lod2statworkbench EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 19 http://lod2.eu
- 20. Creating Knowledge out of Interlinked Data LOD2 Authentication – Authorization – Provenance layer • WebID for user profile and security in Statistical Workbench • Authorization control to (Dis)Allow access to a section (URL) in the workbench Provide role based views inside a section (URL) in the workbench (for native functionality in the workbench) • Provenance information can be collected based on profile EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 20 http://lod2.eu
- 21. Creating Knowledge out of Interlinked Data More info: Stack.lod2.eu EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 21 http://lod2.eu
- 22. Creating Knowledge out of Interlinked Data Updating the stack to version 3 • Release 3 requires a Ubuntu 12.04LTS 64bit machine • A simple apt-get upgrade will be enough, BUT • New version of the stack uses the Virtuoso Open Source edition, version 7 • Conflicts with old Virtuoso Open Source 6 package • The package manager will guide you through the transition process • But best ensure you have a backup of the contents of the database. • Instructions on migrating your database: http://wiki.lod2.eu/display/LOD2DOC/Upgrading+an+installation+to+the+latest+releas e EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 22 http://lod2.eu
- 23. Creating Knowledge out of Interlinked Data More information … Stack.lod2.eu and Wiki.lod2.eu • How to start & How to contribute • Overview of the individual api documentations • Tutorial section • Contact point: support@lod2.eu Public demo • http://demo.lod2.eu/lod2demo • http://demo.lod2.eu/lod2statworkbench LOD2 Webinars series • http://lod2.eu/BlogPost/webinar-series • View them on youtube EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 23 http://lod2.eu
- 24. Creating Knowledge out of Interlinked Data Further improvements Component improvements regular component updates e.g. bugfixes Virtuoso 7 New components Facete: a client side faceted browser for linked data having geospatial coordinates. …But we want to learn from you! Usage experience Challenges encountered Mail us at: EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 24 http://lod2.eu
- 25. Creating Knowledge out of Interlinked Data Ensuring the continuity: LinkedData.org In 2014, the stack moves to a project neutral space • http://stack.linkeddata.org/ Repository for java artifacts for linked data • http://mvn.linkeddata.org/ A collaboration with the GeoKnow project EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 25 http://lod2.eu
- 26. Creating Knowledge out of Interlinked Data LOD2 STATISTICAL OFFICE WORKBENCH The work on the statistical Office Workbench is a the result of a cooperation between the partners IMP, ULEI and TenForce. EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 26 http://lod2.eu
- 27. Creating Knowledge out of Interlinked Data Motivation of the work Data, knowledge and research interest available: • Publink with DG Infso for the Digital Agenda Scoreboard (2011) • Publink with Serbian National Statistical Office (2011-2012) & use case described in D.6.4.1. • Publicdata.eu & Deliverable D9.4.1 : assessment of government data shows that statistical data is freely available in large quantities. (2012) • LATC project: transformation or Eurostat data into RDF (2012) • Creation of Cubeviz application (2012-2013) But: • No tool support for creation data cubes in RDF • No tool support for managing data cubes • No tool support for merging & splitting data cubes And selecting a domain allows to explore the integration of components better. EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 27 http://lod2.eu
- 28. Creating Knowledge out of Interlinked Data Statistical Office Use case Investment service company advanced analysis 2 automatic publishing define standards Data Analyst automatic harvesting automatic publishing 1. Public sector needs an infrastructure to publish into and curate information from the LOD cloud publish data administration 2. Support for consumption of this data CSO IT Administrator EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 28 1 Statistician http://lod2.eu
- 29. Creating Knowledge out of Interlinked Data Statistical Office Workbench – GUI EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 29 http://lod2.eu
- 30. Creating Knowledge out of Interlinked Data Functionalities • efficient transformation / conversion of traditional data stores (e.g. CSV, XML, relational databases) into linked, machine readable formats • building and querying RDF Data Cube stores • validating RDF Data Cube stores • interlinking (e.g. code lists) and adding meaning to data • visualization and exploration of multi-dimensional RDF data cubes • publishing RDF Data Cube to CKAN EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 30 http://lod2.eu
- 31. Creating Knowledge out of Interlinked Data Karel Kremer DEMO STATISTICAL OFFICE WORKBENCH EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 31 http://lod2.eu
- 32. Creating Knowledge out of Interlinked Data Demo LOD Lifecycle coverage Interlinking/ Fusing Manual revision/ authoring Classification/ Enrichment Quality Analysis Storage/ Querying Evolution / Repair Extraction Search/ Browsing/ Exploration EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 32 http://lod2.eu
- 33. Creating Knowledge out of Interlinked Data Introducing the Data * Data Modified slightly to improve demo clarity EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 33 http://lod2.eu
- 34. Creating Knowledge out of Interlinked Data Data Cube Vocabulary • Data cube according to W3C: http://www.w3.org/TR/vocab-data-cube/ ns1:slice ns1:slice ns1:slice ns1:slice rdf:type qb:Slice . rdfs:label "only Europe region slice" . qb:sliceStructure local:onlyEurope . cube:Location cube:r1-c1 ; qb:observation cube:c1-r14 , cube:c1- r15, cube:c1-r9 , cube:c1-r10 , cube:c1-r11 , cube:c1-r12 , cube:c1-r13 , cube:c1-r4 , cube:c1-r5 , cube:c1-r6 , cube:c1-r7 , cube:c1-r8 cube:c1-r3 rdf:type qb:Observation ; , cube:Location cube:r1-c1 ; cube:c1-r3 . cube:Disease cube:r3-c0 ; cube:m " 7 782" ; qb:dataSet cube:ds . EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 34 http://lod2.eu
- 35. Creating Knowledge out of Interlinked Data Merging Data Cubes Disease Region EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 35 http://lod2.eu
- 36. Creating Knowledge out of Interlinked Data Scenario CSV Import Link Merge Data Cube & reconcile Statistical Office Workbench Triple Store EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 36 http://lod2.eu
- 37. Creating Knowledge out of Interlinked Data Scenario Code Lists Context CSV CSV CKAN RDF CSV Import Merge RDF Data Cube RDF Link RDF & reconcile Statistical Office Workbench Triple Store EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 37 http://lod2.eu
- 38. Creating Knowledge out of Interlinked Data Scenario Code Lists Context CSV CSV CKAN RDF CSV Import Merge RDF Data Cube RDF Link RDF & reconcile Statistical Office Workbench Triple Store EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 38 http://lod2.eu
- 39. Creating Knowledge out of Interlinked Data Introducing the Data * Data Modified slightly to improve demo clarity EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 39 http://lod2.eu
- 40. Creating Knowledge out of Interlinked Data { DEMO } EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 40 http://lod2.eu
- 41. Creating Knowledge out of Interlinked Data Try It Yourself! • Get your own stack: Install LOD2 stack from the Debian repository Or download the pre-configured virtual machine • Follow the tutorials here: http://wiki.lod2.eu/display/LOD2DOC/LOD2+Statistical+Workbench • This and much more on: http://stack.lod2.eu EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 41 http://lod2.eu
- 42. Creating Knowledge out of Interlinked Data Credits Jingle Coordination R.E.M., Martin Kaltenböck, Florian Kondert Thomas Thurner Martin Kaltenböck Moderation Martin Kaltenböck Presented by Bert Van Nuffelen & Karel Kremer EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 42 http://lod2.eu
- 43. Creating Knowledge out of Interlinked Data QUESTIONS? Don’t forget: all info to be found at http://stack.lod2.eu ! EU-FP7 LOD2 STACK v.3 Webinar 23-10-2013. Page 43 http://lod2.eu
- 44. Creating Knowledge out of Interlinked Data Hope you enjoyed staying with us – if you need more detailed information, visit us at www.lod2.eu and let us know how we can improve to meet your expectations! Don’t forget to register for our next webinar 28.11.2013 – ORE + DLearner (by ULEI) December 2013 – NIF (by ULEI) Have a great day and don’t forget http://stack.lod2.eu EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 44 http://lod2.eu http://lod2.eu
- 45. Creating Knowledge out of Interlinked Data EU-FP7 LOD2 WP6 – 12.-13.9.2013. Page 45 http://lod2.eu http://lod2.eu
Editor's Notes
- #34: this is an artificial situation, but it simulates the most frequent situation that you will have in real life!
- #36: Of course, not only languages, also other context, like give me a definition of the disease, the symptom
- #40: this is an artificial situation, but it simulates the most frequent situation that you will have in real life!