ECCS 2010
Download as PPT, PDF2 likes515 views
The document discusses analyzing the Web of Data (WoD) as a complex network at multiple scales. At the graph scale, the WoD contains over 100 nodes (datasets) connected by 350 edges. At the triple scale, a network of over 600,000 nodes and 800,000 edges was analyzed. Network analysis found the WoD exhibits properties like short average path lengths, power law degree distributions, and a few highly central nodes like DBpedia. Ongoing challenges include implicit links, multi-relations, and dynamics as data is continuously added.
ECCS 2010
- 1. The Web of Data as a Complex System - First insight into its multi-scale network properties Christophe Guéret, Shenghui Wang , and Stefan Schlobach Department of Computer Science, Network Institute Vrije Universiteit Amsterdam
- 2. Outline What is the Web of Data? How complex is the Web of Data? A new way of seeing the Web of Data What have we found? What are the challenges?
- 3. What is the Web of Data? The Semantic Web is a web of data -- http://www.w3.org/2001/sw/ Linked Data is a sub-topic of the Semantic Web . The term Linked Data is used to describe a method of exposing, sharing, and connecting data via dereferenceable URIs on the Web . -- http://en.wikipedia.org/wiki/Linked_Data Linked Data is about using the Web to connect related data that wasn't previously linked, or using the Web to lower the barriers to linking data currently linked using other methods. -- http://linkeddata.org/
- 4. Four principles of Linked Data Use URIs to identify things. Use HTTP URIs so that these things can be referred to and looked up (" dereferenced ") by people and user agents . Provide useful information about the thing when its URI is dereferenced, using standard formats such as RDF/XML . Include links to other, related URIs in the exposed data to improve discovery of other related information on the Web. -- Tim Berners-Lee
- 5. http://dbpedia.org/resource/Amsterdam http://dbpedia.org/resource/City http://www.w3.org/1999/02/22-rdf-syntax-ns# type http://umbel.org/umbel/ne/wikipedia/Amsterdam http://www.w3.org/2002/07/owl#sameAs http://www.freebase.com/view/en/abraham_pais http://dbpedia.org/ontology/birthPlace An example of linked data Nodes are shared across statements The links have some meaning
- 6. Since 2006, people are creating linked data
- 7. October 2007
- 8. July 2009
- 9. Evolution of the Web of Data
- 10. The WoD is a complex system! More than 260 extremely heterogeneous datasets general-purposed datasets, such as DBpedia domain-oriented datasets, such as Bio2RDF government data, music data, geological data, social network data, etc. Nearly 50 billion RDF triples Nearly 50 billion links within the datasets More than 800 million links between the datasets Embedded rich semantics in the data data points are typed links are typed links is what makes the statements useful
- 11. Amsterdam The Netherlands isLocatedIn Christophe VU Amsterdam workIn isLocatedIn workIn workIn The links have explicit semantics, which brings implicit links deduced after the reasoning process
- 12. People are trying to use the WoD Billion triple challenges since 2008 "The specific goal of the Billion Triples Track is to demonstrate the scalability of applications as well as to encourage the development of applications that can deal with Web data. We stress that the goal of this is not to be a benchmarking effort between triple stores, but rather to demonstrate applications that can scale to a Web scale using realistic Web-quality data . " http://challenge.semanticweb.org/
- 13. The WoD itself should be robust Is there central hubs whose failure would lead to lack of connectivity? The WoD is designed for automated agents that have less capability to recover from the failure of the connectivity. The robustness of the WoD should be ensured Up till now, the WoD could be studied, searched and maintained like a classical database
- 14. Network analysis A new way of seeing the WoD What network analysis tells us
- 15. A new way of seeing the WoD Consider the WoD as network
- 16. Applying network analysis over the WoD Average path length Degree distribution Strongly connected components Degree centrality Between centrality Closeness centrality
- 17. Scales of observation of the WoD 1. Graphs scale
- 18. Graph-scale WoD network Each dataset is a node Edges are weighted, directed connections between the datasets if there is at least one triple having a subject within dataset 1 and an object within dataset 2, then there is an edge between these two datasets. the number of such triples is the weight of the edge.
- 19. 110 nodes with 350 edges Average path length is 2.16 50 components
- 20. The degree of 7 is critical point after which the network is not scale-free any more.
- 21. Top central nodes Betweenness centrality Closeness centrality Degree centrality Every centrality has a specific meaning... Node Value DBpedia 0.332 DBLP Berlin 0.108 DBLP (RKB) 0.100 DBLP Hannover 0.097 FOAF profiles 0.075 Node Value DBpedia 0.762 Geonames 0.614 Drug Bank 0.576 Linked MDB 0.544 Flickr wrappr 0.526 Node Value DBpedia 0.505 UniProt 0.266 DBLP (RKB) 0.266 ACM (RKB) 0.229 GeneID 0.211
- 22. Scales of observation of the WoD 2. Triple scale
- 23. Triple-scale WoD network We took the 10 million triples from the dataset crawled from the WoD, provided by the billion triple challenge 2009 This "BTC" network is defined as G=(V, (E, L)), where V is a set of nodes, and each node is a URI or a literal E is a set of edges L is a set of labels, each label characterising a relation between nodes We applied a few strategies to aggregate data for comparison.
- 24. Triple-scale network and its aggregations BTC aggregated: triples are aggregated by the domain names BTC aggregated + filter: only domain names shared with the graph-scale network Network Nodes Eges Average path length Components BTC 605K 860K 2.15 602K BTC aggregated 14K 31K 2.80 7K BTC aggregated + filter 37 91 1.88 17
- 25. Degree distribution BTC BTC aggregated Power-law distribution
- 27. The next steps Open challenges Ongoing research activities at VUA
- 28. Challenges: Existence of implicit links “ Semantic virus” Amsterdam The Netherlands isLocatedIn Christophe VU Amsterdam workIn isLocatedIn workIn workIn Asia isLocatedIn
- 29. Challenges: Multi-relations links FOAF (social networks + personal information) SIOC (relations characterising blogs) SWRC (describing research work) … Different filtering produce different networks Centrality status of nodes changes w.r.t the networks Dynamics Data will be continuously added and linked.
- 31. Monitoring and Improving the WoD Linked data is meant to be browsed, jumping from one ressource to another The presence of Hubs is critical for the paths Create alternate paths to be used in case of failure Guéret, Groth, van Harmelen, Schlobach, " Finding the Achilles Heel of the Web of Data: using network analysis for link-recommendation ", ISWC2010 - To appear
- 32. {cgueret, swang, schlobac}@few.vu.nl We need to study more!
Editor's Notes
- #10: All the previous version of the picture are on http://richard.cyganiak.de/2007/10/lod/