![SPARQL protocol GET /query/flybase?query=[URL encoded query] HTTP/1.1 Host: openflydata.org Accept: application/sparql-results+json POST /query/flybase HTTP/1.1 Host: openflydata.org Accept: application/sparql-results+json Content-Type: application/x-www-form-urlencoded Content-Length: 456 query=[URL encoded query] HTTP GET HTTP POST](https://image.slidesharecdn.com/20090807lodgmod-100119122416-phpapp01/85/2009-0807-Lod-Gmod-7-320.jpg)
![OpenFlyData.org demonstration Three gene express cross-database search applications Search by gene, gene expression mashup: [ go ]](https://image.slidesharecdn.com/20090807lodgmod-100119122416-phpapp01/85/2009-0807-Lod-Gmod-19-320.jpg)
![Search gene expression by gene batch [ go ]](https://image.slidesharecdn.com/20090807lodgmod-100119122416-phpapp01/85/2009-0807-Lod-Gmod-20-320.jpg)
![Search gene expression by tissue expression profile [ go ]](https://image.slidesharecdn.com/20090807lodgmod-100119122416-phpapp01/85/2009-0807-Lod-Gmod-21-320.jpg)
2009 0807 Lod Gmod
- 1. Open Genomic Data Web Dr Jun Zhao Image Bioinformatics Research Group Department of Zoology University of Oxford 6 August 2009 GMOD Meeting Europe
- 2. Web of Data: “ may more accurately be described as a web of things in the world, described by data on the Web.”
- 3. Linked Data Design Issues
- 4. Resource Description Framework (RDF) rdf:type chado:pub fbgn:FBgn11367 so:Gene fbgn:FBgn11367 pubmed:PMID12
- 5. Resource Description Framework (RDF) rdf:type chado:pub fbgn:FBgn11367 so:Gene
- 6. SPARQL queries PREFIX chado: <http://purl.org/net/chado/schema> PREFIX rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#> PREFIX xs: <http://www.w3.org/2001/XML_Schema#> SELECT ?flybaseID WHERE { ?feature rdf:type chado:Feature ; chado:name “schuy”^^xs:string ; chado:uniquename ?flybaseID . } SELECT ?feature.uniquename AS flybaseID FROM feature WHERE feature.name = “schuy” SPARQL SQL
- 7. SPARQL protocol GET /query/flybase?query=[URL encoded query] HTTP/1.1 Host: openflydata.org Accept: application/sparql-results+json POST /query/flybase HTTP/1.1 Host: openflydata.org Accept: application/sparql-results+json Content-Type: application/x-www-form-urlencoded Content-Length: 456 query=[URL encoded query] HTTP GET HTTP POST
- 10. Two Exemplar Applications OpenFlyData.org
- 11. Connect TCM with Western Medicine
- 12. OpenFlyData: mRNA gene expression study Microarray analysis How much of a given transcript (mRNA) is present in a sample
- 13. In a quantitative way
- 14. Lack of spatial information RNA in situ hybridization Reveal both spatial and temporal aspects of gene expression during the development
- 16. Barriers for accessing these data Data are scattered at different web sites
- 17. Searches have to be repeated, different search interfaces, different use of terminology
- 18. Limited (if any) programmatic access to data … hard work to answer questions that span data sources
- 19. OpenFlyData.org demonstration Three gene express cross-database search applications Search by gene, gene expression mashup: [ go ]
- 20. Search gene expression by gene batch [ go ]
- 21. Search gene expression by tissue expression profile [ go ]
- 22. System architecture SPARQL endpoint Web browser FlyUI application FlyUI widget HTTP Client side SPARQL server (SPARQLite, Tomcat, Apache) RDF cache (Jena TDB) FlyBase BDGP FlyTED FlyAtlas AffyMetrix Server side
- 23. Creating RDF from data sources D2RQ mapping FlyBase and BDGP, native relational databases
- 24. Conservative mapping, with minimum interpretation OAI2SPARQL Harvesting N3 RDF metadata via the OAI-PMH protocol, built-in support by Eprints
- 25. Further from ESWC2008 paper Custom Python program FlyAtlas
- 26. Generating N3 from spreadsheet table
- 27. Performance Loading: Our datasets ~175 million triples Jena / TDB gives much better load performance (~15-30K tps), on 64 bit system with Amazon EBS storage (~3hrs) Querying: Good enough for real time user interaction, e.g., <1s for single gene search, 1-4s for multigene search (unions)
- 28. No significant slowdown when scale from 10m to 175m triples Text matching and case insensitive search Problems with using SPARQL regex filter, the only mechanism for case-insensitive search in SPARQL
- 29. Pre-generated lower-case gene names and loaded into the FlyBase RDF DB
- 30. Tried with OpenLink Virtuoso, still ~10 seconds for a case-insensitive search
- 31. Connect the knowledge about alternative medicine and western drugs
- 32. Demonstrate the value of Linked Data
- 33. Demonstrate a novel technique for creating interlinks between datasets on a large scale
- 34. A joint effort of the BioRDF and LODD (Linked Open Drug Data) task forces of the World Wide Web Consortium (W3C) Health Care Life Science Interest Group TCM-LODD: Background
- 36. Search for herbs associated with a particular disease … [ go ] Demo
- 38. Benefits of SW technologies RDF provides a uniform and flexible data model RDF dump is cheaper and quicker
- 39. Maintaining a separate SPARQL endpoint for each data source makes it easier than a data warehouse approach for handling data updates RDF facilitates data re-use and re-purposing
- 40. SPARQL raises the point of departure for an application Expressive, open-ended query protocol
- 41. Support for unanticipated queries
- 42. Costs & Risks Mapping data to RDF requires expertise and experience
- 43. Expressive query protocol is a double-edged sword
- 44. Performance is good for some queries, not for others…
- 46. About Linked Data http://linkeddata.org/
- 47. http://esw.w3.org/topic/SweoIG/TaskForces/CommunityProjects/LinkingOpenData About the projects http://www.flyweb.info
- 49. Acknowledgements Alistair Miles, Graham Klyne and David Shotton
- 50. Anja Jentzsch, Matthias Samwald, Kei-Hoi Cheung and others from W3C HCLSIG
- 51. Dr Helen White-Cooper and her research group
- 52. BBSRC for funding building the FlyTED database
- 53. BDGP, FlyAtlas and FlyBase for making the data available
- 54. JISC, for funding the FlyWeb project
- 55. The Jena team, esp. Andy Seaborne
- 57. Thank you! jun.zhao @ zoo.ox.ac.uk
Editor's Notes
- #14: Note that the thumbnail images are retrieved from the original web sites
- #15: FlyUI: a library of Javascript widgets as front ends to SPARQL data sources Built on Yahoo User Interface (YUI) library Widgets are composed in a browser to create the complete application Each widget provides: A Service that implements SPARQL queries A Model encapsulating SPARQL query results A Renderer
- #16: Initially hoped to use D2R server's SPARQL query rewriting, but some queries would kill the server, so went for SPARQLite alternative Different techniques for generating RDF applied to different kinds of data source Resulting RDF is loaded into the Jena TDB triple store.
- #21: Alzheimer’s herbs with side effects. Red: Alzheimer’s herbs. Blue: drugs with no side effects reported. Purple: drugswith reported side effects.