SlideShare a Scribd company logo
Holistic Benchmarking of Big Linked Data
HOBBIT
Irini Fundulaki
Institute of Computer Science - FORTH
Greece
4th Graph-TA
Barcelona, Spain, March 3, 2016
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 1 / 9
Voluminous Datasets
1
1http://www.ibmbigdatahub.com/infographic/four-vs-big-data
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 2 / 9
Large number of Linked Data Technologies
2
2https://cdn.datafloq.com/cms/os_big_data_open_source_tools-v2.png
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 3 / 9
Issues to address for Linked Data Technologies
√
Which are the critical steps of the Linked
Data lifecycle?
√
Which are the current bottlenecks?
√
Which are the available market solutions?
√
Which are the relevant key performance
indicators?
√
What is the performance of existing tools
w.r.t. relevant performance indicators?
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 4 / 9
Holistic Benchmarking of Big Linked Data
(HOBBIT)
HOBBIT focuses on Big Linked Data and intends to cover the
business-critical steps of the Linked Data lifecycle
√
Objectives
Gather real Performance indicators and Performance thresholds from
industry
Develop benchmarks based on real data
Provide universal benchmarking platform on standardized hardware to
provide comparable results
Provide periodic benchmarking challenges and reporting
Found independent Hobbit association
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 5 / 9
HOBBIT Benchmarks
√
Generation and Acquisition: will test the performance of the systems that
implement approaches for extracting RDF data from
semi-structured data streams such as sensor data (smart metering) and
unstructured data streams (Twitter, RSS feeds, etc.)
√
Analysis and Processing
linking benchmark will test the performance of instance matching
methods for Linked Data
analytics benchmark will test the performance of supervised and
unsupervised machine learning methods
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 6 / 9
HOBBIT Benchmarks
√
Storage and Curation
storage benchmark will test the performance storage components and
small storage subsystems
versioning benchmark will examine how versioning systems perform
w.r.t. size of the multi-version repository and the efficiency of
cross-snapshot query answering
√
Visualization and Services: will test the performance of systems regarding
question answering and
faceted browsing.
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 7 / 9
HOBBIT Overview
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 8 / 9
HOBBIT Logistics
√
Horizon 2020, 3 years duration (01/12/2016–30/11/2018)
√
Coordinator: Dr. Axel-Cyrille Ngonga-Ngomo, Institute of Applied
Informatics, Germany
√
Partners:
Institute for applied informatics (InfAI), Germany
Fraunhofer IAIS, Germany
Foundation for Research and Technology (FORTH), Greece
National Center for Scientific Research "Demokritos" (NCSR), Greece
iMinds, Belgium
USU Software AG, Germany
ONTOS AG, Switzerland
OpenLink, UK
AGT Group R&D GMBH, Germany
TomTom, Poland
Irini Fundulaki (FORTH) HOBBIT March 3, 2016 9 / 9
HOBBIT @ Graph-TA

More Related Content

PDF
Are we data responsible?
PDF
Presentation of HOBBIT's versioning benchmark at Graph-TA
PDF
Holistic Benchmarking of Big Linked Data: HOBBIT
PDF
Benchmarking Versioning for Big Linked Data
PDF
TranSMART Roadmap Presentation Amsterdam 2015
PDF
rOpenGov: an R ecosystem for open government data and computational social sc...
PPT
A gentle introduction to riese
DOCX
Journal of machine learning research- steps and impact of pharmaceutical care...
Are we data responsible?
Presentation of HOBBIT's versioning benchmark at Graph-TA
Holistic Benchmarking of Big Linked Data: HOBBIT
Benchmarking Versioning for Big Linked Data
TranSMART Roadmap Presentation Amsterdam 2015
rOpenGov: an R ecosystem for open government data and computational social sc...
A gentle introduction to riese
Journal of machine learning research- steps and impact of pharmaceutical care...

What's hot (20)

PDF
FIWARE Global Summit - Implementing the European Data Economy with FIWARE Tec...
PDF
Open Data standards day - IODC 16 - Simple open data practices by euroalert
PDF
The Hyve introduction TranSMART Annual Meeting 2015 Amsterdam
PDF
PDF
PDF
Intact danish workshop_20171001
PPTX
eROSA Stakeholder WS1: Challenges in making data FAIR – An Agronomic and Envi...
PDF
OpenDataMonitor Overview
PDF
Data Journalism - Cleaning Data
PDF
MOCHA 2018 Challenge @ ESWC2018
PPTX
SureCHEMBL Open Patent Data Seaching with chemical stracture
PDF
Rajendra Akerkar - LeMO Project
PDF
Using date in collaboration: Experiences from the Maine Shared Collections St...
DOCX
Journal of machine learning reserach m. luisetto, b. nili an open letter to a...
PPTX
Metadata in Local Government
PDF
Communicating Use and Reuse in the Digital Collection Interface by L. Kelly F...
PDF
Query reverse engineering in the context of the semantic web
PDF
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
PPT
UKSG webinar: The Law on TDM in Europe: an introduction with Nancy Pontika, O...
PDF
inkedARC.net: Accessing the Benefits of Open Data Practice within Archaeology
FIWARE Global Summit - Implementing the European Data Economy with FIWARE Tec...
Open Data standards day - IODC 16 - Simple open data practices by euroalert
The Hyve introduction TranSMART Annual Meeting 2015 Amsterdam
Intact danish workshop_20171001
eROSA Stakeholder WS1: Challenges in making data FAIR – An Agronomic and Envi...
OpenDataMonitor Overview
Data Journalism - Cleaning Data
MOCHA 2018 Challenge @ ESWC2018
SureCHEMBL Open Patent Data Seaching with chemical stracture
Rajendra Akerkar - LeMO Project
Using date in collaboration: Experiences from the Maine Shared Collections St...
Journal of machine learning reserach m. luisetto, b. nili an open letter to a...
Metadata in Local Government
Communicating Use and Reuse in the Digital Collection Interface by L. Kelly F...
Query reverse engineering in the context of the semantic web
Big Data Europe: SC6 Workshop 3: The European Research Data Landscape: Opport...
UKSG webinar: The Law on TDM in Europe: an introduction with Nancy Pontika, O...
inkedARC.net: Accessing the Benefits of Open Data Practice within Archaeology
Ad

Viewers also liked (20)

PPT
KEY
No produktiem uz pakalpojumiem
KEY
Nākamā desmitgade - mobilo app zīmē?
PPTX
Marlenis Lopez Garcia
PDF
Latvijas paaudžu anatomija
PPTX
LoCloud Overview
PPTX
Etnosu raksturojosie faktori
KEY
2 gadi - 10 atziņas
PPT
Kreativni grad ZADAR // Lucija Varvodić, Kristina Volf, Zita Zagorščak
PPS
Conteporary problems and our solutions
PDF
Regia lettori
PDF
What every leader can learn from neuroscience 16 march
PPTX
Toturial google earth
PDF
Pasaules lielākā mācību stunda "Globālais miera indekss"
PPT
Ar skatu uz priekšu
PDF
Digital trends Digitailwise
PPS
Stop forest fires
PPTX
LoCloud: Enabling local digital heritage in Ireland
PPTX
Data processing for digital libraries: the experience of the BnF with Europea...
PDF
Tájékozódás a könyvtárban
No produktiem uz pakalpojumiem
Nākamā desmitgade - mobilo app zīmē?
Marlenis Lopez Garcia
Latvijas paaudžu anatomija
LoCloud Overview
Etnosu raksturojosie faktori
2 gadi - 10 atziņas
Kreativni grad ZADAR // Lucija Varvodić, Kristina Volf, Zita Zagorščak
Conteporary problems and our solutions
Regia lettori
What every leader can learn from neuroscience 16 march
Toturial google earth
Pasaules lielākā mācību stunda "Globālais miera indekss"
Ar skatu uz priekšu
Digital trends Digitailwise
Stop forest fires
LoCloud: Enabling local digital heritage in Ireland
Data processing for digital libraries: the experience of the BnF with Europea...
Tájékozódás a könyvtárban
Ad

Similar to HOBBIT @ Graph-TA (20)

PDF
Hobbit in a Nutshell - EDF2016
PDF
HOBBIT Project Overview @ ESWC HOBBIT Workshop
PDF
Data and Processes: Can we Marry Them . . . and Make the Marriage Last?
PDF
Memory Management in BigData: A Perpective View
PPTX
Toward FAIR Semantic Resources
PPTX
H2020 Open Data Pilot
PDF
Introduction to FAIR Data and Research Objects
PPTX
OSFair2017 Workshop | Text mining
PPTX
Nieuwerburgh - Open science e-infrastructure for research analysis and impact...
PDF
Enabling Data Analytics from Knowledge Graphs @ ISWC 2017 Doctoral Consortium
PDF
Data management plans – EUDAT Best practices and case study | www.eudat.eu
PDF
Hobbit presentation at Apache Big Data Europe 2016
PPT
H2020 data pilot openaire
PPT
The Horizon 2020 Open Data Pilot - OpenAIRE webinar (Oct. 21 2014) by Sarah J...
PPTX
Mapping presentation THAG big data from space
DOCX
Data Wrangling for Big Data Challenges andOpportunities.docx
PPTX
Boost your data analytics with open data and public news content
PPTX
The EUnetHTA perspective on the HTA database
PDF
Analysing Transportation Data with Open Source Big Data Analytic Tools
PPT
Putting the L in front: from Open Data to Linked Open Data
Hobbit in a Nutshell - EDF2016
HOBBIT Project Overview @ ESWC HOBBIT Workshop
Data and Processes: Can we Marry Them . . . and Make the Marriage Last?
Memory Management in BigData: A Perpective View
Toward FAIR Semantic Resources
H2020 Open Data Pilot
Introduction to FAIR Data and Research Objects
OSFair2017 Workshop | Text mining
Nieuwerburgh - Open science e-infrastructure for research analysis and impact...
Enabling Data Analytics from Knowledge Graphs @ ISWC 2017 Doctoral Consortium
Data management plans – EUDAT Best practices and case study | www.eudat.eu
Hobbit presentation at Apache Big Data Europe 2016
H2020 data pilot openaire
The Horizon 2020 Open Data Pilot - OpenAIRE webinar (Oct. 21 2014) by Sarah J...
Mapping presentation THAG big data from space
Data Wrangling for Big Data Challenges andOpportunities.docx
Boost your data analytics with open data and public news content
The EUnetHTA perspective on the HTA database
Analysing Transportation Data with Open Source Big Data Analytic Tools
Putting the L in front: from Open Data to Linked Open Data

More from Holistic Benchmarking of Big Linked Data (20)

PDF
EARL: Joint Entity and Relation Linking for Question Answering over Knowledge...
PDF
Benchmarking Big Linked Data: The case of the HOBBIT Project
PDF
Assessing Linked Data Versioning Systems: The Semantic Publishing Versioning ...
PDF
The DEBS Grand Challenge 2018
PPTX
Benchmarking of distributed linked data streaming systems
PDF
SQCFramework: SPARQL Query Containment Benchmarks Generation Framework
PDF
LargeRDFBench: A billion triples benchmark for SPARQL endpoint federation
PPTX
The DEBS Grand Challenge 2017
PDF
4th Natural Language Interface over the Web of Data (NLIWoD) workshop and QAL...
PDF
Scalable Link Discovery for Modern Data-Driven Applications (poster)
PDF
An Evaluation of Models for Runtime Approximation in Link Discovery
PDF
Scalable Link Discovery for Modern Data-Driven Applications
PDF
Extending LargeRDFBench for Multi-Source Data at Scale for SPARQL Endpoint F...
PPTX
SPgen: A Benchmark Generator for Spatial Link Discovery Tools
PDF
Introducing the HOBBIT platform into the Ontology Alignment Evaluation Campaign
PDF
OKE2018 Challenge @ ESWC2018
PDF
Dynamic planning for link discovery - ESWC 2018
PDF
Hobbit project overview presented at EBDVF 2017
PDF
Leopard ISWC Semantic Web Challenge 2017 (poster)
PDF
Leopard ISWC Semantic Web Challenge 2017
EARL: Joint Entity and Relation Linking for Question Answering over Knowledge...
Benchmarking Big Linked Data: The case of the HOBBIT Project
Assessing Linked Data Versioning Systems: The Semantic Publishing Versioning ...
The DEBS Grand Challenge 2018
Benchmarking of distributed linked data streaming systems
SQCFramework: SPARQL Query Containment Benchmarks Generation Framework
LargeRDFBench: A billion triples benchmark for SPARQL endpoint federation
The DEBS Grand Challenge 2017
4th Natural Language Interface over the Web of Data (NLIWoD) workshop and QAL...
Scalable Link Discovery for Modern Data-Driven Applications (poster)
An Evaluation of Models for Runtime Approximation in Link Discovery
Scalable Link Discovery for Modern Data-Driven Applications
Extending LargeRDFBench for Multi-Source Data at Scale for SPARQL Endpoint F...
SPgen: A Benchmark Generator for Spatial Link Discovery Tools
Introducing the HOBBIT platform into the Ontology Alignment Evaluation Campaign
OKE2018 Challenge @ ESWC2018
Dynamic planning for link discovery - ESWC 2018
Hobbit project overview presented at EBDVF 2017
Leopard ISWC Semantic Web Challenge 2017 (poster)
Leopard ISWC Semantic Web Challenge 2017

Recently uploaded (20)

PDF
Operating System & Kernel Study Guide-1 - converted.pdf
PPTX
Geodesy 1.pptx...............................................
PDF
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
PPTX
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
PPTX
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
PPT
Mechanical Engineering MATERIALS Selection
PDF
PPT on Performance Review to get promotions
PPTX
UNIT-1 - COAL BASED THERMAL POWER PLANTS
PDF
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
PDF
Digital Logic Computer Design lecture notes
PPTX
Foundation to blockchain - A guide to Blockchain Tech
PPTX
Welding lecture in detail for understanding
PPTX
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
PPTX
Construction Project Organization Group 2.pptx
PPT
CRASH COURSE IN ALTERNATIVE PLUMBING CLASS
PDF
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
PPTX
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
DOCX
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
PDF
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
PPTX
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx
Operating System & Kernel Study Guide-1 - converted.pdf
Geodesy 1.pptx...............................................
Mohammad Mahdi Farshadian CV - Prospective PhD Student 2026
CARTOGRAPHY AND GEOINFORMATION VISUALIZATION chapter1 NPTE (2).pptx
Infosys Presentation by1.Riyan Bagwan 2.Samadhan Naiknavare 3.Gaurav Shinde 4...
Mechanical Engineering MATERIALS Selection
PPT on Performance Review to get promotions
UNIT-1 - COAL BASED THERMAL POWER PLANTS
July 2025 - Top 10 Read Articles in International Journal of Software Enginee...
Digital Logic Computer Design lecture notes
Foundation to blockchain - A guide to Blockchain Tech
Welding lecture in detail for understanding
FINAL REVIEW FOR COPD DIANOSIS FOR PULMONARY DISEASE.pptx
Construction Project Organization Group 2.pptx
CRASH COURSE IN ALTERNATIVE PLUMBING CLASS
SM_6th-Sem__Cse_Internet-of-Things.pdf IOT
MCN 401 KTU-2019-PPE KITS-MODULE 2.pptx
ASol_English-Language-Literature-Set-1-27-02-2023-converted.docx
BMEC211 - INTRODUCTION TO MECHATRONICS-1.pdf
MET 305 2019 SCHEME MODULE 2 COMPLETE.pptx

HOBBIT @ Graph-TA

  • 1. Holistic Benchmarking of Big Linked Data HOBBIT Irini Fundulaki Institute of Computer Science - FORTH Greece 4th Graph-TA Barcelona, Spain, March 3, 2016 Irini Fundulaki (FORTH) HOBBIT March 3, 2016 1 / 9
  • 3. Large number of Linked Data Technologies 2 2https://cdn.datafloq.com/cms/os_big_data_open_source_tools-v2.png Irini Fundulaki (FORTH) HOBBIT March 3, 2016 3 / 9
  • 4. Issues to address for Linked Data Technologies √ Which are the critical steps of the Linked Data lifecycle? √ Which are the current bottlenecks? √ Which are the available market solutions? √ Which are the relevant key performance indicators? √ What is the performance of existing tools w.r.t. relevant performance indicators? Irini Fundulaki (FORTH) HOBBIT March 3, 2016 4 / 9
  • 5. Holistic Benchmarking of Big Linked Data (HOBBIT) HOBBIT focuses on Big Linked Data and intends to cover the business-critical steps of the Linked Data lifecycle √ Objectives Gather real Performance indicators and Performance thresholds from industry Develop benchmarks based on real data Provide universal benchmarking platform on standardized hardware to provide comparable results Provide periodic benchmarking challenges and reporting Found independent Hobbit association Irini Fundulaki (FORTH) HOBBIT March 3, 2016 5 / 9
  • 6. HOBBIT Benchmarks √ Generation and Acquisition: will test the performance of the systems that implement approaches for extracting RDF data from semi-structured data streams such as sensor data (smart metering) and unstructured data streams (Twitter, RSS feeds, etc.) √ Analysis and Processing linking benchmark will test the performance of instance matching methods for Linked Data analytics benchmark will test the performance of supervised and unsupervised machine learning methods Irini Fundulaki (FORTH) HOBBIT March 3, 2016 6 / 9
  • 7. HOBBIT Benchmarks √ Storage and Curation storage benchmark will test the performance storage components and small storage subsystems versioning benchmark will examine how versioning systems perform w.r.t. size of the multi-version repository and the efficiency of cross-snapshot query answering √ Visualization and Services: will test the performance of systems regarding question answering and faceted browsing. Irini Fundulaki (FORTH) HOBBIT March 3, 2016 7 / 9
  • 8. HOBBIT Overview Irini Fundulaki (FORTH) HOBBIT March 3, 2016 8 / 9
  • 9. HOBBIT Logistics √ Horizon 2020, 3 years duration (01/12/2016–30/11/2018) √ Coordinator: Dr. Axel-Cyrille Ngonga-Ngomo, Institute of Applied Informatics, Germany √ Partners: Institute for applied informatics (InfAI), Germany Fraunhofer IAIS, Germany Foundation for Research and Technology (FORTH), Greece National Center for Scientific Research "Demokritos" (NCSR), Greece iMinds, Belgium USU Software AG, Germany ONTOS AG, Switzerland OpenLink, UK AGT Group R&D GMBH, Germany TomTom, Poland Irini Fundulaki (FORTH) HOBBIT March 3, 2016 9 / 9