SlideShare a Scribd company logo
Group discussions
Ghent, 28 May 2019
Questions for the discussion:
1. Relevance/added value of metrics produced by
Data4Impact: are these metrics answering the
questions that funders and policymakers have?
2. Utility/practicality of the indicators: do the
indicators bring new value compared to what is
currently available?
3. Which results/indicators are most/least
convincing? Why?
Key Data4Impact indicators
Level Indicator Description
1. Input
level
indicators
1.1. Funding volume Monetary expenditure on R&I activities
2.
Throughpu
t level
indicators
2.1. Publications Number of publications produced by programme/funder cited in patents
Number of highly cited publications in patents
2.2. Patents Number of patents produced
2.3. Innovation outputs produced by EU FPs projects Number of health-specific innovation outputs produced in projects funded by the EU Framework Programmes
2.4. New companies Number of new companies/start-ups created in the EU Framework Programmes
2.5. Innovation outputs produced by companies
participating in R&I activities
Number of product innovations; or process, service or other innovations announced by companies
2.6. Innovation activities carried out by companies
participating in R&I activities
Number of licensing agreements; or cases of acquisitions; or cases of private funding attracted; or cases of public
funding attracted by companies; or cases of newly CE-marked medical devices or technologies
3.
Academic
impact
3.1. Funding priorities Topic size in PubMed (absolute and normalised)
Distribution of topics per funder (normalised)
Distribution of funders per topic (absolute)
3.2. Timeliness of research performed Rate of topic growth between 2012-2018 compared to 2005-2011
Share of funding allocated to top-10% fastest growing topics
3.3. Funding exclusivity Share of funding allocated to top-10% smallest research topics by size (i.e. investment in small-niche topics)
Number of funders per topic whose output share exceeds 3% globally
Share of funding allocated to research topics with less than 5 funders whose share exceeds the 3% mark (i.e.
investment in topics where few other funders invest)
3.4. Technological value/significance of patents Analysis of the extent to which commonly patent forward citations (i.e. citations a patent receives from subsequent
patent filings) are used
4.
Economic
impact
4.1. Economic and innovation performance of companies Estimated share of enterprises with evidence of innovation activities
Estimated share of highly innovative enterprises
Estimated share of enterprises with evidence of licensing activities (incl. patent/trademark license agreements)
Estimated share of enterprises involved in activities related to acquisitions
Estimated share of enterprises with evidence of private investment/capital attracted
4.2. Continuity of innovation activities Estimated overlap between project activities in FP7 & identified company innovations
Number of newly CE-marked devices and medical technologies that could be directly linked to R&I activities in the
EU Framework Programmes
5. Societal/
health
impact
5.1. Impact on public health Citations of publications in clinical guidelines
5.2. Societal awareness/relevance of research Rank of research topic based on number of news articles, blogs, posts, tweets, etc. discussing a given topic
5.3. Congruence of research funding with societal priorities Rank similarity of most discussed research topics versus actual spending in the topics
5.4. Newly launched medicines and medicinal products Number of human medicinal products or orphan medicines that could be directly linked to R&I activities in the EU
Framework Programmes
Strength of link based on the number of mentions of product names and their active substances in EC monitoring
data
Data4Impact has received funding from the European Union’s Horizon 2020
research and innovation programme under grant agreement No 770531.
Thank you for your attention!
Data4Impact Consortium
Visit out website:
www.data4impact.eu
Follow us on Twitter and SlideShare:
@Data4Impact

More Related Content

PDF
20190528_Data4Impact_Open Science and Big data in support of measuring R&I In...
PPTX
Presentation on Data4Impact methodology & results in the workshop on the use ...
PPTX
Introduction to Data4Impact
PDF
IMI Outputs - November 2015
PDF
Blind - Standardisation and standards as research and innovation indicators
PPTX
Rassenfosse - IProduct database of patent products pairs
PPTX
Cadth 2015 d2 procurement oral presentation-vf
PPT
Gabriel Rissola: "Measuring the impact of eInclusion actors"
20190528_Data4Impact_Open Science and Big data in support of measuring R&I In...
Presentation on Data4Impact methodology & results in the workshop on the use ...
Introduction to Data4Impact
IMI Outputs - November 2015
Blind - Standardisation and standards as research and innovation indicators
Rassenfosse - IProduct database of patent products pairs
Cadth 2015 d2 procurement oral presentation-vf
Gabriel Rissola: "Measuring the impact of eInclusion actors"

What's hot (19)

PPT
NSERC Strategic Projects Grants Overview
PPTX
OiRA - Online interactive Risk Assessment - an overview of the project
PPTX
Nagaoka - Comments on Science and Innovation policy making today
PPTX
HCF 2017 closing day 2 Jukka Malm
PDF
Communicating the benefits of regulatory policy
PDF
Literature review on the labour market impacts of value chain development int...
PDF
Medteq Guidelines 7th call for projects
PPTX
Innovate UK Future Worlds Event - Living World – Mark Kelly
PPTX
Czarnitzki - Towards a portfolio of additionaliyu indicators
PDF
An analytical framework for consistent evaluation of pest and disease managem...
PPTX
June 9 2017 Panel 5 Karin Kilian
PPTX
Rafols - Towards more inclusive STI indicators
PPT
Salazar - Towards more inclusive science and innovations indicators
PDF
Procurement strategies and processes for health
PPTX
HCF 2016: Erika Kunz
PPTX
June 8 2017 Panel 2 Timo Unger
PDF
Engaging Stakeholders Effectively for a Targeted Approach in Evaluation
PPTX
HCF 2017 closing day 1 Jukka Malm
PPTX
HCF 2016: Christian Schaible
NSERC Strategic Projects Grants Overview
OiRA - Online interactive Risk Assessment - an overview of the project
Nagaoka - Comments on Science and Innovation policy making today
HCF 2017 closing day 2 Jukka Malm
Communicating the benefits of regulatory policy
Literature review on the labour market impacts of value chain development int...
Medteq Guidelines 7th call for projects
Innovate UK Future Worlds Event - Living World – Mark Kelly
Czarnitzki - Towards a portfolio of additionaliyu indicators
An analytical framework for consistent evaluation of pest and disease managem...
June 9 2017 Panel 5 Karin Kilian
Rafols - Towards more inclusive STI indicators
Salazar - Towards more inclusive science and innovations indicators
Procurement strategies and processes for health
HCF 2016: Erika Kunz
June 8 2017 Panel 2 Timo Unger
Engaging Stakeholders Effectively for a Targeted Approach in Evaluation
HCF 2017 closing day 1 Jukka Malm
HCF 2016: Christian Schaible
Ad

Similar to Data4 impact group discussions (20)

PDF
Ace formsurvey2017 06-02-2017_en
PPT
Earma Annual Conference 23 june 2011 - Magali Poinot (parts 2&3)
PPTX
Management Strategic Part One
PPTX
Angga efriansyah schilling
DOCX
20210801205923industry_4.0.docx
PDF
Workshop report
PPT
Innovation in Sensor Design:
PDF
02 design-for-innovation-smart-living-and-innovative-business-models-1
PPT
Presentatie IWT TGO-infosessies
PPTX
SPLC 2018 Summit: Buying with People in Mind: Procurement that Protects Workers
PDF
TCI Pathway working with Pera Technology on Horizon 2020 funding UK
PDF
Horizon 2020 - EU Funding Opportunities, SME instrument
PDF
Grant Funding from Europe for Innovation and New Product Development
PDF
EU Framework for Research and Innovation- Grants from European Commission
PPTX
Outbound open innovation & its effect on firm performance daniel lameck 71010...
PPTX
Barriers to Entry in Markets
PPT
entrepreneurship lecture 1 about how to become a successful business man
PDF
Outsoursed supplier innovation
PPT
Lutz Walter
Ace formsurvey2017 06-02-2017_en
Earma Annual Conference 23 june 2011 - Magali Poinot (parts 2&3)
Management Strategic Part One
Angga efriansyah schilling
20210801205923industry_4.0.docx
Workshop report
Innovation in Sensor Design:
02 design-for-innovation-smart-living-and-innovative-business-models-1
Presentatie IWT TGO-infosessies
SPLC 2018 Summit: Buying with People in Mind: Procurement that Protects Workers
TCI Pathway working with Pera Technology on Horizon 2020 funding UK
Horizon 2020 - EU Funding Opportunities, SME instrument
Grant Funding from Europe for Innovation and New Product Development
EU Framework for Research and Innovation- Grants from European Commission
Outbound open innovation & its effect on firm performance daniel lameck 71010...
Barriers to Entry in Markets
entrepreneurship lecture 1 about how to become a successful business man
Outsoursed supplier innovation
Lutz Walter
Ad

More from OpenAIRE (20)

PDF
10th OpenAIRE Content Providers Community Call
PDF
9th Content Providers Community Call\
PPTX
OpenAIRE in the European Open Science Cloud (EOSC)
PDF
8th Content Providers Community Call
PDF
7th Content Providers Community Call
PDF
OpenAIRE PROVIDE Dashboard for Turkish repository managers
PDF
What will it cost to manage and share my data?
PDF
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3)
PDF
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 2)
PDF
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)
PDF
6th Content Providers Community Call
PPTX
20200504_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
PPTX
20200504_Research Data & the GDPR: How Open is Open?
PDF
20200504_Data, Data Ownership and Open Science
PPTX
20200429_Research Data & the GDPR: How Open is Open? (updated version)
PDF
20200429_Data, Data Ownership and Open Science
PPTX
20200429_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
PDF
COVID-19: Activities, tools, best practice and contact points in Greece
PDF
5th Content Providers Community Call
PDF
4th Content Providers Community Call
10th OpenAIRE Content Providers Community Call
9th Content Providers Community Call\
OpenAIRE in the European Open Science Cloud (EOSC)
8th Content Providers Community Call
7th Content Providers Community Call
OpenAIRE PROVIDE Dashboard for Turkish repository managers
What will it cost to manage and share my data?
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 3)
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 2)
Open Research Gateway for the ELIXIR-GR Infrastructure (Part 1)
6th Content Providers Community Call
20200504_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
20200504_Research Data & the GDPR: How Open is Open?
20200504_Data, Data Ownership and Open Science
20200429_Research Data & the GDPR: How Open is Open? (updated version)
20200429_Data, Data Ownership and Open Science
20200429_OpenAIRE Legal Policy Webinar: GDPR and Sharing Data
COVID-19: Activities, tools, best practice and contact points in Greece
5th Content Providers Community Call
4th Content Providers Community Call

Recently uploaded (20)

PPTX
neck nodes and dissection types and lymph nodes levels
PPTX
BIOMOLECULES PPT........................
PPTX
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
PPTX
Comparative Structure of Integument in Vertebrates.pptx
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PPTX
Vitamins & Minerals: Complete Guide to Functions, Food Sources, Deficiency Si...
PDF
Cosmic Outliers: Low-spin Halos Explain the Abundance, Compactness, and Redsh...
PPTX
Microbiology with diagram medical studies .pptx
PPTX
Taita Taveta Laboratory Technician Workshop Presentation.pptx
PPTX
Introduction to Fisheries Biotechnology_Lesson 1.pptx
PPTX
TOTAL hIP ARTHROPLASTY Presentation.pptx
PPTX
Derivatives of integument scales, beaks, horns,.pptx
PDF
. Radiology Case Scenariosssssssssssssss
PPTX
famous lake in india and its disturibution and importance
PDF
The scientific heritage No 166 (166) (2025)
PPTX
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
PPT
protein biochemistry.ppt for university classes
PDF
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
PDF
HPLC-PPT.docx high performance liquid chromatography
PPTX
Classification Systems_TAXONOMY_SCIENCE8.pptx
neck nodes and dissection types and lymph nodes levels
BIOMOLECULES PPT........................
ANEMIA WITH LEUKOPENIA MDS 07_25.pptx htggtftgt fredrctvg
Comparative Structure of Integument in Vertebrates.pptx
The KM-GBF monitoring framework – status & key messages.pptx
Vitamins & Minerals: Complete Guide to Functions, Food Sources, Deficiency Si...
Cosmic Outliers: Low-spin Halos Explain the Abundance, Compactness, and Redsh...
Microbiology with diagram medical studies .pptx
Taita Taveta Laboratory Technician Workshop Presentation.pptx
Introduction to Fisheries Biotechnology_Lesson 1.pptx
TOTAL hIP ARTHROPLASTY Presentation.pptx
Derivatives of integument scales, beaks, horns,.pptx
. Radiology Case Scenariosssssssssssssss
famous lake in india and its disturibution and importance
The scientific heritage No 166 (166) (2025)
DRUG THERAPY FOR SHOCK gjjjgfhhhhh.pptx.
protein biochemistry.ppt for university classes
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
HPLC-PPT.docx high performance liquid chromatography
Classification Systems_TAXONOMY_SCIENCE8.pptx

Data4 impact group discussions

  • 2. Questions for the discussion: 1. Relevance/added value of metrics produced by Data4Impact: are these metrics answering the questions that funders and policymakers have? 2. Utility/practicality of the indicators: do the indicators bring new value compared to what is currently available? 3. Which results/indicators are most/least convincing? Why?
  • 3. Key Data4Impact indicators Level Indicator Description 1. Input level indicators 1.1. Funding volume Monetary expenditure on R&I activities 2. Throughpu t level indicators 2.1. Publications Number of publications produced by programme/funder cited in patents Number of highly cited publications in patents 2.2. Patents Number of patents produced 2.3. Innovation outputs produced by EU FPs projects Number of health-specific innovation outputs produced in projects funded by the EU Framework Programmes 2.4. New companies Number of new companies/start-ups created in the EU Framework Programmes 2.5. Innovation outputs produced by companies participating in R&I activities Number of product innovations; or process, service or other innovations announced by companies 2.6. Innovation activities carried out by companies participating in R&I activities Number of licensing agreements; or cases of acquisitions; or cases of private funding attracted; or cases of public funding attracted by companies; or cases of newly CE-marked medical devices or technologies 3. Academic impact 3.1. Funding priorities Topic size in PubMed (absolute and normalised) Distribution of topics per funder (normalised) Distribution of funders per topic (absolute) 3.2. Timeliness of research performed Rate of topic growth between 2012-2018 compared to 2005-2011 Share of funding allocated to top-10% fastest growing topics 3.3. Funding exclusivity Share of funding allocated to top-10% smallest research topics by size (i.e. investment in small-niche topics) Number of funders per topic whose output share exceeds 3% globally Share of funding allocated to research topics with less than 5 funders whose share exceeds the 3% mark (i.e. investment in topics where few other funders invest) 3.4. Technological value/significance of patents Analysis of the extent to which commonly patent forward citations (i.e. citations a patent receives from subsequent patent filings) are used 4. Economic impact 4.1. Economic and innovation performance of companies Estimated share of enterprises with evidence of innovation activities Estimated share of highly innovative enterprises Estimated share of enterprises with evidence of licensing activities (incl. patent/trademark license agreements) Estimated share of enterprises involved in activities related to acquisitions Estimated share of enterprises with evidence of private investment/capital attracted 4.2. Continuity of innovation activities Estimated overlap between project activities in FP7 & identified company innovations Number of newly CE-marked devices and medical technologies that could be directly linked to R&I activities in the EU Framework Programmes 5. Societal/ health impact 5.1. Impact on public health Citations of publications in clinical guidelines 5.2. Societal awareness/relevance of research Rank of research topic based on number of news articles, blogs, posts, tweets, etc. discussing a given topic 5.3. Congruence of research funding with societal priorities Rank similarity of most discussed research topics versus actual spending in the topics 5.4. Newly launched medicines and medicinal products Number of human medicinal products or orphan medicines that could be directly linked to R&I activities in the EU Framework Programmes Strength of link based on the number of mentions of product names and their active substances in EC monitoring data
  • 4. Data4Impact has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 770531. Thank you for your attention! Data4Impact Consortium Visit out website: www.data4impact.eu Follow us on Twitter and SlideShare: @Data4Impact