SlideShare a Scribd company logo
Open science: Implications for bibliometrics and
scientometrics
Ludo Waltman
Centre for Science and Technology Studies (CWTS), Leiden University
24th Nordic Workshop on Bibliometrics and Research Policy
Reykjavík, Iceland
November 28, 2019
1
Motivations for the JOI/QSS flip
• Open citations
• Open access
• Ownership
2
Open science: Implications for bibliometrics and
scientometrics
• Open metadata
• Open access
• Open peer review
3
Open metadata
4
5
6
7
Large publishers not supporting I4OC
8
VOSviewer visualization of journal citation network
based on Crossref data
9
Open citations in Crossref (2008–2017)
10
Overlap of citations 83M
Unique citations in Scopus 112M
Unique citations in Crossref 2M
All publishers Elsevier
Overlap of citations 0M
Unique citations in Scopus 37M
Unique citations in Crossref 0M
Scopus Crossref Scopus Crossref
Citations are considered only between citing and cited publications that
are indexed both in Scopus and in Crossref
Open citations in Microsoft Academic (2008–2017)
1111
Overlap of citations 183M
Unique citations in Scopus 27M
Unique citations in MA 10M
All publishers Elsevier
Overlap of citations 38M
Unique citations in Scopus 0M
Unique citations in MA 1M
Scopus MA Scopus MA
Citations are considered only between citing and cited publications that
are indexed both in Scopus and in Microsoft Academic
Abstracts in Crossref (2016–2018)
12
Free access to metadata for scientometric research
13
Open metadata (Quantitative Science Studies)
14
Metadata quality and completeness
(Quantitative Science Studies)
• Author identifiers (using ORCID)
• Author contribution statement (using CRediT)
• Competing interests statement
• Data availability statement (‘as open as possible, as closed as necessary’)
• Funding information
15
Open access
16
17
18
APCs of scientometric journals
19
Frontiers RMA Frontiers USD 950
JASIST Wiley EUR 2500
JDIS De Gruyter free
Journal of Informetrics Elsevier USD 2000
PLOS ONE PLOS USD 1595
Quantitative Science Studies MIT Press USD 600/800
Research Evaluation Oxford University Press EUR 2430
Research Policy Elsevier USD 2880
Scientometrics Springer Nature EUR 2040
Transparent APC breakdown
(Quantitative Science Studies)
20
Toward centrally funded infrastructures for open
access publishing
21
Negotiations between Dutch universities and Elsevier
22
Open peer review
23
24
What is open peer review?
Open peer review may entail:
• Open reports: Peer review reports are published
• Open identities: Identity of reviewers is revealed
Three forms of open peer review:
• Open reports, closed identities (e.g., EMBO)
• Closed reports, open identities (e.g., Frontiers)
• Open reports, open identities (e.g., F1000)
25
Why open peer review?
Open peer review provides insight into the quality of:
• Journals
– Shows the quality control performed by a journal
– Enables the compilation of peer review statistics
– Mitigates the problem of ‘predatory journals’
• Articles
– Shows the quality control performed for an article
– Shows the assessment of the quality of an article by reviewers
– Shows the extent to which an article has benefited from the comments of reviewers
– Shows the remaining concerns reviewers have about an article
• Reviewers (only if the identity of reviewers is revealed)
– Shows the performance of a reviewer
– Provides recognition to a reviewer
26
27
28
Conclusions
29
Conclusions
• Open science requires all actors in the research system to rethink their way
of working:
– Research practice: Researchers should become less protective of their work and more focused on
contributing to the common good
– Research evaluation: Evaluation should be aligned with the expectations we have from
researchers and should make use of all relevant information
– Research infrastructure: Roles and responsibilities of public and private actors need to be
reconsidered
• As scientometricians, we have a special responsibility to take open science
seriously in the way we do our research
• Open science affects not only the way we do our research, but also our
object of study
30
… and looking forward to receiving your submissions
to Quantitative Science Studies!
31
Thank you for your attention …

More Related Content

PPTX
Responsible journals: Making reading, evaluation and publishing open
PPTX
Toward open citations: Why, how, and when?
PPTX
Ranking universities responsibly
PPTX
Ranking universities responsibly
PPTX
Comparing scientific performance across disciplines: Methodological and conce...
PPTX
The landscape of research on research
PPTX
Comparing bibliographic data sources
PPTX
Large-scale visualization of science: Methods, tools, and applications
Responsible journals: Making reading, evaluation and publishing open
Toward open citations: Why, how, and when?
Ranking universities responsibly
Ranking universities responsibly
Comparing scientific performance across disciplines: Methodological and conce...
The landscape of research on research
Comparing bibliographic data sources
Large-scale visualization of science: Methods, tools, and applications

What's hot (20)

PPTX
Open citations: Next steps
PPTX
From econometrics to bibliometrics
PPTX
Contextualized scientometrics: What's behind the numbers?
PPTX
Bibliometric visualization using VOSviewer
PPTX
Scientific information retrieval: Challenges and opportunities
PPTX
New developments in the CWTS Leiden Ranking
PPTX
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
PPTX
COVID-19 and its implications for the scholarly communication system
PPTX
Scientometrics for research assessment
PPTX
The need for contextualized scientometric analysis
PPTX
Crossref LIVE19 - Researcher and metadata user view
PPTX
Crossref as a source of open bibliographic metadata
PPTX
An in-depth bibliometric perspective on China’s scientific performance
PPTX
Research-only rankings of HEIs: Is it possible to measure scientific performa...
PPTX
Bibliometrische visualisaties voor het bijhouden van wetenschappelijke litera...
PPTX
Science of science, scientometrics, and research policy: The need for quantit...
PPTX
Social sciences research addressing societal challenges
PPTX
A new software tool for large-scale analysis of citation networks
PPTX
Responsible use of university rankings
PDF
Science Mapping and Research Positioning
Open citations: Next steps
From econometrics to bibliometrics
Contextualized scientometrics: What's behind the numbers?
Bibliometric visualization using VOSviewer
Scientific information retrieval: Challenges and opportunities
New developments in the CWTS Leiden Ranking
Web of Science, Scopus, Dimensions, and beyond: The evolving landscape of bib...
COVID-19 and its implications for the scholarly communication system
Scientometrics for research assessment
The need for contextualized scientometric analysis
Crossref LIVE19 - Researcher and metadata user view
Crossref as a source of open bibliographic metadata
An in-depth bibliometric perspective on China’s scientific performance
Research-only rankings of HEIs: Is it possible to measure scientific performa...
Bibliometrische visualisaties voor het bijhouden van wetenschappelijke litera...
Science of science, scientometrics, and research policy: The need for quantit...
Social sciences research addressing societal challenges
A new software tool for large-scale analysis of citation networks
Responsible use of university rankings
Science Mapping and Research Positioning
Ad

Similar to Open science: Implications for bibliometrics and scientometrics (20)

PDF
Scopus: a changing world of Research
PDF
Scopus for Authors
PPTX
Scopus, ScienceDirect and Mendeley
PPTX
Scopus author seminar maynooth_29 10 2014
PDF
Jay patel Open Access TIPPA Midwest presentation june 2013
PPTX
Law Research Visibility Workshop 3
PDF
Author Seminar: How to get published?
PDF
Unlocking Research Visibility.pdf
PDF
Academic Social Networks and Researcher Ranking
PDF
Advanced bibliometric software tools for publishers and editors
PPTX
Citation impact: an introduction to bibliometrics for researchers
PDF
Multiple perspectives on bibliometric data
PDF
+Sc gm fr mars 2016
PPTX
Wnl sponsor 2 scopus
PDF
VOSviewer and CitNetExplorer Tutorial
PPTX
Introduction to Metrics and Impact Tracking
PPTX
Where to publish
PPTX
Where to-publish-2016-05-31
PPTX
What's in the research librarian's tool shed?
PPTX
Citation analysis: State of the art, good practices, and future developments
Scopus: a changing world of Research
Scopus for Authors
Scopus, ScienceDirect and Mendeley
Scopus author seminar maynooth_29 10 2014
Jay patel Open Access TIPPA Midwest presentation june 2013
Law Research Visibility Workshop 3
Author Seminar: How to get published?
Unlocking Research Visibility.pdf
Academic Social Networks and Researcher Ranking
Advanced bibliometric software tools for publishers and editors
Citation impact: an introduction to bibliometrics for researchers
Multiple perspectives on bibliometric data
+Sc gm fr mars 2016
Wnl sponsor 2 scopus
VOSviewer and CitNetExplorer Tutorial
Introduction to Metrics and Impact Tracking
Where to publish
Where to-publish-2016-05-31
What's in the research librarian's tool shed?
Citation analysis: State of the art, good practices, and future developments
Ad

Recently uploaded (20)

PPTX
microscope-Lecturecjchchchchcuvuvhc.pptx
PDF
. Radiology Case Scenariosssssssssssssss
PPTX
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
PDF
Phytochemical Investigation of Miliusa longipes.pdf
PDF
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
PDF
The scientific heritage No 166 (166) (2025)
PPTX
2. Earth - The Living Planet earth and life
PPTX
ECG_Course_Presentation د.محمد صقران ppt
PPTX
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
PDF
Placing the Near-Earth Object Impact Probability in Context
PDF
AlphaEarth Foundations and the Satellite Embedding dataset
PPTX
Cell Membrane: Structure, Composition & Functions
PPTX
Taita Taveta Laboratory Technician Workshop Presentation.pptx
PDF
bbec55_b34400a7914c42429908233dbd381773.pdf
PPTX
BIOMOLECULES PPT........................
PPTX
Comparative Structure of Integument in Vertebrates.pptx
PPTX
The KM-GBF monitoring framework – status & key messages.pptx
PPTX
Derivatives of integument scales, beaks, horns,.pptx
PPTX
Introduction to Cardiovascular system_structure and functions-1
PDF
Biophysics 2.pdffffffffffffffffffffffffff
microscope-Lecturecjchchchchcuvuvhc.pptx
. Radiology Case Scenariosssssssssssssss
GEN. BIO 1 - CELL TYPES & CELL MODIFICATIONS
Phytochemical Investigation of Miliusa longipes.pdf
Mastering Bioreactors and Media Sterilization: A Complete Guide to Sterile Fe...
The scientific heritage No 166 (166) (2025)
2. Earth - The Living Planet earth and life
ECG_Course_Presentation د.محمد صقران ppt
EPIDURAL ANESTHESIA ANATOMY AND PHYSIOLOGY.pptx
Placing the Near-Earth Object Impact Probability in Context
AlphaEarth Foundations and the Satellite Embedding dataset
Cell Membrane: Structure, Composition & Functions
Taita Taveta Laboratory Technician Workshop Presentation.pptx
bbec55_b34400a7914c42429908233dbd381773.pdf
BIOMOLECULES PPT........................
Comparative Structure of Integument in Vertebrates.pptx
The KM-GBF monitoring framework – status & key messages.pptx
Derivatives of integument scales, beaks, horns,.pptx
Introduction to Cardiovascular system_structure and functions-1
Biophysics 2.pdffffffffffffffffffffffffff

Open science: Implications for bibliometrics and scientometrics

  • 1. Open science: Implications for bibliometrics and scientometrics Ludo Waltman Centre for Science and Technology Studies (CWTS), Leiden University 24th Nordic Workshop on Bibliometrics and Research Policy Reykjavík, Iceland November 28, 2019
  • 2. 1
  • 3. Motivations for the JOI/QSS flip • Open citations • Open access • Ownership 2
  • 4. Open science: Implications for bibliometrics and scientometrics • Open metadata • Open access • Open peer review 3
  • 6. 5
  • 7. 6
  • 8. 7
  • 9. Large publishers not supporting I4OC 8
  • 10. VOSviewer visualization of journal citation network based on Crossref data 9
  • 11. Open citations in Crossref (2008–2017) 10 Overlap of citations 83M Unique citations in Scopus 112M Unique citations in Crossref 2M All publishers Elsevier Overlap of citations 0M Unique citations in Scopus 37M Unique citations in Crossref 0M Scopus Crossref Scopus Crossref Citations are considered only between citing and cited publications that are indexed both in Scopus and in Crossref
  • 12. Open citations in Microsoft Academic (2008–2017) 1111 Overlap of citations 183M Unique citations in Scopus 27M Unique citations in MA 10M All publishers Elsevier Overlap of citations 38M Unique citations in Scopus 0M Unique citations in MA 1M Scopus MA Scopus MA Citations are considered only between citing and cited publications that are indexed both in Scopus and in Microsoft Academic
  • 13. Abstracts in Crossref (2016–2018) 12
  • 14. Free access to metadata for scientometric research 13
  • 15. Open metadata (Quantitative Science Studies) 14
  • 16. Metadata quality and completeness (Quantitative Science Studies) • Author identifiers (using ORCID) • Author contribution statement (using CRediT) • Competing interests statement • Data availability statement (‘as open as possible, as closed as necessary’) • Funding information 15
  • 18. 17
  • 19. 18
  • 20. APCs of scientometric journals 19 Frontiers RMA Frontiers USD 950 JASIST Wiley EUR 2500 JDIS De Gruyter free Journal of Informetrics Elsevier USD 2000 PLOS ONE PLOS USD 1595 Quantitative Science Studies MIT Press USD 600/800 Research Evaluation Oxford University Press EUR 2430 Research Policy Elsevier USD 2880 Scientometrics Springer Nature EUR 2040
  • 22. Toward centrally funded infrastructures for open access publishing 21
  • 23. Negotiations between Dutch universities and Elsevier 22
  • 25. 24
  • 26. What is open peer review? Open peer review may entail: • Open reports: Peer review reports are published • Open identities: Identity of reviewers is revealed Three forms of open peer review: • Open reports, closed identities (e.g., EMBO) • Closed reports, open identities (e.g., Frontiers) • Open reports, open identities (e.g., F1000) 25
  • 27. Why open peer review? Open peer review provides insight into the quality of: • Journals – Shows the quality control performed by a journal – Enables the compilation of peer review statistics – Mitigates the problem of ‘predatory journals’ • Articles – Shows the quality control performed for an article – Shows the assessment of the quality of an article by reviewers – Shows the extent to which an article has benefited from the comments of reviewers – Shows the remaining concerns reviewers have about an article • Reviewers (only if the identity of reviewers is revealed) – Shows the performance of a reviewer – Provides recognition to a reviewer 26
  • 28. 27
  • 29. 28
  • 31. Conclusions • Open science requires all actors in the research system to rethink their way of working: – Research practice: Researchers should become less protective of their work and more focused on contributing to the common good – Research evaluation: Evaluation should be aligned with the expectations we have from researchers and should make use of all relevant information – Research infrastructure: Roles and responsibilities of public and private actors need to be reconsidered • As scientometricians, we have a special responsibility to take open science seriously in the way we do our research • Open science affects not only the way we do our research, but also our object of study 30
  • 32. … and looking forward to receiving your submissions to Quantitative Science Studies! 31 Thank you for your attention …