SlideShare a Scribd company logo
From closed to open access:
A case study of flipped journals
Fakhri Momeni, Nicholas Fraser, Isabella Peters,
Philipp Mayr
GESIS - Leibniz Institute for the Social Sciences
17th ISSI Conference in Rome, Italy
3rd September 2019
Recent development
• Editorial Board of Journal of Informetrics
resigned and started a new journal Gold
OA journal Quantitative Science
Studies (QSS)
2
https://www.cwts.nl/news?article=n-r2v294
Introduction
• Increased stakeholder pressure to transition
research to Open Access (OA) has led to many
journals ‘flipping’ from a toll access to an open
access publishing model
• Changing the publishing model can influence the
decision of authors to submit their papers to a
journal, and increased article accessibility may
influence citation behaviour
• Here, we assess the effect of the journals
flipping to OA by studying the changes in the
number of published articles, as well as changes
in citation metrics at the article (average relative
3
What is a flipped journal?
• A journal transitioning from a subscription-
based (or closed access (CA)) to an open
access (OA) publishing model
4
The journal „Abstract and Applied
Analysis“ converted/ flipped 2006 to
Gold OA
https://www.hindawi.com/journals/aaa
/
What is a flipped journal?
• There are also cases of “reverse-flipped”
journals
• But we just consider CA -> OA
flipped journals
5
Contribution
• RQ: Can we see typical effects after
flipping?
• The aim of this paper is to show changes
in the number of published articles and
citations after the flipping of a journal.
6
Method
• We analysed a set of 171 journals in the
Web of Science (WoS) which flipped to open
access.
• Analysis respectively, as bibliometric
indicators at the article and journal level, to
trace the transformation of flipped journals
– the number of articles,
– average relative citation (ARC)
– Field-normalized impact factor (IF).
7
Dataset
• “Journals that converted from TA to OA“ at
Simmons [1]
• 171 journals could be matched with names
and ISSNs to WoS [2]
• We classified our dataset of journals into
the six major domains of the Science
Metrix classification system
8
[1] http://oad.simmons.edu/oadwiki/Journals_that_converted_from_TA_to_OA
[2] https://github.com/momenifi/OASE
Results
9
0
10
20
30
40
50
60
Numberofflippedjournals
Year
Figure 1. Distribution of flipping years for 171 WoS
journals
Journal conversions carried out
2006 by Hindawi and Spanish
National Research Council
Results
10
114
136 143 142 139 132 139 136 138
0
50
100
150
200
250
-4 -3 -2 -1 0 1 2 3 4
year=2006, n=16
year=2009, n=7
year=2010, n=7
year=2011, n=8
year=2012, n=9
all years, n=58
averagenumberofarticlesperjournals
• Excluding the journals that have at least one year with zero published articles and
flipped after 2012, we obtain a dataset of 58 journals.
Yearly average number of articles for flipped journals four years before and after
flipping (n=number of journals and year is the flipping time).
Year of flipping
Results
11
0
0.5
1
1.5
2
-4 -3 -2 -1 0 1 2 3 4
ARC
Average normalized IF
Comparing the ARC of articles and average normalized IF of 43
flipped journals before and after flipping.
• Decrease in ARC
after flipping
• Slightly higher IFs
after flipping
Results
12
Comparing flipped journa
with CA journals in
the same field
• flipped journals show
more strongly fluctuating
long-term trends of
ARC and IF
• for Health Sciences
(A and B) we see an
improvement in ARC and
IF after flipping
• Applied Sciences
(C and D) shows no
long-term advantage
Limitations
• Relatively few flipped journals
• Not all journals in the Simmons list could
be matched in WoS
• Comparison with CA journals: limited
numbers of flipped journals across our
samples
13
Conclusions
• Our results show that whilst IF increases in the years
immediately following flipping, the article-level ARC
decreases
– In line with results found by Piwowar et al. (2018) and
Archambault et al. (2014) that gold OA articles are cited less
than CA articles.
• We also observe that a lower number of articles are
published after flipping, pointing to a lower tendency
amongst authors to submit to OA journals.
• We will also study in more detail the so-called “quality effect”,
which assumes that high quality publications profit
proportionally more from OA, as they are more citable than
low-quality publications
– The question we seek to answer is whether journals with high
IFs benefit significantly more from flipping to OA than journals
with medium or low IFs.
14
Future Work
• Our bibliometric study will be
complemented with more qualitative
information from interviews with
authors, editors, and publishers to reveal
their attitudes towards journal flipping
and OA,
• With this we hope to better show such
interwoven factors that influence
bibliometric indicators of flipped journals.
15
Thank you
Dr Philipp Mayr
GESIS - Leibniz Institute for the Social Sciences, Germany
Team Leader Information & Data Retrieval
Email: philipp.mayr@gesis.org
Twitter: @philipp_mayr
16
Paper available:
https://arxiv.org/abs/1903.11682
https://github.com/momenifi/OASE
This work is supported by BMBF
project OASE, grant number
01PU17005A.
https://www.gesis.org/en/research/external-funding-projects/overview-external-funding-projects/oa

More Related Content

PPTX
Presentation on Scopus
PPTX
Citation analysis: State of the art, good practices, and future developments
PDF
Elsevier - Why Scopus
PPT
journal and impact factor
DOCX
Web of Science and Scopus: Understanding the indexing system
PDF
2018 Journal Impact Factor
PPTX
Citation indexing
PPTX
Using Impact Factors in Research & Publication
Presentation on Scopus
Citation analysis: State of the art, good practices, and future developments
Elsevier - Why Scopus
journal and impact factor
Web of Science and Scopus: Understanding the indexing system
2018 Journal Impact Factor
Citation indexing
Using Impact Factors in Research & Publication

What's hot (20)

PDF
Impact factor
PPTX
Cite score
PPT
Citation analysis for research evaluation
PDF
Primary research presentation r leap 1st section of the manual
PPTX
NUTRITION AND HEALTH SCIENCES
PDF
Impact Factor
PDF
International medical case reports journal q3
PPTX
Research metrices (cite score)
PDF
Journal impact measures: the Impact Factor
PPTX
Journal Citation Reports - Finding Journal impact factors
 
PPTX
Author Level Metrics
PPTX
Vincent Larivière - Journal Impact Factors: history, limitations and adverse ...
PDF
Scopus: a changing world of Research
PPT
Why You Should Not Use The Journal Impact Factor To Evaluate Research
PPTX
Honr 1001 fall 2013
PPTX
Journal impact factors: use and misuse
PPTX
Understanding the Twitter Usage of Science Citation Index (SCI) Journals
PPTX
HP Els Presentation
PDF
Scopus:Workshops on Scopus for Literature Searching and Research Impact
PPTX
Journal Citation Reports
Impact factor
Cite score
Citation analysis for research evaluation
Primary research presentation r leap 1st section of the manual
NUTRITION AND HEALTH SCIENCES
Impact Factor
International medical case reports journal q3
Research metrices (cite score)
Journal impact measures: the Impact Factor
Journal Citation Reports - Finding Journal impact factors
 
Author Level Metrics
Vincent Larivière - Journal Impact Factors: history, limitations and adverse ...
Scopus: a changing world of Research
Why You Should Not Use The Journal Impact Factor To Evaluate Research
Honr 1001 fall 2013
Journal impact factors: use and misuse
Understanding the Twitter Usage of Science Citation Index (SCI) Journals
HP Els Presentation
Scopus:Workshops on Scopus for Literature Searching and Research Impact
Journal Citation Reports
Ad

Similar to From closed to open access: A case study of flipped journals (6)

PPT
Open Access Advantages, Quality and Progress of the Research
PPT
Stevan Harnad - Scholarly/Scientific Impact Metrics in the Open Access Era
PPT
Open Access: Improving scholarly communication
PPT
Open access for researchers, policy makers and research managers
PPTX
Library as publisher
PPTX
Increasing impact of journal articles (web version)
Open Access Advantages, Quality and Progress of the Research
Stevan Harnad - Scholarly/Scientific Impact Metrics in the Open Access Era
Open Access: Improving scholarly communication
Open access for researchers, policy makers and research managers
Library as publisher
Increasing impact of journal articles (web version)
Ad

More from GESIS (20)

PDF
Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs
PPTX
10th BIR Workshop @ECIR 2020: introduction
PPTX
Highly cited references in PLOS ONE and their in-text usage over time
PDF
4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural...
PPTX
Bibliometric-enhanced Information Retrieval: Connecting IR with Bibliometrics
PPTX
Analyzing the network structure and gender differences of the “NKOS community”
PPTX
Recent advances in the project EXCITE – Extraction of Citations from PDF Docu...
PPTX
Searching beyond datasets in the Social Sciences
PPTX
Bedeutung von Text Mining am Beispiel der Sozialwissenschaften
PPTX
Contextualised Browsing in a Digital Library’s Living Lab
PPTX
41st European Conference on Information Retrieval (ECIR 2019)
PPTX
Offenes kollaboratives Schreiben: Eine „Open Science“-Infrastruktur am Beispi...
PDF
A Complete Year of User Retrieval Sessions in a Social Sciences Academic Sear...
PPTX
Challenges in Extracting and Managing References
PDF
Opening Scholarly Communication in Social Sciences by Connecting Collaborativ...
PPTX
Measuring the usefulness of Knowledge Organization Systems in Information Ret...
PDF
Recent Advances in Bibliometric-Enhanced Information Retrieval
PPTX
Analyzing the research output presented at European Networked Knowledge Organ...
PPTX
Introduction to the 15th NKOS workshop @TPDL2016
PPTX
Recent applications of Knowledge Organization Systems
Chatting with Papers: A Hybrid Approach Using LLMs and Knowledge Graphs
10th BIR Workshop @ECIR 2020: introduction
Highly cited references in PLOS ONE and their in-text usage over time
4th Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural...
Bibliometric-enhanced Information Retrieval: Connecting IR with Bibliometrics
Analyzing the network structure and gender differences of the “NKOS community”
Recent advances in the project EXCITE – Extraction of Citations from PDF Docu...
Searching beyond datasets in the Social Sciences
Bedeutung von Text Mining am Beispiel der Sozialwissenschaften
Contextualised Browsing in a Digital Library’s Living Lab
41st European Conference on Information Retrieval (ECIR 2019)
Offenes kollaboratives Schreiben: Eine „Open Science“-Infrastruktur am Beispi...
A Complete Year of User Retrieval Sessions in a Social Sciences Academic Sear...
Challenges in Extracting and Managing References
Opening Scholarly Communication in Social Sciences by Connecting Collaborativ...
Measuring the usefulness of Knowledge Organization Systems in Information Ret...
Recent Advances in Bibliometric-Enhanced Information Retrieval
Analyzing the research output presented at European Networked Knowledge Organ...
Introduction to the 15th NKOS workshop @TPDL2016
Recent applications of Knowledge Organization Systems

Recently uploaded (20)

PPTX
BIOMOLECULES PPT........................
PDF
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
PDF
Phytochemical Investigation of Miliusa longipes.pdf
PPTX
Microbiology with diagram medical studies .pptx
PDF
Placing the Near-Earth Object Impact Probability in Context
PDF
Biophysics 2.pdffffffffffffffffffffffffff
PPTX
Overview of calcium in human muscles.pptx
PPTX
Introduction to Fisheries Biotechnology_Lesson 1.pptx
PPTX
neck nodes and dissection types and lymph nodes levels
PPTX
Application of enzymes in medicine (2).pptx
PDF
. Radiology Case Scenariosssssssssssssss
PDF
Cosmic Outliers: Low-spin Halos Explain the Abundance, Compactness, and Redsh...
PDF
lecture 2026 of Sjogren's syndrome l .pdf
PDF
Looking into the jet cone of the neutrino-associated very high-energy blazar ...
PDF
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
PDF
SEHH2274 Organic Chemistry Notes 1 Structure and Bonding.pdf
PDF
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
PDF
Warm, water-depleted rocky exoplanets with surfaceionic liquids: A proposed c...
PDF
CHAPTER 3 Cell Structures and Their Functions Lecture Outline.pdf
PPT
protein biochemistry.ppt for university classes
BIOMOLECULES PPT........................
CAPERS-LRD-z9:AGas-enshroudedLittleRedDotHostingaBroad-lineActive GalacticNuc...
Phytochemical Investigation of Miliusa longipes.pdf
Microbiology with diagram medical studies .pptx
Placing the Near-Earth Object Impact Probability in Context
Biophysics 2.pdffffffffffffffffffffffffff
Overview of calcium in human muscles.pptx
Introduction to Fisheries Biotechnology_Lesson 1.pptx
neck nodes and dissection types and lymph nodes levels
Application of enzymes in medicine (2).pptx
. Radiology Case Scenariosssssssssssssss
Cosmic Outliers: Low-spin Halos Explain the Abundance, Compactness, and Redsh...
lecture 2026 of Sjogren's syndrome l .pdf
Looking into the jet cone of the neutrino-associated very high-energy blazar ...
ELS_Q1_Module-11_Formation-of-Rock-Layers_v2.pdf
SEHH2274 Organic Chemistry Notes 1 Structure and Bonding.pdf
Formation of Supersonic Turbulence in the Primordial Star-forming Cloud
Warm, water-depleted rocky exoplanets with surfaceionic liquids: A proposed c...
CHAPTER 3 Cell Structures and Their Functions Lecture Outline.pdf
protein biochemistry.ppt for university classes

From closed to open access: A case study of flipped journals

  • 1. From closed to open access: A case study of flipped journals Fakhri Momeni, Nicholas Fraser, Isabella Peters, Philipp Mayr GESIS - Leibniz Institute for the Social Sciences 17th ISSI Conference in Rome, Italy 3rd September 2019
  • 2. Recent development • Editorial Board of Journal of Informetrics resigned and started a new journal Gold OA journal Quantitative Science Studies (QSS) 2 https://www.cwts.nl/news?article=n-r2v294
  • 3. Introduction • Increased stakeholder pressure to transition research to Open Access (OA) has led to many journals ‘flipping’ from a toll access to an open access publishing model • Changing the publishing model can influence the decision of authors to submit their papers to a journal, and increased article accessibility may influence citation behaviour • Here, we assess the effect of the journals flipping to OA by studying the changes in the number of published articles, as well as changes in citation metrics at the article (average relative 3
  • 4. What is a flipped journal? • A journal transitioning from a subscription- based (or closed access (CA)) to an open access (OA) publishing model 4 The journal „Abstract and Applied Analysis“ converted/ flipped 2006 to Gold OA https://www.hindawi.com/journals/aaa /
  • 5. What is a flipped journal? • There are also cases of “reverse-flipped” journals • But we just consider CA -> OA flipped journals 5
  • 6. Contribution • RQ: Can we see typical effects after flipping? • The aim of this paper is to show changes in the number of published articles and citations after the flipping of a journal. 6
  • 7. Method • We analysed a set of 171 journals in the Web of Science (WoS) which flipped to open access. • Analysis respectively, as bibliometric indicators at the article and journal level, to trace the transformation of flipped journals – the number of articles, – average relative citation (ARC) – Field-normalized impact factor (IF). 7
  • 8. Dataset • “Journals that converted from TA to OA“ at Simmons [1] • 171 journals could be matched with names and ISSNs to WoS [2] • We classified our dataset of journals into the six major domains of the Science Metrix classification system 8 [1] http://oad.simmons.edu/oadwiki/Journals_that_converted_from_TA_to_OA [2] https://github.com/momenifi/OASE
  • 9. Results 9 0 10 20 30 40 50 60 Numberofflippedjournals Year Figure 1. Distribution of flipping years for 171 WoS journals Journal conversions carried out 2006 by Hindawi and Spanish National Research Council
  • 10. Results 10 114 136 143 142 139 132 139 136 138 0 50 100 150 200 250 -4 -3 -2 -1 0 1 2 3 4 year=2006, n=16 year=2009, n=7 year=2010, n=7 year=2011, n=8 year=2012, n=9 all years, n=58 averagenumberofarticlesperjournals • Excluding the journals that have at least one year with zero published articles and flipped after 2012, we obtain a dataset of 58 journals. Yearly average number of articles for flipped journals four years before and after flipping (n=number of journals and year is the flipping time). Year of flipping
  • 11. Results 11 0 0.5 1 1.5 2 -4 -3 -2 -1 0 1 2 3 4 ARC Average normalized IF Comparing the ARC of articles and average normalized IF of 43 flipped journals before and after flipping. • Decrease in ARC after flipping • Slightly higher IFs after flipping
  • 12. Results 12 Comparing flipped journa with CA journals in the same field • flipped journals show more strongly fluctuating long-term trends of ARC and IF • for Health Sciences (A and B) we see an improvement in ARC and IF after flipping • Applied Sciences (C and D) shows no long-term advantage
  • 13. Limitations • Relatively few flipped journals • Not all journals in the Simmons list could be matched in WoS • Comparison with CA journals: limited numbers of flipped journals across our samples 13
  • 14. Conclusions • Our results show that whilst IF increases in the years immediately following flipping, the article-level ARC decreases – In line with results found by Piwowar et al. (2018) and Archambault et al. (2014) that gold OA articles are cited less than CA articles. • We also observe that a lower number of articles are published after flipping, pointing to a lower tendency amongst authors to submit to OA journals. • We will also study in more detail the so-called “quality effect”, which assumes that high quality publications profit proportionally more from OA, as they are more citable than low-quality publications – The question we seek to answer is whether journals with high IFs benefit significantly more from flipping to OA than journals with medium or low IFs. 14
  • 15. Future Work • Our bibliometric study will be complemented with more qualitative information from interviews with authors, editors, and publishers to reveal their attitudes towards journal flipping and OA, • With this we hope to better show such interwoven factors that influence bibliometric indicators of flipped journals. 15
  • 16. Thank you Dr Philipp Mayr GESIS - Leibniz Institute for the Social Sciences, Germany Team Leader Information & Data Retrieval Email: philipp.mayr@gesis.org Twitter: @philipp_mayr 16 Paper available: https://arxiv.org/abs/1903.11682 https://github.com/momenifi/OASE This work is supported by BMBF project OASE, grant number 01PU17005A. https://www.gesis.org/en/research/external-funding-projects/overview-external-funding-projects/oa