SlideShare a Scribd company logo
Challenges Citing Preprints
and How to Tackle Them
Bruce Rosenblum
Vice President of Content and Workflow Solutions
Inera | An Atypon Company
@eXtyles | inera.com
Preprint growth
 COVID-19 created
 an explosion of preprints
 an explosion in citations to preprints
 “Posting” is moving faster than peer review and publishing
Why are preprint citations challenging?
 Preprint servers don’t always identify content as preprints
 Recommended citations may be incomplete
 Author citations are frequently incomplete
 Incomplete metadata makes citation completion and
verification challenging
Preprint servers don’t always identify content as not peer-reviewed
What we want:
What we sometimes see:
Problems when content is not identified as peer-reviewed
Published on 4/13/21 at
https://www.nationalgeographic.com/science/article/zoom-fatigue-may-be-with-
us-for-years-heres-how-well-cope
Links to:
Is it a
preprint? How
can we tell?
Recommended citations on preprint servers don’t indicate preprint status
Top 3 recommended citations from OSF Preprints: Is it a
preprint? How
can we tell?
Recommended citations on preprint servers may not include a DOI
Suggested citation from OSF Preprints:
Authors’ preprint citations often don’t include a DOI
Examples of real-world author-submitted preprint citations:
Recommendations for preprint citations
 Update recommended citations, journal style guides, reference
managers, and author instructions for preprint citations to always
include these elements:
 Author/s
 Date of posting
 Preprint title
 Preprint server name
 “Preprint” indicator
 DOI
Example of a “Good” preprint citation
 From the AMA Manual of Style:
1. Bloss CS, Wineinger NE, Peters M, et al. A prospective
randomized trial examining health care utilization in
individuals using multiple smartphone-enabled biosensors.
bioRxiv. Preprint posted online October 28, 2015.
doi:10.1101/029983
Automated link formation between preprint and article doesn’t always work
The preprint title:
The article title:
Source: Bulletin of the World Health Organization
Crossref returns inconsistent results for the same query
Same reference entry, two different Crossref query results:
Authors may post preprints to two or more preprint servers
Lancet preprint on SSRN:
Bulletin of the World Health Organization preprint:
Preprint on medRxiv:
Preprint sites may replace preprint with published journal article
Wyatt, K., Griffin, R., Guerry, A., Ruckelshaus, M., Fogarty, M., & Arkema, K. K. (2018, January
26). Habitat risk assessment for regional ocean planning in the U.S. Northeast and Mid-Atlantic
[preprint]. MarXiv. https://doi.org/10.31230/osf.io/b3y2w
Now resolves to…
Preprint metadata may not indicate withdrawn status
Preprint on bioRxiv:
But … Crossref provides no system to indicate withdrawn status in metadata.
Our recommendations for preprints
 Clearly identify non-peer-reviewed content at all stages
 NISO: Create PIE-J-type recommended practice for preprints
 Update citation styles to include all recommended elements
 Implement metadata integrations and common workflows to ensure that
preprints are:
 treated as a unique citation type
 promptly updated with publication status
 never replaced with the published version
 never deposited to Crossref as journal articles
 Create systems to automatically
 link published articles with their preprints
 identify withdrawn preprints
Recommended reading
 Izzo Hunter, S., I. Kleshchevich, and B. Rosenblum. “What’s wrong with
preprint citations?” The Scholarly Kitchen, 18 September 2020.
https://scholarlykitchen.sspnet.org/2020/09/18/guest-post-whats-wrong-
with-preprint-citations/
 Beck, J., et al. “Building trust in preprints: Recommendations for servers and
other stakeholders.” OSF Preprints, 21 July 2020.
https://doi.org/10.31219/osf.io/8dn4w
 Patel, J. “Opinion: Preprints in the Public Eye.” The Scientist, 18 March 2021.
https://www.the-scientist.com/news-opinion/opinion-preprints-in-the-public-
eye--68563
Thank you!

More Related Content

PDF
Funk "Indexing & Discovering a Record of Versions"
PPTX
McIntosh "Improving the quality of preprints with automated checks"
PPTX
Biocuration 2014 - The Resource Identification Initiative
PPT
How many medline platforms on the web?
PPTX
PPTX
Wimmics seminar--drug interaction knowledge base, micropublication, open anno...
PPTX
Pepe "Enriching Preprints with Provenance, Reproducibility, and Trustworthiness"
Funk "Indexing & Discovering a Record of Versions"
McIntosh "Improving the quality of preprints with automated checks"
Biocuration 2014 - The Resource Identification Initiative
How many medline platforms on the web?
Wimmics seminar--drug interaction knowledge base, micropublication, open anno...
Pepe "Enriching Preprints with Provenance, Reproducibility, and Trustworthiness"

What's hot (20)

PDF
tools for reproducible research in an increasingly digital world
PPTX
Collaborative Research: Scopus & RefWorks
PPTX
Linking assertions to evidence with the MicroPublications ontology WG evidenc...
PPT
Clinical Epidemiology - Systematic PubMed Searching Workshop
PDF
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
PPTX
PPP: Preparing for Publication
PPTX
On the Reproducibility of Science: Unique Identification of Research Resourc...
PDF
Coursera datascitoolbox 2015
PPTX
S17 biot6838 santiago
PDF
Why should Journals ask fo RRIDs?
PDF
3 surya gupta - tabloid proteome
PDF
Coursera datascitoolbox 2015
PDF
Mozilla Science Labs Berlin Meetup
PDF
Leveraging VIVO data: visualizations, queries, and reports
PDF
Coursera The Data Scientist's Toolbox 2014
PPT
Wikipedia and Biomedical Research
PPTX
PPTX
Why canceling subscriptions may just yet save scholarship
PPTX
VIVO2015 - Leveraging Personalized Google Analytics for Greater RNS Engagement
PPTX
A replication crisis in the making: how we reward unreliable science
tools for reproducible research in an increasingly digital world
Collaborative Research: Scopus & RefWorks
Linking assertions to evidence with the MicroPublications ontology WG evidenc...
Clinical Epidemiology - Systematic PubMed Searching Workshop
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
PPP: Preparing for Publication
On the Reproducibility of Science: Unique Identification of Research Resourc...
Coursera datascitoolbox 2015
S17 biot6838 santiago
Why should Journals ask fo RRIDs?
3 surya gupta - tabloid proteome
Coursera datascitoolbox 2015
Mozilla Science Labs Berlin Meetup
Leveraging VIVO data: visualizations, queries, and reports
Coursera The Data Scientist's Toolbox 2014
Wikipedia and Biomedical Research
Why canceling subscriptions may just yet save scholarship
VIVO2015 - Leveraging Personalized Google Analytics for Greater RNS Engagement
A replication crisis in the making: how we reward unreliable science
Ad

More from National Information Standards Organization (NISO) (20)

PPTX
Larry Bennett_ ALA Annual Convention 2025AL2 slides.pptx
PPTX
Potash "Our Journey & Vision for Accessible Content"
PPTX
O'Leary "Progress Assessment - How Far Are We from Delivery"
PPTX
Carpenter and O'Leary "Accessibility Standards and the Future of Inclusive Pu...
PPTX
Davidian "Transfer Code of Practice Standing Committee Update"
PPTX
Patham "NISO Open Discovery Initiative (ODI) Update"
PPTX
Hichliffe "A Standard Terminology for Peer Review"
PPTX
Levin "KBART RP Update at ALA Annual 2025"
PPTX
Carpenter "Advancing Infrastructure for Sustainable Collections: CCLP Project...
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Carpenter "2025 NISO Annual Members Meeting"
PPTX
Allen "Social Marketing in Scholarly Communications"
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Pfeiffer "Secrets to Changing Behavior in Scholarly Communication: A 2025 NIS...
PPTX
Gilstrap "Accessibility Essentials: A 2025 NISO Training Series, Session 7, M...
PPTX
Turner "Accessibility Essentials: A 2025 NISO Training Series, Session 7, Lan...
PPTX
Comeford "Accessibility Essentials: A 2025 NISO Training Series, Session 7, A...
PPTX
Laverick and Richard "Accessibility Essentials: A 2025 NISO Training Series, ...
Larry Bennett_ ALA Annual Convention 2025AL2 slides.pptx
Potash "Our Journey & Vision for Accessible Content"
O'Leary "Progress Assessment - How Far Are We from Delivery"
Carpenter and O'Leary "Accessibility Standards and the Future of Inclusive Pu...
Davidian "Transfer Code of Practice Standing Committee Update"
Patham "NISO Open Discovery Initiative (ODI) Update"
Hichliffe "A Standard Terminology for Peer Review"
Levin "KBART RP Update at ALA Annual 2025"
Carpenter "Advancing Infrastructure for Sustainable Collections: CCLP Project...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Carpenter "2025 NISO Annual Members Meeting"
Allen "Social Marketing in Scholarly Communications"
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Pfeiffer "Secrets to Changing Behavior in Scholarly Communication: A 2025 NIS...
Gilstrap "Accessibility Essentials: A 2025 NISO Training Series, Session 7, M...
Turner "Accessibility Essentials: A 2025 NISO Training Series, Session 7, Lan...
Comeford "Accessibility Essentials: A 2025 NISO Training Series, Session 7, A...
Laverick and Richard "Accessibility Essentials: A 2025 NISO Training Series, ...
Ad

Recently uploaded (20)

PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
Anesthesia in Laparoscopic Surgery in India
PDF
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
PPTX
Cell Structure & Organelles in detailed.
PDF
Supply Chain Operations Speaking Notes -ICLT Program
PDF
Classroom Observation Tools for Teachers
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
PDF
Microbial disease of the cardiovascular and lymphatic systems
PPTX
master seminar digital applications in india
PDF
O7-L3 Supply Chain Operations - ICLT Program
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PPTX
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
PDF
01-Introduction-to-Information-Management.pdf
PPTX
Final Presentation General Medicine 03-08-2024.pptx
PPTX
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
PPTX
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...
2.FourierTransform-ShortQuestionswithAnswers.pdf
Anesthesia in Laparoscopic Surgery in India
ANTIBIOTICS.pptx.pdf………………… xxxxxxxxxxxxx
Cell Structure & Organelles in detailed.
Supply Chain Operations Speaking Notes -ICLT Program
Classroom Observation Tools for Teachers
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
FourierSeries-QuestionsWithAnswers(Part-A).pdf
VCE English Exam - Section C Student Revision Booklet
grade 11-chemistry_fetena_net_5883.pdf teacher guide for all student
Microbial disease of the cardiovascular and lymphatic systems
master seminar digital applications in india
O7-L3 Supply Chain Operations - ICLT Program
Abdominal Access Techniques with Prof. Dr. R K Mishra
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
school management -TNTEU- B.Ed., Semester II Unit 1.pptx
01-Introduction-to-Information-Management.pdf
Final Presentation General Medicine 03-08-2024.pptx
Tissue processing ( HISTOPATHOLOGICAL TECHNIQUE
1st Inaugural Professorial Lecture held on 19th February 2020 (Governance and...

Rosenblum "Challenges Citing Preprints and How to Tackle Them"

  • 1. Challenges Citing Preprints and How to Tackle Them Bruce Rosenblum Vice President of Content and Workflow Solutions Inera | An Atypon Company @eXtyles | inera.com
  • 2. Preprint growth  COVID-19 created  an explosion of preprints  an explosion in citations to preprints  “Posting” is moving faster than peer review and publishing
  • 3. Why are preprint citations challenging?  Preprint servers don’t always identify content as preprints  Recommended citations may be incomplete  Author citations are frequently incomplete  Incomplete metadata makes citation completion and verification challenging
  • 4. Preprint servers don’t always identify content as not peer-reviewed What we want: What we sometimes see:
  • 5. Problems when content is not identified as peer-reviewed Published on 4/13/21 at https://www.nationalgeographic.com/science/article/zoom-fatigue-may-be-with- us-for-years-heres-how-well-cope Links to: Is it a preprint? How can we tell?
  • 6. Recommended citations on preprint servers don’t indicate preprint status Top 3 recommended citations from OSF Preprints: Is it a preprint? How can we tell?
  • 7. Recommended citations on preprint servers may not include a DOI Suggested citation from OSF Preprints:
  • 8. Authors’ preprint citations often don’t include a DOI Examples of real-world author-submitted preprint citations:
  • 9. Recommendations for preprint citations  Update recommended citations, journal style guides, reference managers, and author instructions for preprint citations to always include these elements:  Author/s  Date of posting  Preprint title  Preprint server name  “Preprint” indicator  DOI
  • 10. Example of a “Good” preprint citation  From the AMA Manual of Style: 1. Bloss CS, Wineinger NE, Peters M, et al. A prospective randomized trial examining health care utilization in individuals using multiple smartphone-enabled biosensors. bioRxiv. Preprint posted online October 28, 2015. doi:10.1101/029983
  • 11. Automated link formation between preprint and article doesn’t always work The preprint title: The article title: Source: Bulletin of the World Health Organization
  • 12. Crossref returns inconsistent results for the same query Same reference entry, two different Crossref query results:
  • 13. Authors may post preprints to two or more preprint servers Lancet preprint on SSRN: Bulletin of the World Health Organization preprint: Preprint on medRxiv:
  • 14. Preprint sites may replace preprint with published journal article Wyatt, K., Griffin, R., Guerry, A., Ruckelshaus, M., Fogarty, M., & Arkema, K. K. (2018, January 26). Habitat risk assessment for regional ocean planning in the U.S. Northeast and Mid-Atlantic [preprint]. MarXiv. https://doi.org/10.31230/osf.io/b3y2w Now resolves to…
  • 15. Preprint metadata may not indicate withdrawn status Preprint on bioRxiv: But … Crossref provides no system to indicate withdrawn status in metadata.
  • 16. Our recommendations for preprints  Clearly identify non-peer-reviewed content at all stages  NISO: Create PIE-J-type recommended practice for preprints  Update citation styles to include all recommended elements  Implement metadata integrations and common workflows to ensure that preprints are:  treated as a unique citation type  promptly updated with publication status  never replaced with the published version  never deposited to Crossref as journal articles  Create systems to automatically  link published articles with their preprints  identify withdrawn preprints
  • 17. Recommended reading  Izzo Hunter, S., I. Kleshchevich, and B. Rosenblum. “What’s wrong with preprint citations?” The Scholarly Kitchen, 18 September 2020. https://scholarlykitchen.sspnet.org/2020/09/18/guest-post-whats-wrong- with-preprint-citations/  Beck, J., et al. “Building trust in preprints: Recommendations for servers and other stakeholders.” OSF Preprints, 21 July 2020. https://doi.org/10.31219/osf.io/8dn4w  Patel, J. “Opinion: Preprints in the Public Eye.” The Scientist, 18 March 2021. https://www.the-scientist.com/news-opinion/opinion-preprints-in-the-public- eye--68563