SlideShare a Scribd company logo
Improving the quality of pre-prints with
automated checks
Leslie
McIntosh, PhD
Ripeta, founder and CEO
@ripetaReview
What’s Happening in Preprints?
What’s happening in preprints?
No standard way of reporting or
removing preprints
32 Retracted + 3 ‘Letters of
Concern’ from Covid preprints
Still exploring checks
Automating checks
Automation in Preprints
Will authors
improve
manuscripts?
Ripeta, LLC. All rights reserved. This is not to be shared without official permission.
ripetaReview
Ripeta, LLC. All rights reserved. This is not to be shared without official permission.
ripetaReview Quality
review of
one paper
ripetaReview
Ripeta, LLC. All rights reserved. This is not to be shared without official permission.
ripetaReview
Sample ripetaReview
Research Quality
Study Objective: Yes
Professionalism
ID: Confirmed with ORCID
Funding Statement: Yes
Reproducibility
DAS: Yes
Data Location: In paper
Code Availability: No
Data Location
Result: Text found
The data used to support the findings of this study are included
within the article.
Recommendations: Please consider depositing data and
materials into an accessible repository. Having data easily
accessible has shown to increase the number of citations to
your article. This also assists in making your work
reproducible.
Relationship between the ABO Blood Group and the COVID-19
Susceptibility
DOI: 10.1101/2020.03.11.20031096
Results
Feedback
Will authors
improve
manuscripts?
(ResearchSquare)
33% of authors
corrected and re-
uploaded their
preprint
Can quality
papers be
quickly
identified?
Ripeta, LLC. All rights reserved. This is not to be shared without official permission.
ripetaReport
Ripeta, LLC. All rights reserved. This is not to be shared without official permission.
ripetaReport Report of
Portfolio of
Publications
Sample ripetaReport (Wellcome Trust)
ripetaReporting
Can quality
papers be
quickly
identified?
(Covid preprints)
Automation in Preprints
Quality
Indicators
Research
Professionalism
Reproducibility
info@ripeta.com
Research
Relationship between the ABO Blood Group and the COVID-19 Susceptibility
DOI: 10.1101/2020.03.11.20031096
Here, we investigated the relationship between the ABO blood type
and the susceptibility to COVID-19 in patients from three hospitals in
Wuhan and Shenzhen, China to test if the former may be a biomarker
for the latter.
Study Objective
Scientific
Headings
Abstracts, Background/Introduction, Methods
Professionalism
Reproducibility
Relationship between the ABO Blood Group and the COVID-19 Susceptibility
DOI: 10.1101/2020.03.11.20031096
Data Availability
The data used to support the findings of this study are included within the article.
Data Availability
The data used to support the findings of this study are included within the article.
{Not Found}
Data Availability
Statement
Data Location
Code Availability
Can automation
save time?
Covid Preprint
Analyses
ripetaScore Outcome Citations
Similarity nCoV spike protein
10.1101/2020.01.30.927871 Low Withdrawn 50
Hydroxychloroquine
10.1101/2020.03.16.20037135 Medium Questioned 3000
ABO Blood Group
10.1101/2020.03.11.20031096
Medium Overhyped 150
Potential vaccine targets
10.1101/2020.02.03.933226 High Published 450
Article DOI Study
Purpose
Author-
ship
Funding
Statement
Data
location
DAS Code
availability
10.1101/2020.01.30.927871 Yes 2 No None No No
Uncanny similarity of unique inserts in the 2019-nCoV spike
protein to HIV-1 gp120 and Gag
Methodology
Retrieval and alignment of nucleic acid and protein sequences
We retrieved all the available coronavirus sequences (n=55) from NCBI viral
genome database (https://www.ncbi.nlm.nih.gov/) and we used the GISAID (Elbe
& Buckland-Merrett, 2017)[https://www.gisaid.org/] to retrieve all available full-
length sequences (n=28) of 2019-nCoV as on 27 Jan 2020. Multiple sequence
alignment of all coronavirus genomes was performed by using MUSCLE
software (Edgar, 2004) based on neighbour joining method. Out of 55
coronavirus genome 32 representative genomes of all category were used for
phylogenetic tree development using MEGAX software (Kumar et al., 2018). The
closest relative was found to be SARS CoV.
Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an
open-label non-randomized clinical trial
Article DOI Study
Purpose
Author-
ship
Funding
Statement
Data
location
DAS Code
availability
10.1016/j.ijantimicag.2020
.105949
Yes 1 Yes None No No
Elisabeth Bik took a close look at the IJAA article and
detailed a long list of serious problems with the study,
including questions about its ethical underpinnings, messy
confounding variables, missing patients, rushed and
conflicted peer review, and confusing data.
Relationship between the ABO Blood Group and the COVID-19 Susceptibility
Article DOI Study
Purpose
Author-
ship
Funding
Statement
Data
location
DAS Code
availability
10.1101/2020.03.11.200310
96
Yes 4 Yes In paper Yes No
Preliminary identification of potential vaccine targets for the COVID-19
coronavirus (SARS-CoV-2) based on SARS-CoV immunological studies
Article DOI Study
Purpose
Author-
ship
Funding
Statement
Data
location
DAS Code
availability
10.1101/2020.02.03.933226 Yes 4 Yes External
repo
Yes Yes
Can automation
save time?
(SpringerNature &
bioRxiv/medRxiv Preprints)
4 minutes
instead of 40 hours
to check 400+
manuscripts
Does automation
solve all problems?
Automated checks
can make
better science easier
Follow us @RipetaReview for more memes
Follow us for weekly
academic highlights,
transparency tips, and more!
@RipetaReview
@Ripeta
info@ripeta.com
www.ripeta.com
Stay
Informed
Leslie McIntosh
CEO
Cynthia Hudson
Vitale
COO, co-founder
Chris Westling
Data Engineer
Ruth Whittam
Data Scientist,
Lead
Josh Sumner
Data Scientist,
Intern
Leah Haynes
Data Scientist,
Intern
ripetinis
Paola Ortega
Saborío
Data Engineer
August
DeVore
Editor
ripeta.com
info@ripeta.com
Appendix
ripetaData Research Professionalism Reproducibility
Open Access Ethical Approval Statement Data Availability Statements
Abstract Ethical Approval Organization Data Locations - Repository
Study Objective Author Contribution Statement Data Locations - PID
Funding Statement Competing Interests Data Locations - Identifiers
Funding Source Funding Source Data Locations - URL
Funding Grant ID Funding Grant ID Analysis Software
Count of Authors (single) Analysis Software Version
Self-Citations Statistical Methods
Author Identification Code Availability Statement

More Related Content

PPTX
Pepe "Enriching Preprints with Provenance, Reproducibility, and Trustworthiness"
PDF
Funk "Indexing & Discovering a Record of Versions"
PPTX
Rosenblum "Challenges Citing Preprints and How to Tackle Them"
PPTX
Biocuration 2014 - The Resource Identification Initiative
PPTX
Wimmics seminar--drug interaction knowledge base, micropublication, open anno...
PPTX
On the Reproducibility of Science: Unique Identification of Research Resourc...
PDF
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
PPTX
Linking assertions to evidence with the MicroPublications ontology WG evidenc...
Pepe "Enriching Preprints with Provenance, Reproducibility, and Trustworthiness"
Funk "Indexing & Discovering a Record of Versions"
Rosenblum "Challenges Citing Preprints and How to Tackle Them"
Biocuration 2014 - The Resource Identification Initiative
Wimmics seminar--drug interaction knowledge base, micropublication, open anno...
On the Reproducibility of Science: Unique Identification of Research Resourc...
Charleston 2012: Altmetrics: Analyzing the Value in Scholarly Content
Linking assertions to evidence with the MicroPublications ontology WG evidenc...

What's hot (20)

PDF
Why should Journals ask fo RRIDs?
PDF
RDA Scholarly Infrastructure 2015
PDF
Open Drug Discovery Teams Feature Overview
PDF
Using ADAGE for pathway-style analyses
PDF
Data Visualization in Biomedical Sciences: More than Meets the Eye
PDF
Why should my institution support RRIDs?
PPTX
Journal of Nanomedicine & Biotherapeutic Discovery
PDF
Citation frequency and ethical issue
PDF
No Boundary Thinking in Bioinformatics Workshop Keynote
PPT
Dr Julie Stahlhut - Barcode Data Life-cycle
PDF
Data for AI models, the past, the present, the future
PPTX
20151018 ORCID UAE workshop - Knowledge E - P Purnell presentation
PDF
NETWORK OF DISEASES AND ITS ENDOWMENT TOWARDS DISEASE
PPT
Collaborative Technologies for Biomedical Research
PPTX
Share & Flourish workshop, Leiden, August 2014
PDF
Seattle-Denver VA Center for Innovation
PDF
JPROT-TargetedProteomics-CallforPapers
PPTX
Problem-citations--CrossrefLive18--2018-11-13
PDF
Roche_open_science_NIOO_KNAW_workshop_NL
Why should Journals ask fo RRIDs?
RDA Scholarly Infrastructure 2015
Open Drug Discovery Teams Feature Overview
Using ADAGE for pathway-style analyses
Data Visualization in Biomedical Sciences: More than Meets the Eye
Why should my institution support RRIDs?
Journal of Nanomedicine & Biotherapeutic Discovery
Citation frequency and ethical issue
No Boundary Thinking in Bioinformatics Workshop Keynote
Dr Julie Stahlhut - Barcode Data Life-cycle
Data for AI models, the past, the present, the future
20151018 ORCID UAE workshop - Knowledge E - P Purnell presentation
NETWORK OF DISEASES AND ITS ENDOWMENT TOWARDS DISEASE
Collaborative Technologies for Biomedical Research
Share & Flourish workshop, Leiden, August 2014
Seattle-Denver VA Center for Innovation
JPROT-TargetedProteomics-CallforPapers
Problem-citations--CrossrefLive18--2018-11-13
Roche_open_science_NIOO_KNAW_workshop_NL
Ad

Similar to McIntosh "Improving the quality of preprints with automated checks" (20)

PPTX
ABO Blood Groups and SARS-CoV-2 Infection by Fumiichiro Yamamoto, Ph.D.
PDF
Sars cov 2 spike mutations paper los alamos
PPTX
Remdesivir in the Management of COVID-19: Evidence Based Approach
PDF
2019 novel coronavirus (2019-nCoV) outbreak: A new challenge Tommaso Lupia
PPTX
COVID-19 - Powerpoint.pptx
PPTX
The Coronavirus (COVID-19) Outbreak and Data-driven Healthcare: A Biomedical ...
PPTX
COVID-19 & Diabetes by Dr Shahjada Selim
PPTX
2019-nCoV
PPT
capdrh#############################+.ppt
PDF
Book spike sars-cov-2 as procoagulant factor and vaccine class effect hypoth...
PPSX
Guideline based approach to management of Covid-19
PDF
Γρηγόριος Γεροτζιάφας, 4th Health Innovation Conference
PPTX
covid-19-residents.pptx
PPTX
covid-19-residents.pptx
PPTX
Covid 19-residents
PPTX
Covid 19 INFORMATION
DOCX
Choose one of the psychological disorders discusse
PDF
Highly Conserved Binding Region of ACE2 as Receptor for SARS CoV 2 between Hu...
PDF
Future Outbreak of Caused by SARS-Cov2 Omicron XBB.1.16 Variant: A Perspective
PDF
Future Outbreak of Caused by SARS-Cov2 Omicron XBB.1.16 Variant: A Perspective
ABO Blood Groups and SARS-CoV-2 Infection by Fumiichiro Yamamoto, Ph.D.
Sars cov 2 spike mutations paper los alamos
Remdesivir in the Management of COVID-19: Evidence Based Approach
2019 novel coronavirus (2019-nCoV) outbreak: A new challenge Tommaso Lupia
COVID-19 - Powerpoint.pptx
The Coronavirus (COVID-19) Outbreak and Data-driven Healthcare: A Biomedical ...
COVID-19 & Diabetes by Dr Shahjada Selim
2019-nCoV
capdrh#############################+.ppt
Book spike sars-cov-2 as procoagulant factor and vaccine class effect hypoth...
Guideline based approach to management of Covid-19
Γρηγόριος Γεροτζιάφας, 4th Health Innovation Conference
covid-19-residents.pptx
covid-19-residents.pptx
Covid 19-residents
Covid 19 INFORMATION
Choose one of the psychological disorders discusse
Highly Conserved Binding Region of ACE2 as Receptor for SARS CoV 2 between Hu...
Future Outbreak of Caused by SARS-Cov2 Omicron XBB.1.16 Variant: A Perspective
Future Outbreak of Caused by SARS-Cov2 Omicron XBB.1.16 Variant: A Perspective
Ad

More from National Information Standards Organization (NISO) (20)

PPTX
Larry Bennett_ ALA Annual Convention 2025AL2 slides.pptx
PPTX
Potash "Our Journey & Vision for Accessible Content"
PPTX
O'Leary "Progress Assessment - How Far Are We from Delivery"
PPTX
Carpenter and O'Leary "Accessibility Standards and the Future of Inclusive Pu...
PPTX
Davidian "Transfer Code of Practice Standing Committee Update"
PPTX
Patham "NISO Open Discovery Initiative (ODI) Update"
PPTX
Hichliffe "A Standard Terminology for Peer Review"
PPTX
Levin "KBART RP Update at ALA Annual 2025"
PPTX
Carpenter "Advancing Infrastructure for Sustainable Collections: CCLP Project...
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Carpenter "2025 NISO Annual Members Meeting"
PPTX
Allen "Social Marketing in Scholarly Communications"
PPTX
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
PDF
Pfeiffer "Secrets to Changing Behavior in Scholarly Communication: A 2025 NIS...
PPTX
Gilstrap "Accessibility Essentials: A 2025 NISO Training Series, Session 7, M...
PPTX
Turner "Accessibility Essentials: A 2025 NISO Training Series, Session 7, Lan...
PPTX
Comeford "Accessibility Essentials: A 2025 NISO Training Series, Session 7, A...
PPTX
Laverick and Richard "Accessibility Essentials: A 2025 NISO Training Series, ...
Larry Bennett_ ALA Annual Convention 2025AL2 slides.pptx
Potash "Our Journey & Vision for Accessible Content"
O'Leary "Progress Assessment - How Far Are We from Delivery"
Carpenter and O'Leary "Accessibility Standards and the Future of Inclusive Pu...
Davidian "Transfer Code of Practice Standing Committee Update"
Patham "NISO Open Discovery Initiative (ODI) Update"
Hichliffe "A Standard Terminology for Peer Review"
Levin "KBART RP Update at ALA Annual 2025"
Carpenter "Advancing Infrastructure for Sustainable Collections: CCLP Project...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Carpenter "2025 NISO Annual Members Meeting"
Allen "Social Marketing in Scholarly Communications"
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Gibson "Secrets to Changing Behaviour in Scholarly Communication: A 2025 NISO...
Pfeiffer "Secrets to Changing Behavior in Scholarly Communication: A 2025 NIS...
Gilstrap "Accessibility Essentials: A 2025 NISO Training Series, Session 7, M...
Turner "Accessibility Essentials: A 2025 NISO Training Series, Session 7, Lan...
Comeford "Accessibility Essentials: A 2025 NISO Training Series, Session 7, A...
Laverick and Richard "Accessibility Essentials: A 2025 NISO Training Series, ...

Recently uploaded (20)

PDF
2.FourierTransform-ShortQuestionswithAnswers.pdf
PDF
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PPTX
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
PDF
Classroom Observation Tools for Teachers
PDF
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
PPTX
202450812 BayCHI UCSC-SV 20250812 v17.pptx
PPTX
Institutional Correction lecture only . . .
PDF
O5-L3 Freight Transport Ops (International) V1.pdf
PDF
A systematic review of self-coping strategies used by university students to ...
PDF
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
PPTX
Lesson notes of climatology university.
PPTX
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
PDF
VCE English Exam - Section C Student Revision Booklet
PDF
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
PDF
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
PDF
Computing-Curriculum for Schools in Ghana
PDF
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
PPTX
human mycosis Human fungal infections are called human mycosis..pptx
PPTX
Presentation on HIE in infants and its manifestations
PDF
Abdominal Access Techniques with Prof. Dr. R K Mishra
2.FourierTransform-ShortQuestionswithAnswers.pdf
FourierSeries-QuestionsWithAnswers(Part-A).pdf
PPT- ENG7_QUARTER1_LESSON1_WEEK1. IMAGERY -DESCRIPTIONS pptx.pptx
Classroom Observation Tools for Teachers
Black Hat USA 2025 - Micro ICS Summit - ICS/OT Threat Landscape
202450812 BayCHI UCSC-SV 20250812 v17.pptx
Institutional Correction lecture only . . .
O5-L3 Freight Transport Ops (International) V1.pdf
A systematic review of self-coping strategies used by university students to ...
The Lost Whites of Pakistan by Jahanzaib Mughal.pdf
Lesson notes of climatology university.
IMMUNITY IMMUNITY refers to protection against infection, and the immune syst...
VCE English Exam - Section C Student Revision Booklet
Saundersa Comprehensive Review for the NCLEX-RN Examination.pdf
Chapter 2 Heredity, Prenatal Development, and Birth.pdf
Computing-Curriculum for Schools in Ghana
OBE - B.A.(HON'S) IN INTERIOR ARCHITECTURE -Ar.MOHIUDDIN.pdf
human mycosis Human fungal infections are called human mycosis..pptx
Presentation on HIE in infants and its manifestations
Abdominal Access Techniques with Prof. Dr. R K Mishra

McIntosh "Improving the quality of preprints with automated checks"

  • 1. Improving the quality of pre-prints with automated checks
  • 2. Leslie McIntosh, PhD Ripeta, founder and CEO @ripetaReview
  • 4. What’s happening in preprints? No standard way of reporting or removing preprints 32 Retracted + 3 ‘Letters of Concern’ from Covid preprints Still exploring checks Automating checks
  • 7. Ripeta, LLC. All rights reserved. This is not to be shared without official permission. ripetaReview
  • 8. Ripeta, LLC. All rights reserved. This is not to be shared without official permission. ripetaReview Quality review of one paper ripetaReview
  • 9. Ripeta, LLC. All rights reserved. This is not to be shared without official permission. ripetaReview Sample ripetaReview Research Quality Study Objective: Yes Professionalism ID: Confirmed with ORCID Funding Statement: Yes Reproducibility DAS: Yes Data Location: In paper Code Availability: No Data Location Result: Text found The data used to support the findings of this study are included within the article. Recommendations: Please consider depositing data and materials into an accessible repository. Having data easily accessible has shown to increase the number of citations to your article. This also assists in making your work reproducible. Relationship between the ABO Blood Group and the COVID-19 Susceptibility DOI: 10.1101/2020.03.11.20031096 Results Feedback
  • 10. Will authors improve manuscripts? (ResearchSquare) 33% of authors corrected and re- uploaded their preprint
  • 12. Ripeta, LLC. All rights reserved. This is not to be shared without official permission. ripetaReport
  • 13. Ripeta, LLC. All rights reserved. This is not to be shared without official permission. ripetaReport Report of Portfolio of Publications Sample ripetaReport (Wellcome Trust)
  • 18. Research Relationship between the ABO Blood Group and the COVID-19 Susceptibility DOI: 10.1101/2020.03.11.20031096 Here, we investigated the relationship between the ABO blood type and the susceptibility to COVID-19 in patients from three hospitals in Wuhan and Shenzhen, China to test if the former may be a biomarker for the latter. Study Objective Scientific Headings Abstracts, Background/Introduction, Methods
  • 20. Reproducibility Relationship between the ABO Blood Group and the COVID-19 Susceptibility DOI: 10.1101/2020.03.11.20031096 Data Availability The data used to support the findings of this study are included within the article. Data Availability The data used to support the findings of this study are included within the article. {Not Found} Data Availability Statement Data Location Code Availability
  • 22. Covid Preprint Analyses ripetaScore Outcome Citations Similarity nCoV spike protein 10.1101/2020.01.30.927871 Low Withdrawn 50 Hydroxychloroquine 10.1101/2020.03.16.20037135 Medium Questioned 3000 ABO Blood Group 10.1101/2020.03.11.20031096 Medium Overhyped 150 Potential vaccine targets 10.1101/2020.02.03.933226 High Published 450
  • 23. Article DOI Study Purpose Author- ship Funding Statement Data location DAS Code availability 10.1101/2020.01.30.927871 Yes 2 No None No No Uncanny similarity of unique inserts in the 2019-nCoV spike protein to HIV-1 gp120 and Gag Methodology Retrieval and alignment of nucleic acid and protein sequences We retrieved all the available coronavirus sequences (n=55) from NCBI viral genome database (https://www.ncbi.nlm.nih.gov/) and we used the GISAID (Elbe & Buckland-Merrett, 2017)[https://www.gisaid.org/] to retrieve all available full- length sequences (n=28) of 2019-nCoV as on 27 Jan 2020. Multiple sequence alignment of all coronavirus genomes was performed by using MUSCLE software (Edgar, 2004) based on neighbour joining method. Out of 55 coronavirus genome 32 representative genomes of all category were used for phylogenetic tree development using MEGAX software (Kumar et al., 2018). The closest relative was found to be SARS CoV.
  • 24. Hydroxychloroquine and azithromycin as a treatment of COVID-19: results of an open-label non-randomized clinical trial Article DOI Study Purpose Author- ship Funding Statement Data location DAS Code availability 10.1016/j.ijantimicag.2020 .105949 Yes 1 Yes None No No Elisabeth Bik took a close look at the IJAA article and detailed a long list of serious problems with the study, including questions about its ethical underpinnings, messy confounding variables, missing patients, rushed and conflicted peer review, and confusing data.
  • 25. Relationship between the ABO Blood Group and the COVID-19 Susceptibility Article DOI Study Purpose Author- ship Funding Statement Data location DAS Code availability 10.1101/2020.03.11.200310 96 Yes 4 Yes In paper Yes No
  • 26. Preliminary identification of potential vaccine targets for the COVID-19 coronavirus (SARS-CoV-2) based on SARS-CoV immunological studies Article DOI Study Purpose Author- ship Funding Statement Data location DAS Code availability 10.1101/2020.02.03.933226 Yes 4 Yes External repo Yes Yes
  • 27. Can automation save time? (SpringerNature & bioRxiv/medRxiv Preprints) 4 minutes instead of 40 hours to check 400+ manuscripts
  • 29. Automated checks can make better science easier Follow us @RipetaReview for more memes
  • 30. Follow us for weekly academic highlights, transparency tips, and more! @RipetaReview @Ripeta info@ripeta.com www.ripeta.com Stay Informed
  • 31. Leslie McIntosh CEO Cynthia Hudson Vitale COO, co-founder Chris Westling Data Engineer Ruth Whittam Data Scientist, Lead Josh Sumner Data Scientist, Intern Leah Haynes Data Scientist, Intern ripetinis Paola Ortega Saborío Data Engineer August DeVore Editor
  • 33. ripetaData Research Professionalism Reproducibility Open Access Ethical Approval Statement Data Availability Statements Abstract Ethical Approval Organization Data Locations - Repository Study Objective Author Contribution Statement Data Locations - PID Funding Statement Competing Interests Data Locations - Identifiers Funding Source Funding Source Data Locations - URL Funding Grant ID Funding Grant ID Analysis Software Count of Authors (single) Analysis Software Version Self-Citations Statistical Methods Author Identification Code Availability Statement