SlideShare a Scribd company logo
2
Most read
11
Most read
12
Most read
AHMEN: Session 1
Cases from COPE:
fabrications and falsifications of data;
managing retractions and corrections
Virginia Barbour
Director, AOASG
Immediate past Chair, COPE
Advisor, Office of Research Ethics and Integrity, QUT
ORCID: 0000-0002-2358-2440
@ginnybarbour
COPE cases show trends in publication ethics
Irene Hames, at 7th International Congress on
Peer Review, 8–10 September 2013, Chicago,
USA http://bit.ly/2qAD5Be
Cases relevant to data and correction of the
literature 1997- 2012
Data
• Over 16yr - fabrication 17%, selective/misleading
reporting/interpretation 13%;
• High (new) 2009 -12 – unauthorized use & image manipulation
Correction of the literature
• Over 16yr - retractions 47%, corrections 27%, expressions of
concern 11%, disputes 9%, corrigenda & errata 6%
Diversity of data
issues
publicationethics.org
Diversity of
correction issues
Cases can
be complex
publicationethics.org
…and take
many
years to
resolve…
Tensions:
Institutions want data to be managed
Journals want data to be available
Institutions have responsibilities other than
correction of the literature
Journals want swift corrections
Illustrative examples of cases
• Data manipulation and institute’s internal review
• Handling self-admissions of fraud
• Concerns about the reliability of findings following
re-analysis of a dataset from a published article
Cases from COPE - fabrications and falsifications of data, managing retractions and corrections
• A journal received an enquiry from a reader stating that they had found some
discrepancies in the spectra published in the electronic supporting information for a
published paper. They suggested that the discrepancies would be consistent with the
spectra being manually ‘cleaned’. If this were true, the characterisation and purity of
the compounds reported in the paper would be called into question.
• The editor checked the spectra in close detail and verified that the discrepancies that
the reader had identified were a reasonable cause for concern. When they contacted
the lead author to discuss the concerns, they explained that ‘cleaning’ spectra to
remove impurity peaks was not a practice that was carried out by their research
group, and they did not believe that it had occurred in this instance. However, the
researcher who had carried out the analysis had now left the group and the original
data files were no longer available.
• An independent expert confirmed that there was clear evidence that the spectra had
been altered.
• The journal contacted the director of the institute to request their assistance in
determining whether the spectra had in fact been altered. They confirmed that it was
not possible to locate the original data due to a limitation of their archival system.
They stated that their internal review had not found any ‘intentional altering of the
spectra and that the papers should not be suspected and be allowed to stand.
Case description
Questions from the journal
What action should the editor now take to resolve this
matter?
• accept the research institute’s recommendation that
without evidence to prove deliberate manipulation of the
data no further action should be taken.
• publish an expression of concern notice on each of the
affected articles stating that discrepancies in the spectra
were identified, the institute was asked to investigate, but
that the original data were not available and they found no
evidence of deliberate manipulation of the spectra.
NB: The editor also checked the author’s related papers in the
journal and identified a total of four papers that were affected
by similar discrepancies in the spectra.
Cases from COPE - fabrications and falsifications of data, managing retractions and corrections
• The first author of a decade old paper in our journal and a 15-year-
old paper from another journal informed us that he faked the data in
two figure panels in the paper in our journal and one figure panel in
the paper in the other journal.
• We informed the corresponding author that we had received self-
admission of fraud from the first author and asked the
corresponding author to retrieve original raw data for the figures in
question and provide them to us. The corresponding author did not
believe that the first author had faked the data. The matter was
referred to the institution.
• The first author provided both us and an investigating committee of
the institution with data that he said was contemporaneously
produced and showed a different result from what was published
• The institute’s report concluded that no further action is warranted
was based on the fact that there was no recorded falsification in the
laboratory notebook.
Case description
Questions from the journal
• What is the journal’s responsibility when one
author self proclaims fraud and another author says
no fraud occurred?
• What is the responsibility of the journal if the
journal thinks an institutional investigation was not
evidence based?
Cases from COPE - fabrications and falsifications of data, managing retractions and corrections
• A reader posted a comment raising some questions about the data analysis in a published
study and the availability of the dataset. The dataset involves genetic information from
potentially identifiable patients and as a result the authors indicated that the deposition of
the data was not possible due to patient privacy concerns. The authors (eventually) made
the dataset available to the editors and the reader.
• The reader has re-analyzed the datasets provided by the authors and he indicates that his
results do not support the conclusions reported in the article.
• We asked the authors to provide a response to the results of the re-analysis and we
indicated that, in the light of the concerns raised, it may be necessary to consider
retraction of the article. The authors have replied and offered to collaborate with the
reader in further analyses, however they suggest that the differences in the results may be
due to the different methodologies employed for the analyses and they have not formally
agreed to retract the article.
• We have offered the reader to submit his re-analysis for publication but he is not
interested in doing this; he is however willing for us to make his re-analysis publicly
available via a public notification on the published article if we decide that such a
notification is necessary
Case description
• In the light of the concerns raised about the study,
should we post a formal public notification on the
article in order to alert readers of the concerns
about the validity of the findings?
• If so, would it be appropriate to proceed with a
retraction or given that the authors have not
agreed to this, consider instead the publication of
an expression of concern?
Questions from the journal
When is a retraction appropriate?
Journal editors should consider retracting a publication if:
• they have clear evidence that the findings are unreliable,
either as a result of misconduct (e.g. data fabrication) or
honest error (e.g. miscalculation or experimental error)
• the findings have previously been published elsewhere
without proper cross-referencing, permission or justification
(i.e. cases of redundant publication)
• it constitutes plagiarism
• it reports unethical research
When is an expression of concern appropriate?
Journal editors should consider issuing an expression of
concern if:
• they receive inconclusive evidence of research or
publication misconduct by the authors
• there is evidence that the findings are unreliable but the
authors’ institution will not investigate the case
• they believe that an investigation into alleged misconduct
related to the publication either has not been, or would not
be, fair and impartial or conclusive
• an investigation is underway but a judgement will not be
available for a considerable time
When is a correction appropriate?
Journal editors should consider issuing a correction if:
• a small portion of an otherwise reliable publication proves
to be misleading (especially because of honest error)
• the author / contributor list is incorrect (i.e. a deserving
author has been omitted or somebody who does not meet
authorship criteria has been included)
publicationethics.org
Despite clear guidance
September 2009
Elizabeth Wager, Virginia Barbour, Steven Yentis, Sabine Kleinert on behalf of COPE
Council
“Retraction is a mechanism for correcting the literature and
alerting readers to publications that contain such seriously flawed
or erroneous data that their findings and conclusions cannot be
relied upon…
..the main purpose of retractions is to correct the literature and
ensure its integrity rather than to punish authors.”
We could probably do better
“our current system
…does not encourage
researchers to engage
in consistent post-
publication changes”
References
COPE - Publication ethics resources
Cases
http://publicationethics.org/
Retraction Guidelines
https://publicationethics.org/files/retraction%20guidelines_0.pdf
Amending Published Articles: Time To Rethink Retractions And Corrections?
http://biorxiv.org/content/early/2017/03/24/118356

More Related Content

PPT
How journal editors can detect and deter scientific misconduct
PPT
Fnlm june 10 2013 final
PDF
Ethics in peer review
PDF
Approaches to Peer Review
PDF
The future of peer review mariette enslin tand_f_indaba
PPTX
Dealing with Academic Rejection 25 Feb 2017
PDF
2.5 critical thinking_pdf_download
How journal editors can detect and deter scientific misconduct
Fnlm june 10 2013 final
Ethics in peer review
Approaches to Peer Review
The future of peer review mariette enslin tand_f_indaba
Dealing with Academic Rejection 25 Feb 2017
2.5 critical thinking_pdf_download

What's hot (20)

PPTX
Academic publishing advice from industry experts
PPTX
What is a literature review?
PPTX
Introduction to Peer review, updated 2015-03-05
PPTX
Meyer-Practical tips for responsible and effective data sharing
PPT
Lecture 14 peer review
PPTX
Learn more about replication studies and negative results
PPT
R Report
PPT
Trish Groves - MedicReS World Congress 2012
PPTX
How to Avoid Publication in Predatory Medical Journal
PPT
Chain of Trust, a web quality assessment tool
PDF
Crises of confidence and publishing reforms: What every social psychologist n...
PPTX
S7 quantitative #2 2019
PPTX
The Impact Factor, Eigenfactor, and Altmetrics: From Theory to Analysis
PPT
AS Sociology: Experiments
PPTX
Dear Reviewer: Notes of appreciation from authors to peer reviewers
PPTX
AMIA 2013 Social Medica Panel
PDF
Leveraging Medical Health Record Data for Identifying Research Study Particip...
PPTX
Ethics in Infodemiology and Public Health 2.0
PPTX
Scientific research: What Anna Karenina teaches us about useful negative results
PPTX
Evaluation of sources
Academic publishing advice from industry experts
What is a literature review?
Introduction to Peer review, updated 2015-03-05
Meyer-Practical tips for responsible and effective data sharing
Lecture 14 peer review
Learn more about replication studies and negative results
R Report
Trish Groves - MedicReS World Congress 2012
How to Avoid Publication in Predatory Medical Journal
Chain of Trust, a web quality assessment tool
Crises of confidence and publishing reforms: What every social psychologist n...
S7 quantitative #2 2019
The Impact Factor, Eigenfactor, and Altmetrics: From Theory to Analysis
AS Sociology: Experiments
Dear Reviewer: Notes of appreciation from authors to peer reviewers
AMIA 2013 Social Medica Panel
Leveraging Medical Health Record Data for Identifying Research Study Particip...
Ethics in Infodemiology and Public Health 2.0
Scientific research: What Anna Karenina teaches us about useful negative results
Evaluation of sources
Ad

Similar to Cases from COPE - fabrications and falsifications of data, managing retractions and corrections (20)

PPTX
Misconduct.pptxnjknvcccbklnhyiinvgikhhik
PPTX
September 20, 2021, George Washington University: Ethics class
PPT
Research Ethics Garcia
PPT
Garcia Ethics 2016
PPTX
Retraction of papers in journals and Predatory journals .pptx
PPTX
Chapter-4-Research Publication And Ethics.pptx
PPTX
ECCVID 2020
PPTX
Research Ethics for Researchers and Acadmicians
PDF
Introduction to research integrity: Research ethic
PDF
RCR-2015_ethics.pdf
PPTX
The Committee on Publication Ethics (COPE) for Better Science: Most Common Et...
PPTX
Research misconduct an introduction
PPTX
The Committee on Publication Ethics (COPE) for Better Science
PDF
Using evidence
PDF
Module_3.pdf
PPTX
Research Ethical Issues
PDF
محاضرة د.سعاد
PPTX
Research and Publication Ethics-LEC 12.pptx
PPTX
Workshop Part 2: Publication Ethics for Biomedical Researchers (BioMed Centra...
PPTX
Data Manipulation And Data Integrity ethics in research
Misconduct.pptxnjknvcccbklnhyiinvgikhhik
September 20, 2021, George Washington University: Ethics class
Research Ethics Garcia
Garcia Ethics 2016
Retraction of papers in journals and Predatory journals .pptx
Chapter-4-Research Publication And Ethics.pptx
ECCVID 2020
Research Ethics for Researchers and Acadmicians
Introduction to research integrity: Research ethic
RCR-2015_ethics.pdf
The Committee on Publication Ethics (COPE) for Better Science: Most Common Et...
Research misconduct an introduction
The Committee on Publication Ethics (COPE) for Better Science
Using evidence
Module_3.pdf
Research Ethical Issues
محاضرة د.سعاد
Research and Publication Ethics-LEC 12.pptx
Workshop Part 2: Publication Ethics for Biomedical Researchers (BioMed Centra...
Data Manipulation And Data Integrity ethics in research
Ad

More from ARDC (20)

PPTX
Introduction to ADA
PPTX
Architecture and Standards
PPTX
Data Sharing and Release Legislation
PPT
Australian Dementia Network (ADNet)
PPTX
Investigator-initiated clinical trials: a community perspective
PPTX
NCRIS and the health domain
PPTX
International perspective for sharing publicly funded medical research data
PPTX
Clinical trials data sharing
PPTX
Clinical trials and cohort studies
PPTX
Introduction to vision and scope
PPTX
FAIR for the future: embracing all things data
PDF
ARDC 2018 state engagements - Nov-Dec 2018 - Slides - Ian Duncan
PDF
Skilling-up-in-research-data-management-20181128
PDF
Research data management and sharing of medical data
PPTX
Findable, Accessible, Interoperable and Reusable (FAIR) data
PPTX
Applying FAIR principles to linked datasets: Opportunities and Challenges
PDF
How to make your data count webinar, 26 Nov 2018
PDF
Ready, Set, Go! Join the Top 10 FAIR Data Things Global Sprint
PDF
How FAIR is your data? Copyright, licensing and reuse of data
PDF
Peter neish DMPs BoF eResearch 2018
Introduction to ADA
Architecture and Standards
Data Sharing and Release Legislation
Australian Dementia Network (ADNet)
Investigator-initiated clinical trials: a community perspective
NCRIS and the health domain
International perspective for sharing publicly funded medical research data
Clinical trials data sharing
Clinical trials and cohort studies
Introduction to vision and scope
FAIR for the future: embracing all things data
ARDC 2018 state engagements - Nov-Dec 2018 - Slides - Ian Duncan
Skilling-up-in-research-data-management-20181128
Research data management and sharing of medical data
Findable, Accessible, Interoperable and Reusable (FAIR) data
Applying FAIR principles to linked datasets: Opportunities and Challenges
How to make your data count webinar, 26 Nov 2018
Ready, Set, Go! Join the Top 10 FAIR Data Things Global Sprint
How FAIR is your data? Copyright, licensing and reuse of data
Peter neish DMPs BoF eResearch 2018

Recently uploaded (20)

PPTX
Introduction to pro and eukaryotes and differences.pptx
PDF
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
DOC
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
PDF
FORM 1 BIOLOGY MIND MAPS and their schemes
PDF
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
PPTX
Introduction to Building Materials
PPTX
Computer Architecture Input Output Memory.pptx
PDF
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
PPTX
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
PDF
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
PDF
LDMMIA Reiki Yoga Finals Review Spring Summer
PDF
Indian roads congress 037 - 2012 Flexible pavement
PDF
Hazard Identification & Risk Assessment .pdf
PPTX
History, Philosophy and sociology of education (1).pptx
PDF
Empowerment Technology for Senior High School Guide
PPTX
B.Sc. DS Unit 2 Software Engineering.pptx
PDF
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
PPTX
TNA_Presentation-1-Final(SAVE)) (1).pptx
PDF
AI-driven educational solutions for real-life interventions in the Philippine...
PDF
Computing-Curriculum for Schools in Ghana
Introduction to pro and eukaryotes and differences.pptx
BP 704 T. NOVEL DRUG DELIVERY SYSTEMS (UNIT 1)
Soft-furnishing-By-Architect-A.F.M.Mohiuddin-Akhand.doc
FORM 1 BIOLOGY MIND MAPS and their schemes
1.3 FINAL REVISED K-10 PE and Health CG 2023 Grades 4-10 (1).pdf
Introduction to Building Materials
Computer Architecture Input Output Memory.pptx
Τίμαιος είναι φιλοσοφικός διάλογος του Πλάτωνα
CHAPTER IV. MAN AND BIOSPHERE AND ITS TOTALITY.pptx
احياء السادس العلمي - الفصل الثالث (التكاثر) منهج متميزين/كلية بغداد/موهوبين
LDMMIA Reiki Yoga Finals Review Spring Summer
Indian roads congress 037 - 2012 Flexible pavement
Hazard Identification & Risk Assessment .pdf
History, Philosophy and sociology of education (1).pptx
Empowerment Technology for Senior High School Guide
B.Sc. DS Unit 2 Software Engineering.pptx
medical_surgical_nursing_10th_edition_ignatavicius_TEST_BANK_pdf.pdf
TNA_Presentation-1-Final(SAVE)) (1).pptx
AI-driven educational solutions for real-life interventions in the Philippine...
Computing-Curriculum for Schools in Ghana

Cases from COPE - fabrications and falsifications of data, managing retractions and corrections

  • 1. AHMEN: Session 1 Cases from COPE: fabrications and falsifications of data; managing retractions and corrections Virginia Barbour Director, AOASG Immediate past Chair, COPE Advisor, Office of Research Ethics and Integrity, QUT ORCID: 0000-0002-2358-2440 @ginnybarbour
  • 2. COPE cases show trends in publication ethics Irene Hames, at 7th International Congress on Peer Review, 8–10 September 2013, Chicago, USA http://bit.ly/2qAD5Be
  • 3. Cases relevant to data and correction of the literature 1997- 2012 Data • Over 16yr - fabrication 17%, selective/misleading reporting/interpretation 13%; • High (new) 2009 -12 – unauthorized use & image manipulation Correction of the literature • Over 16yr - retractions 47%, corrections 27%, expressions of concern 11%, disputes 9%, corrigenda & errata 6%
  • 8. Tensions: Institutions want data to be managed Journals want data to be available Institutions have responsibilities other than correction of the literature Journals want swift corrections
  • 9. Illustrative examples of cases • Data manipulation and institute’s internal review • Handling self-admissions of fraud • Concerns about the reliability of findings following re-analysis of a dataset from a published article
  • 11. • A journal received an enquiry from a reader stating that they had found some discrepancies in the spectra published in the electronic supporting information for a published paper. They suggested that the discrepancies would be consistent with the spectra being manually ‘cleaned’. If this were true, the characterisation and purity of the compounds reported in the paper would be called into question. • The editor checked the spectra in close detail and verified that the discrepancies that the reader had identified were a reasonable cause for concern. When they contacted the lead author to discuss the concerns, they explained that ‘cleaning’ spectra to remove impurity peaks was not a practice that was carried out by their research group, and they did not believe that it had occurred in this instance. However, the researcher who had carried out the analysis had now left the group and the original data files were no longer available. • An independent expert confirmed that there was clear evidence that the spectra had been altered. • The journal contacted the director of the institute to request their assistance in determining whether the spectra had in fact been altered. They confirmed that it was not possible to locate the original data due to a limitation of their archival system. They stated that their internal review had not found any ‘intentional altering of the spectra and that the papers should not be suspected and be allowed to stand. Case description
  • 12. Questions from the journal What action should the editor now take to resolve this matter? • accept the research institute’s recommendation that without evidence to prove deliberate manipulation of the data no further action should be taken. • publish an expression of concern notice on each of the affected articles stating that discrepancies in the spectra were identified, the institute was asked to investigate, but that the original data were not available and they found no evidence of deliberate manipulation of the spectra. NB: The editor also checked the author’s related papers in the journal and identified a total of four papers that were affected by similar discrepancies in the spectra.
  • 14. • The first author of a decade old paper in our journal and a 15-year- old paper from another journal informed us that he faked the data in two figure panels in the paper in our journal and one figure panel in the paper in the other journal. • We informed the corresponding author that we had received self- admission of fraud from the first author and asked the corresponding author to retrieve original raw data for the figures in question and provide them to us. The corresponding author did not believe that the first author had faked the data. The matter was referred to the institution. • The first author provided both us and an investigating committee of the institution with data that he said was contemporaneously produced and showed a different result from what was published • The institute’s report concluded that no further action is warranted was based on the fact that there was no recorded falsification in the laboratory notebook. Case description
  • 15. Questions from the journal • What is the journal’s responsibility when one author self proclaims fraud and another author says no fraud occurred? • What is the responsibility of the journal if the journal thinks an institutional investigation was not evidence based?
  • 17. • A reader posted a comment raising some questions about the data analysis in a published study and the availability of the dataset. The dataset involves genetic information from potentially identifiable patients and as a result the authors indicated that the deposition of the data was not possible due to patient privacy concerns. The authors (eventually) made the dataset available to the editors and the reader. • The reader has re-analyzed the datasets provided by the authors and he indicates that his results do not support the conclusions reported in the article. • We asked the authors to provide a response to the results of the re-analysis and we indicated that, in the light of the concerns raised, it may be necessary to consider retraction of the article. The authors have replied and offered to collaborate with the reader in further analyses, however they suggest that the differences in the results may be due to the different methodologies employed for the analyses and they have not formally agreed to retract the article. • We have offered the reader to submit his re-analysis for publication but he is not interested in doing this; he is however willing for us to make his re-analysis publicly available via a public notification on the published article if we decide that such a notification is necessary Case description
  • 18. • In the light of the concerns raised about the study, should we post a formal public notification on the article in order to alert readers of the concerns about the validity of the findings? • If so, would it be appropriate to proceed with a retraction or given that the authors have not agreed to this, consider instead the publication of an expression of concern? Questions from the journal
  • 19. When is a retraction appropriate? Journal editors should consider retracting a publication if: • they have clear evidence that the findings are unreliable, either as a result of misconduct (e.g. data fabrication) or honest error (e.g. miscalculation or experimental error) • the findings have previously been published elsewhere without proper cross-referencing, permission or justification (i.e. cases of redundant publication) • it constitutes plagiarism • it reports unethical research
  • 20. When is an expression of concern appropriate? Journal editors should consider issuing an expression of concern if: • they receive inconclusive evidence of research or publication misconduct by the authors • there is evidence that the findings are unreliable but the authors’ institution will not investigate the case • they believe that an investigation into alleged misconduct related to the publication either has not been, or would not be, fair and impartial or conclusive • an investigation is underway but a judgement will not be available for a considerable time
  • 21. When is a correction appropriate? Journal editors should consider issuing a correction if: • a small portion of an otherwise reliable publication proves to be misleading (especially because of honest error) • the author / contributor list is incorrect (i.e. a deserving author has been omitted or somebody who does not meet authorship criteria has been included)
  • 22. publicationethics.org Despite clear guidance September 2009 Elizabeth Wager, Virginia Barbour, Steven Yentis, Sabine Kleinert on behalf of COPE Council “Retraction is a mechanism for correcting the literature and alerting readers to publications that contain such seriously flawed or erroneous data that their findings and conclusions cannot be relied upon… ..the main purpose of retractions is to correct the literature and ensure its integrity rather than to punish authors.”
  • 23. We could probably do better “our current system …does not encourage researchers to engage in consistent post- publication changes”
  • 24. References COPE - Publication ethics resources Cases http://publicationethics.org/ Retraction Guidelines https://publicationethics.org/files/retraction%20guidelines_0.pdf Amending Published Articles: Time To Rethink Retractions And Corrections? http://biorxiv.org/content/early/2017/03/24/118356