SlideShare a Scribd company logo
Clinical and Translational
Science Institute / CTSI
at the University of California, San Francisco
Data Reproducibility in Preclinical Discovery,
Is it a Real Problem?
Cathy Tralau-Stewart PhD FRSC
Head, Therapeutics Track, UCSF Catalyst
Thank you to our sponsors
Why is Reproducibility
Currently
Hitting The Headlines ?
‘The push to replicate findings could
shelve promising research and
unfairly damage the reputations of
careful, meticulous scientists’ Mina
Bissell 2013
‘the challenge of increasing
reproducibility and addressing the
costs associated with the lack of
reproducibility in life science
research is simply too important and
costly to ignore’. Freedman 2015
‘the guidelines could make preparing,
submitting and reviewing research
papers more burdensome, and that
the checklists and other requirements
imposed by journals could make it
more difficult to recruit high-quality
peer reviewers’ Haywood 2015
‘The recent evidence showing the irre-
producibility of significant numbers of
biomedical-research publications demands
immediate and substantive action’ Collins &
Tabak 2015
‘Our observations indicate
that literature data on
potential drug targets
should be viewed with
caution’ Prinz et al 2014
The Debate
Potential Implications of Non Reproducibility
Globally
• Estimated $28bn wasted per year (50% of US Pre-Clinical spend) due
to reproducibility issues
• Reduction in;
– products
– Patient benefit
– Return on Investment (ROI)
– Innovation
• Exposure of patients to ineffective or dangerous new drugs
For The Research Community
Proof of reproducibility may soon be a requirement for
• Publication
• Securing funding & Investment
Evidence for Poor Reproducibility
Freedman LP et al PLOS 2015
~50% of Annual US Pre-Clinical Research Spend Are
Subject to Reproducibility Errors
Freedman LP et al PLOS 2015
Cathy Tralau-Stewart, PhD
Head, Therapeutics Track,
UCSF Catalyst
Moderator:
UCSF–CTSI Catalyst Awards presents
Data Reproducibility in Preclinical
Discovery, Is it a Real Problem?
Panelists:
Keith Yamamoto, PhD
Vice Chancellor for Research
Executive Vice Dean,
UCSF School of Medicine
John Ioannidis, MD, DSc
Professor of Health Research Policy
Stanford School of Medicine
Parker Antin, PhD
FASEB
Board of Directors President
Amanda Halford, MBA
VP of Academic Research
Sigma-Aldrich
Elizabeth Iorns, PhD
Co-Founder & CEO
Science Exchange
Lawrence Tabak, DDS, PhD
Principal Deputy Director
NIH
Questions for Panel: Catalyst@ucsf.edu

More Related Content

PPT
Medical Studies What Can You Believe
PDF
Conor S. O'Brien, "What Can We Learn from the Experience of Healthy Participa...
PPTX
Problems in nursing, health, and social
PPTX
Eric G. Campbell, "IRB Oversight of PCOR: A National Survey of IRB Chairs"
PPT
Original Research
PPT
PT 610: EBP and Information Management
PPTX
Week 12 discussion
Medical Studies What Can You Believe
Conor S. O'Brien, "What Can We Learn from the Experience of Healthy Participa...
Problems in nursing, health, and social
Eric G. Campbell, "IRB Oversight of PCOR: A National Survey of IRB Chairs"
Original Research
PT 610: EBP and Information Management
Week 12 discussion

What's hot (20)

PPT
Nur3052 ch5
PPTX
Prescription for Change: Barriers To Change In Health Care
PPT
Evidence Based Medicine Revisited
PPT
ROLE OF LIBRARIAN IN HEALTH CARE INSTITUTIONS
PDF
Neal Dickert, "Paying Research Subjects Is (Really) Nothing Special"
PPT
Ebd/cosmetic dentistry courses
PPTX
HXR 2016: To Heal and to Cure: Digital Health Experiences
PDF
Dominick Frosch, Many Miles to Go……Implementing Shared Decision Making in Rou...
PPTX
Post-Publication Peer Review in Science: Reflections on Retractions and Med...
PDF
Glyn Elwyn, Shared Decision Making... a dangerous idea
PPTX
Using secondary sources for evidence-based clinical practice
PPTX
Difference between cohort, cross sectional and case control study - Scientifi...
PPTX
DNP Bound - Using the Library/Searching for the Evidence
PDF
Dawn Stacey, Theory and Knowledge of Patient Decision Aids: the Evidence
PPT
The Diversity of Genetic Services Delivery Models in NZ
PPT
evidence based medical practice
PDF
Alicyn Campbell EORTC: Quality of Life in Cancer Clinical Trials Conference. ...
PPTX
Evaluating medical evidence for journalists
PPT
Healthtalkonline.org - Ann McPherson
PPTX
Evidence based dentistry
Nur3052 ch5
Prescription for Change: Barriers To Change In Health Care
Evidence Based Medicine Revisited
ROLE OF LIBRARIAN IN HEALTH CARE INSTITUTIONS
Neal Dickert, "Paying Research Subjects Is (Really) Nothing Special"
Ebd/cosmetic dentistry courses
HXR 2016: To Heal and to Cure: Digital Health Experiences
Dominick Frosch, Many Miles to Go……Implementing Shared Decision Making in Rou...
Post-Publication Peer Review in Science: Reflections on Retractions and Med...
Glyn Elwyn, Shared Decision Making... a dangerous idea
Using secondary sources for evidence-based clinical practice
Difference between cohort, cross sectional and case control study - Scientifi...
DNP Bound - Using the Library/Searching for the Evidence
Dawn Stacey, Theory and Knowledge of Patient Decision Aids: the Evidence
The Diversity of Genetic Services Delivery Models in NZ
evidence based medical practice
Alicyn Campbell EORTC: Quality of Life in Cancer Clinical Trials Conference. ...
Evaluating medical evidence for journalists
Healthtalkonline.org - Ann McPherson
Evidence based dentistry
Ad

Viewers also liked (20)

PPTX
VIVO 2014: Google Analytics, Email Marketing & Vanity to Increase User Engage...
PPT
UCSF Informatics Day 2014 - Ida Sim, "Informatics Technologies: From a Data-C...
PPTX
CER 2016 Goldman Intro
PPTX
UCSF Informatics Day 2014 - Mark Pletcher, "Making EHR Data Useful for the Le...
PPT
CER 2016 Hernandez patient engagement
PPTX
CER 2016 Jacoby stakeholder engagement
PPT
CER 2016 Nguyen ctsi collaborative research
PPTX
How to Harness the Power of Google Analytics, Email Marketing & Vanity to Inc...
PPTX
Building Your Professional Network with LinkedIn
PPTX
CER 2016 Dohan EQUIP
PPTX
UCSF Informatics Day 2014 - Dana Ludwig, "Research Data Browser"
PPT
UCSF Informatics Day 2014 - Elizabeth St. Lezin, "Blood Transfusion Research ...
PPTX
CER 2016 Goldman CTSI CER Resources
PPTX
CER 2016 Srivastava
PPTX
CER 2016 Phillips cer symposium pcori 2016 from 012716
PPTX
CER 2016 Trontell pcori cer presentation 2016 02 02 final
PPT
UCSF Informatics Day 2014 - Keith R. Yamamoto, "Precision Medicine"
PPTX
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"
PPT
UCSF Informatics Day 2014 - David Dobbs, "Enterprise Data Warehouse"
PPTX
UCSF Informatics Day 2014 - Lindsey Watt Alami, "Study Management throughout ...
VIVO 2014: Google Analytics, Email Marketing & Vanity to Increase User Engage...
UCSF Informatics Day 2014 - Ida Sim, "Informatics Technologies: From a Data-C...
CER 2016 Goldman Intro
UCSF Informatics Day 2014 - Mark Pletcher, "Making EHR Data Useful for the Le...
CER 2016 Hernandez patient engagement
CER 2016 Jacoby stakeholder engagement
CER 2016 Nguyen ctsi collaborative research
How to Harness the Power of Google Analytics, Email Marketing & Vanity to Inc...
Building Your Professional Network with LinkedIn
CER 2016 Dohan EQUIP
UCSF Informatics Day 2014 - Dana Ludwig, "Research Data Browser"
UCSF Informatics Day 2014 - Elizabeth St. Lezin, "Blood Transfusion Research ...
CER 2016 Goldman CTSI CER Resources
CER 2016 Srivastava
CER 2016 Phillips cer symposium pcori 2016 from 012716
CER 2016 Trontell pcori cer presentation 2016 02 02 final
UCSF Informatics Day 2014 - Keith R. Yamamoto, "Precision Medicine"
UCSF Informatics Day 2014 - Jocel Dumlao, "REDCap / MyResearch"
UCSF Informatics Day 2014 - David Dobbs, "Enterprise Data Warehouse"
UCSF Informatics Day 2014 - Lindsey Watt Alami, "Study Management throughout ...
Ad

Similar to Data Reproducibility in Preclinical Discovery, Is It a Real Problem? 09/17/15 (20)

PPTX
Using alternative scholarly metrics to showcase the impact of your research: ...
PDF
Assessing Clinical Research Infrastructure Needs
PPTX
Zubin Master MedicReS World Congress 2015
PPTX
DFCM Pearls: What is New
PPTX
Medical research slideshare_june_18_2015
PPTX
Medical research slideshare_june_18_2015
PPT
NIH/Career Development Award Workshop
PPTX
UCSF CER - CER, PCOR, PCORI Overview (Symposium 2013)
PPT
Move Your Research Out of the Ivory Tower and Impact Health: Translating Earl...
PPTX
EVIDENCE BASED DECISION MAKING IN DENTISTRY
PPTX
Research statistics, methods and dilemmas in palliative
PDF
PDF
Translational researchfinal4whsla
PPTX
Ethics In Ct 2 Mar2011
PDF
U of T Department of Family & Community Medicine PEARLS 2014
PDF
FDA 2013 Clinical Investigator Training Course: A Patient Advocate’s Perspect...
PDF
Digital Scholar Webinar: Transparent, Open, and Reproducible Research
PDF
Unconventional Cancer Treatments Hellen Gelband
PPTX
Mind the Gap Health Systems Research and the Search for Answers
PPTX
Amia2016 pghd-panel-v8
Using alternative scholarly metrics to showcase the impact of your research: ...
Assessing Clinical Research Infrastructure Needs
Zubin Master MedicReS World Congress 2015
DFCM Pearls: What is New
Medical research slideshare_june_18_2015
Medical research slideshare_june_18_2015
NIH/Career Development Award Workshop
UCSF CER - CER, PCOR, PCORI Overview (Symposium 2013)
Move Your Research Out of the Ivory Tower and Impact Health: Translating Earl...
EVIDENCE BASED DECISION MAKING IN DENTISTRY
Research statistics, methods and dilemmas in palliative
Translational researchfinal4whsla
Ethics In Ct 2 Mar2011
U of T Department of Family & Community Medicine PEARLS 2014
FDA 2013 Clinical Investigator Training Course: A Patient Advocate’s Perspect...
Digital Scholar Webinar: Transparent, Open, and Reproducible Research
Unconventional Cancer Treatments Hellen Gelband
Mind the Gap Health Systems Research and the Search for Answers
Amia2016 pghd-panel-v8

More from CTSI at UCSF (10)

PDF
AMIA Joint Summits 2017: Building Research Data Mart from UCSF OMOP Database ...
PPTX
UCSF Informatics Day 2014 - Robert Nussbaum, "The Genomic Medicine Initiative...
PPTX
UCSF Informatics Day 2014 - Sayan Chatterjee, "APeX Reporting"
PPT
UCSF Informatics Day 2014 - Sorena Nadaf, "Translational Informatics OnCore C...
PPTX
UCSF Informatics Day 2014 - Sam Hawgood, "Informatics at UCSF"
PPTX
UCSF Informatics Day 2014 - Sue Dubman and Alexandra Solomon, "Innovative inf...
PPT
UCSF Informatics Day 2014 - Sayan Chatterjee and Jennifer Clarke, "APeX Sense...
PPTX
UCSF Informatics Day 2014 - Wylie Burke, "Bioethical Issues in Genomics and E...
PPTX
UCSF Informatics Day 2014 - Michael Blum, "Digital Health"
PPTX
UCSF Informatics Day 2014 - Doug Berman, "A Brief Tour of UCSF’s Clinical Dat...
AMIA Joint Summits 2017: Building Research Data Mart from UCSF OMOP Database ...
UCSF Informatics Day 2014 - Robert Nussbaum, "The Genomic Medicine Initiative...
UCSF Informatics Day 2014 - Sayan Chatterjee, "APeX Reporting"
UCSF Informatics Day 2014 - Sorena Nadaf, "Translational Informatics OnCore C...
UCSF Informatics Day 2014 - Sam Hawgood, "Informatics at UCSF"
UCSF Informatics Day 2014 - Sue Dubman and Alexandra Solomon, "Innovative inf...
UCSF Informatics Day 2014 - Sayan Chatterjee and Jennifer Clarke, "APeX Sense...
UCSF Informatics Day 2014 - Wylie Burke, "Bioethical Issues in Genomics and E...
UCSF Informatics Day 2014 - Michael Blum, "Digital Health"
UCSF Informatics Day 2014 - Doug Berman, "A Brief Tour of UCSF’s Clinical Dat...

Recently uploaded (20)

PDF
OSCE SERIES ( Questions & Answers ) - Set 5.pdf
PPT
nephrology MRCP - Member of Royal College of Physicians ppt
PDF
Lecture on Anesthesia for ENT surgery 2025pptx.pdf
PDF
OSCE SERIES - Set 7 ( Questions & Answers ).pdf
PDF
Transcultural that can help you someday.
PDF
focused on the development and application of glycoHILIC, pepHILIC, and comm...
PPTX
Reading between the Rings: Imaging in Brain Infections
PPTX
NRP and care of Newborn.pptx- APPT presentation about neonatal resuscitation ...
PPT
Infections Member of Royal College of Physicians.ppt
PPTX
Epidemiology of diptheria, pertusis and tetanus with their prevention
PDF
Plant-Based Antimicrobials: A New Hope for Treating Diarrhea in HIV Patients...
PPTX
09. Diabetes in Pregnancy/ gestational.pptx
PPT
neurology Member of Royal College of Physicians (MRCP).ppt
PDF
Comparison of Swim-Up and Microfluidic Sperm Sorting.pdf
PDF
OSCE Series Set 1 ( Questions & Answers ).pdf
PPT
HIV lecture final - student.pptfghjjkkejjhhge
PPTX
Radiation Dose Management for Patients in Medical Imaging- Avinesh Shrestha
PDF
The_EHRA_Book_of_Interventional Electrophysiology.pdf
PPTX
HYPERSENSITIVITY REACTIONS - Pathophysiology Notes for Second Year Pharm D St...
PDF
OSCE SERIES ( Questions & Answers ) - Set 3.pdf
OSCE SERIES ( Questions & Answers ) - Set 5.pdf
nephrology MRCP - Member of Royal College of Physicians ppt
Lecture on Anesthesia for ENT surgery 2025pptx.pdf
OSCE SERIES - Set 7 ( Questions & Answers ).pdf
Transcultural that can help you someday.
focused on the development and application of glycoHILIC, pepHILIC, and comm...
Reading between the Rings: Imaging in Brain Infections
NRP and care of Newborn.pptx- APPT presentation about neonatal resuscitation ...
Infections Member of Royal College of Physicians.ppt
Epidemiology of diptheria, pertusis and tetanus with their prevention
Plant-Based Antimicrobials: A New Hope for Treating Diarrhea in HIV Patients...
09. Diabetes in Pregnancy/ gestational.pptx
neurology Member of Royal College of Physicians (MRCP).ppt
Comparison of Swim-Up and Microfluidic Sperm Sorting.pdf
OSCE Series Set 1 ( Questions & Answers ).pdf
HIV lecture final - student.pptfghjjkkejjhhge
Radiation Dose Management for Patients in Medical Imaging- Avinesh Shrestha
The_EHRA_Book_of_Interventional Electrophysiology.pdf
HYPERSENSITIVITY REACTIONS - Pathophysiology Notes for Second Year Pharm D St...
OSCE SERIES ( Questions & Answers ) - Set 3.pdf

Data Reproducibility in Preclinical Discovery, Is It a Real Problem? 09/17/15

  • 1. Clinical and Translational Science Institute / CTSI at the University of California, San Francisco Data Reproducibility in Preclinical Discovery, Is it a Real Problem? Cathy Tralau-Stewart PhD FRSC Head, Therapeutics Track, UCSF Catalyst
  • 2. Thank you to our sponsors
  • 4. ‘The push to replicate findings could shelve promising research and unfairly damage the reputations of careful, meticulous scientists’ Mina Bissell 2013 ‘the challenge of increasing reproducibility and addressing the costs associated with the lack of reproducibility in life science research is simply too important and costly to ignore’. Freedman 2015 ‘the guidelines could make preparing, submitting and reviewing research papers more burdensome, and that the checklists and other requirements imposed by journals could make it more difficult to recruit high-quality peer reviewers’ Haywood 2015 ‘The recent evidence showing the irre- producibility of significant numbers of biomedical-research publications demands immediate and substantive action’ Collins & Tabak 2015 ‘Our observations indicate that literature data on potential drug targets should be viewed with caution’ Prinz et al 2014 The Debate
  • 5. Potential Implications of Non Reproducibility Globally • Estimated $28bn wasted per year (50% of US Pre-Clinical spend) due to reproducibility issues • Reduction in; – products – Patient benefit – Return on Investment (ROI) – Innovation • Exposure of patients to ineffective or dangerous new drugs For The Research Community Proof of reproducibility may soon be a requirement for • Publication • Securing funding & Investment
  • 6. Evidence for Poor Reproducibility Freedman LP et al PLOS 2015
  • 7. ~50% of Annual US Pre-Clinical Research Spend Are Subject to Reproducibility Errors Freedman LP et al PLOS 2015
  • 8. Cathy Tralau-Stewart, PhD Head, Therapeutics Track, UCSF Catalyst Moderator: UCSF–CTSI Catalyst Awards presents Data Reproducibility in Preclinical Discovery, Is it a Real Problem? Panelists: Keith Yamamoto, PhD Vice Chancellor for Research Executive Vice Dean, UCSF School of Medicine John Ioannidis, MD, DSc Professor of Health Research Policy Stanford School of Medicine Parker Antin, PhD FASEB Board of Directors President Amanda Halford, MBA VP of Academic Research Sigma-Aldrich Elizabeth Iorns, PhD Co-Founder & CEO Science Exchange Lawrence Tabak, DDS, PhD Principal Deputy Director NIH Questions for Panel: Catalyst@ucsf.edu