SlideShare a Scribd company logo
Inside NIH
Study Sections
and Common
Mistakes on
NIH
Applications:
Advice from the
Battleground
September 1, 2021
1-2:30 p.m.
3
Agenda
Welcome and Introduction of Agenda: April Armstrong
Part 1 (40 minutes)
“The Inside Scoop on NIH Study Sections” by Chanita
Hughes-Halbert
“How to think like a reviewer” by Arthur Toga
“Strategies for grant renewal” by Gage Crump
Part 2 (50 minutes)
Panel Discussion: Thomas Buchanan, Sarah Hamm-
Alvarez, Chanita Hughes-Halbert, Art Toga, Gage
Crump, and April Armstrong
Panelists
5
•Please submit questions using the Q&A
feature anytime throughout the meeting
•Please do not use the chat feature
•This meeting will be recorded and posted
online
The Inside
Scoop on NIH
Study Sections
Chanita Hughes Halbert, PhD
Department of Population and Public
Health Sciences
Norris Comprehensive Cancer
Center
University of Southern California
hughesha@usc.edu
Grant Process Overview
• Center for Scientific Review: Receives
and reviews applications that are
submitted to NIH
• Reviewers: Responsible for evaluating
the scientific merit and impact of
applications using established criteria.
• Study Sections:
• Integrated Review Group – study
sections that are clustered together
around a common scientific area
• Study Section – Scientists who are
experts in the field, mature/objective,
and diverse
https://public.csr.nih.gov/
Key Principles of NIH Peer Review
• NIH provides oversight of the process
• Fair
• Objective
• Study sections evaluate scientific merit
• Scientists who are experts in the field,
mature/objective, and diverse
Key Players in Study Sections
• SRO – Scientific Review Officer
• PO – Program Official
• Study Section Chair
• Reviewers
• SRO introduction and orientation
• Study section introductions
• Triage (not discussed)
• Primary, secondary, and tertiary reviewers provide
scores and critiques (and discussants)
• Discussion/questions among study section
• Discussion is summarized
• Reviewers provide scores again based on
discussion
• Study section members asked if voting outside of
the range
• Priority score is provided to applicant
• Summary statement is provided to applicants
Inside the Study Section
Q&A Session with Dr.
Hughes-Halbert (2
minutes)
12
Arthur W. Toga
www.ini.usc.edu
CIA
Think Like a Reviewer
 RFP
 RFA
 PA
 RFI
 PO
 SRA
 CSR
 Know the panel !
 The wisdom of Willie Sutton (circa 1933)
 Structured
 Clear
 Comprehensive
 Brevity
 What (aims), why (significance), when (timeline), how
(innovation and approach), who (investigators)
 Other Stuff
 What if X goes wrong?
 Validation
 Block the Critique
 Graphics not Groans
 Bullets, Bold and Beautiful
1. Triage and Nerf
2. Arguments and Rebuttals
3. Déjà vu all over again
 If she says ‘that is nice dear…’
 Pass the elevator test
 iCRAP
Q&A Session with Dr.
Toga (2 minutes)
20
Strategies for grant renewal
Gage Crump, PhD
Professor, Stem Cell Biology and
Regenerative Medicine, Integrative
Anatomical Sciences
Eli and Edythe Broad CIRM Center for
Regenerative Medicine and Stem Cell
Research at USC
21
What Reviewers Look for in R01 Renewal
• Productivity
• ~1 last-author publication per year of grant (bioRxiv and
other pre-prints count toward total)
• Minimum 1-2 papers in higher impact journals
** if productivity lower, consider new R01 instead
• Significant New Direction
• Avoid appearance of incremental advance
• At least one aim significantly different than prior R01
• Bring in new co-I/collaborator
** renewal needs some connection to prior R01
** ok to change title of renewal R01, grant number stays
same
Unique Aspects of R01 Renewal
• Progress Report
• ~1 page summarizing progress on each aim of prior R01
• Part of Research Strategy (counts toward 12-page limit)
• Flexible where to insert (I typically place between
Background and Preliminary Studies)
• Progress Report Publications
• Reviewers receive Summary Statement of R01 being renewed
• Based on previous reviewer comments will get a sense of
your previous aims, but will not have access to previous
Specific Aims or Research Strategy sections
• Its Ok to have changed directions or not completed some
aims as long as you have published well
Why to Renew vs. Submitting New R01
• Leverage strong publications in previous period
• Build on previous grant with exciting new findings
• Sympathy scoring for legacy grants – i.e. reviewers
impressed with long-standing grants (I’ve seen some for
45th year but >~15 years may help)
Q&A Session with Dr.
Crump (2 minutes)
25
Panel Discussion and
Q&A Session (50
minutes)
Please use the Q&A box
to submit questions
anytime
26
What is your general
approach to reviewing grants
for study section?
• What do you look at most
closely?
• Are there sections you place
less emphasis?
• How might your approach
be different if you are
primary vs secondary
reviewer?
27
What is your general
approach to reviewing grants
for study section?
• What do you look at most
closely?
• Are there sections you
place less emphasis?
• How might your approach
be different if you are
primary vs secondary
reviewer?
28
What is your general
approach to reviewing grants
for study section?
• What do you look at most
closely?
• Are there sections you place
less emphasis?
• How might your approach
be different if you are
primary vs secondary
reviewer?
29
30
2. Common Mistakes on NIH Research
Applications and How to Avoid them:
• Specific Aims
• Research Strategy
• Significance
• Innovation
• Approach
• Preliminary studies
• Overall strategy
• Methodology and analysis
2. Common Mistakes on NIH Research
Applications and How to Avoid them:
• Specific Aims
• Research Strategy
• Significance
• Innovation
• Approach
• Preliminary studies
• Overall strategy
• Methodology and analysis
2. Common Mistakes on NIH Research
Applications and How to Avoid them:
• Specific Aims
• Research Strategy
• Significance
• Innovation
• Approach
• Preliminary studies
• Overall strategy
• Methodology and analysis
2. Common Mistakes on NIH Research
Applications and How to Avoid them:
• Specific Aims
• Research Strategy
• Significance
• Innovation
• Approach
• Preliminary studies
• Overall strategy
• Methodology and analysis
2. Common Mistakes on NIH Research
Applications and How to Avoid them:
• Specific Aims
• Research Strategy
• Significance
• Innovation
• Approach
• Preliminary studies
• Overall strategy
• Methodology and analysis
2. Common Mistakes on NIH Research
Applications and How to Avoid them:
• Specific Aims
• Research Strategy
• Significance
• Innovation
• Approach
• Preliminary studies
• Overall strategy
• Methodology and analysis
Summary Statement
3. The Summary Statement: Now what?
a.What is the role of your program officer in
assistant with your interpretation or response to
a statement?
b.How do you read and interpret it – what matters
most? Least?
c. Whether and how do you construct a response
and revision?
d.What should you do about inaccuracies?
3. The Summary Statement: Now what?
a. What is the role of your program officer in
assistant with your interpretation or response to a
statement?
b.How do you read and interpret it – what matters
most? Least?
c. Whether and how do you construct a response
and revision?
d.What should you do about inaccuracies?
Your feedback matters.
Please complete the post meeting survey.
Inside NIH
Study Sections
and Common
Mistakes on
NIH
Applications:
Advice from the
Battleground
September 1, 2021
1-2:30 p.m.

More Related Content

PPTX
Nov1 webinar intro_slides v
PDF
Digital Scholar Webinar: Open reproducible research
PPTX
Effectiveness of New, Informationist-led Curriculum Changes at the College of...
PDF
Digital Scholar Webinar: Transparent, Open, and Reproducible Research
PPTX
Survey research lecture 9
PDF
Open science and the individual researcher
PDF
Journal Club - Best Practices for Scientific Computing
PPTX
Annotation examples--Fribourg--2019-09-03
Nov1 webinar intro_slides v
Digital Scholar Webinar: Open reproducible research
Effectiveness of New, Informationist-led Curriculum Changes at the College of...
Digital Scholar Webinar: Transparent, Open, and Reproducible Research
Survey research lecture 9
Open science and the individual researcher
Journal Club - Best Practices for Scientific Computing
Annotation examples--Fribourg--2019-09-03

What's hot (18)

PPTX
Altmetrics for kla final
PPT
Clinical Epidemiology - Systematic PubMed Searching Workshop
PPT
Primary and secondary research
PPTX
Methods of data collection
DOCX
Unit 1 assignment 1 research method
PPTX
Data collection
PPTX
Articulating Program Impacts with Case Studies & Success Stories
PPTX
Secondary data and precautions to be taken while
PPT
Some Early Thoughts
PPTX
An introduction to Statistical Analysis Plans
PPTX
How to conduct systematic literature review
DOCX
Methods of data collection
PPT
Data collection methods
PPSX
Research tools & data collection method_vipin
PPT
Quantandqual
PPTX
Data and data collection procedures
PPTX
Resident Presentations - Evidence-Based Medicine for Haematology
PPT
Primary and sec data
Altmetrics for kla final
Clinical Epidemiology - Systematic PubMed Searching Workshop
Primary and secondary research
Methods of data collection
Unit 1 assignment 1 research method
Data collection
Articulating Program Impacts with Case Studies & Success Stories
Secondary data and precautions to be taken while
Some Early Thoughts
An introduction to Statistical Analysis Plans
How to conduct systematic literature review
Methods of data collection
Data collection methods
Research tools & data collection method_vipin
Quantandqual
Data and data collection procedures
Resident Presentations - Evidence-Based Medicine for Haematology
Primary and sec data
Ad

Similar to Advice from the Battleground: Inside NIH Study Sections and Common Mistakes on NIH Applications (20)

PPTX
How to Craft the "Significance” & "Innovation" [Filler] - 2023
PPTX
How to Craft the "Significance” & "Innovation" - 2023
PDF
What Really Happens in an NIH Study Review?
PDF
How to Craft the "Significance” & "Innovation" Sections of a Grant Applicatio...
PPTX
Presentation how to write a research protocol
PDF
How to Craft the "Significance” & "Innovation" Sections of a Grant Applicatio...
PPTX
Stage of research process.pptx
PPTX
RESEARCH METHODOLOGY FOR UNDERGRADUATES.pptx
PDF
Introduction to Research & Proposal Development Research Concepts 2024.pdf
PDF
Grant Writing Workshop
PPT
Research proposal
PPTX
Research Methology for midwifery students .pptx
PPTX
A Tactical Approach to Writing Your Grant Application by William Parks, PhD
PPT
Research questions and design
PPTX
Qualitative research by Dr. Subraham Pany
PPTX
Research-Methodology on Research social sciescience
PDF
Clinical protocol
PPTX
FUNDAMENTALS OF RESEARCH BNR 22 APRIL 2024 (1).pptx
PPTX
How to write a research proposal
How to Craft the "Significance” & "Innovation" [Filler] - 2023
How to Craft the "Significance” & "Innovation" - 2023
What Really Happens in an NIH Study Review?
How to Craft the "Significance” & "Innovation" Sections of a Grant Applicatio...
Presentation how to write a research protocol
How to Craft the "Significance” & "Innovation" Sections of a Grant Applicatio...
Stage of research process.pptx
RESEARCH METHODOLOGY FOR UNDERGRADUATES.pptx
Introduction to Research & Proposal Development Research Concepts 2024.pdf
Grant Writing Workshop
Research proposal
Research Methology for midwifery students .pptx
A Tactical Approach to Writing Your Grant Application by William Parks, PhD
Research questions and design
Qualitative research by Dr. Subraham Pany
Research-Methodology on Research social sciescience
Clinical protocol
FUNDAMENTALS OF RESEARCH BNR 22 APRIL 2024 (1).pptx
How to write a research proposal
Ad

More from SC CTSI at USC and CHLA (20)

PDF
Research Ethics Forum 5_31_23_slide_set.pdf
PPTX
Digital Scholar webinar: Establishing social media presence
DOCX
Welcome video script_template
PPTX
CTSI ERC Welcome Videos
PDF
The journal of law medicine ethics mapping
PDF
Education Resource Center: Tips for Collecting High-Quality Qualitative Data
PDF
Tips for collecting_high_quality_qualitative_data
PPTX
Education Resource Center Series: Engaging Techniques for Teaching Students &...
PDF
Digital Scholar Webinar: Understanding and using PROSPERO: International pros...
PPTX
Education Resource Center Workshop Series: Teaching, Training & Communicating...
PPTX
Digital Scholar Webinar: Clinicaltrials.gov Registration and Reporting Documents
PPTX
Research Ethics Forum: Ethical Challenges in Trials of Human Genome Editing a...
PPTX
CTSI ERC: Busting Myths in Online Education
PDF
Digital Scholar Webinar: Recruiting Research Participants Online Using Reddit
PDF
Open reproducible research
PPTX
Facilitator template workshop_final
PDF
Facilitator presenter planning_resource_template
PDF
SCLA COVID-19 and Latinos in LA
PPTX
REDCap "Snapshot" Webinar: e-Consent Framework
PPTX
Recruiting, Supporting, and Retaining Diverse Researchers: SC CTSI’s Responsi...
Research Ethics Forum 5_31_23_slide_set.pdf
Digital Scholar webinar: Establishing social media presence
Welcome video script_template
CTSI ERC Welcome Videos
The journal of law medicine ethics mapping
Education Resource Center: Tips for Collecting High-Quality Qualitative Data
Tips for collecting_high_quality_qualitative_data
Education Resource Center Series: Engaging Techniques for Teaching Students &...
Digital Scholar Webinar: Understanding and using PROSPERO: International pros...
Education Resource Center Workshop Series: Teaching, Training & Communicating...
Digital Scholar Webinar: Clinicaltrials.gov Registration and Reporting Documents
Research Ethics Forum: Ethical Challenges in Trials of Human Genome Editing a...
CTSI ERC: Busting Myths in Online Education
Digital Scholar Webinar: Recruiting Research Participants Online Using Reddit
Open reproducible research
Facilitator template workshop_final
Facilitator presenter planning_resource_template
SCLA COVID-19 and Latinos in LA
REDCap "Snapshot" Webinar: e-Consent Framework
Recruiting, Supporting, and Retaining Diverse Researchers: SC CTSI’s Responsi...

Recently uploaded (20)

PDF
Beginner’s Guide to Digital Marketing.pdf
PDF
Women’s Talk Session 1- Talking about women
PPTX
The-Scope-of-Food-Quality-and-Safety.pptx managemement
PPTX
CYBER SECURITY PPT.pptx CYBER SECURITY APPLICATION AND USAGE
PPTX
FINAL PPT.pptx cfyufuyfuyuy8ioyoiuvy ituyc utdfm v
PDF
MCQ Practice CBT OL Official Language 1.pptx.pdf
PPTX
microtomy kkk. presenting to cryst in gl
PPT
ALLIED MATHEMATICS -I UNIT III MATRICES.ppt
PDF
Sheri Ann Lowe Compliance Strategist Resume
PPT
pwm ppt .pdf long description of pwm....
PPTX
STS CHAP 4 human development as reflected
PDF
202s5_Luciano André Deitos Koslowski.pdf
PDF
LSR CASEBOOK 2024-25.pdf. very nice casbook
PPT
Gsisgdkddkvdgjsjdvdbdbdbdghjkhgcvvkkfcxxfg
PDF
Career Overview of John Munro of Hilton Head
PPTX
The Stock at arrangement the stock and product.pptx
PPTX
Principles of Inheritance and variation class 12.pptx
PPT
notes_Lecture2 23l3j2 dfjl dfdlkj d 2.ppt
PPTX
Overview Planner of Soft Skills in a single ppt
PPTX
DPT-MAY24.pptx for review and ucploading
Beginner’s Guide to Digital Marketing.pdf
Women’s Talk Session 1- Talking about women
The-Scope-of-Food-Quality-and-Safety.pptx managemement
CYBER SECURITY PPT.pptx CYBER SECURITY APPLICATION AND USAGE
FINAL PPT.pptx cfyufuyfuyuy8ioyoiuvy ituyc utdfm v
MCQ Practice CBT OL Official Language 1.pptx.pdf
microtomy kkk. presenting to cryst in gl
ALLIED MATHEMATICS -I UNIT III MATRICES.ppt
Sheri Ann Lowe Compliance Strategist Resume
pwm ppt .pdf long description of pwm....
STS CHAP 4 human development as reflected
202s5_Luciano André Deitos Koslowski.pdf
LSR CASEBOOK 2024-25.pdf. very nice casbook
Gsisgdkddkvdgjsjdvdbdbdbdghjkhgcvvkkfcxxfg
Career Overview of John Munro of Hilton Head
The Stock at arrangement the stock and product.pptx
Principles of Inheritance and variation class 12.pptx
notes_Lecture2 23l3j2 dfjl dfdlkj d 2.ppt
Overview Planner of Soft Skills in a single ppt
DPT-MAY24.pptx for review and ucploading

Advice from the Battleground: Inside NIH Study Sections and Common Mistakes on NIH Applications

  • 1. Inside NIH Study Sections and Common Mistakes on NIH Applications: Advice from the Battleground September 1, 2021 1-2:30 p.m.
  • 2. 3 Agenda Welcome and Introduction of Agenda: April Armstrong Part 1 (40 minutes) “The Inside Scoop on NIH Study Sections” by Chanita Hughes-Halbert “How to think like a reviewer” by Arthur Toga “Strategies for grant renewal” by Gage Crump Part 2 (50 minutes) Panel Discussion: Thomas Buchanan, Sarah Hamm- Alvarez, Chanita Hughes-Halbert, Art Toga, Gage Crump, and April Armstrong
  • 4. 5 •Please submit questions using the Q&A feature anytime throughout the meeting •Please do not use the chat feature •This meeting will be recorded and posted online
  • 5. The Inside Scoop on NIH Study Sections Chanita Hughes Halbert, PhD Department of Population and Public Health Sciences Norris Comprehensive Cancer Center University of Southern California hughesha@usc.edu
  • 6. Grant Process Overview • Center for Scientific Review: Receives and reviews applications that are submitted to NIH • Reviewers: Responsible for evaluating the scientific merit and impact of applications using established criteria. • Study Sections: • Integrated Review Group – study sections that are clustered together around a common scientific area • Study Section – Scientists who are experts in the field, mature/objective, and diverse https://public.csr.nih.gov/
  • 7. Key Principles of NIH Peer Review • NIH provides oversight of the process • Fair • Objective • Study sections evaluate scientific merit • Scientists who are experts in the field, mature/objective, and diverse
  • 8. Key Players in Study Sections • SRO – Scientific Review Officer • PO – Program Official • Study Section Chair • Reviewers
  • 9. • SRO introduction and orientation • Study section introductions • Triage (not discussed) • Primary, secondary, and tertiary reviewers provide scores and critiques (and discussants) • Discussion/questions among study section • Discussion is summarized • Reviewers provide scores again based on discussion • Study section members asked if voting outside of the range • Priority score is provided to applicant • Summary statement is provided to applicants Inside the Study Section
  • 10. Q&A Session with Dr. Hughes-Halbert (2 minutes) 12
  • 12.  RFP  RFA  PA  RFI
  • 13.  PO  SRA  CSR  Know the panel !  The wisdom of Willie Sutton (circa 1933)
  • 14.  Structured  Clear  Comprehensive  Brevity  What (aims), why (significance), when (timeline), how (innovation and approach), who (investigators)  Other Stuff  What if X goes wrong?  Validation  Block the Critique
  • 15.  Graphics not Groans  Bullets, Bold and Beautiful
  • 16. 1. Triage and Nerf 2. Arguments and Rebuttals 3. Déjà vu all over again
  • 17.  If she says ‘that is nice dear…’  Pass the elevator test  iCRAP
  • 18. Q&A Session with Dr. Toga (2 minutes) 20
  • 19. Strategies for grant renewal Gage Crump, PhD Professor, Stem Cell Biology and Regenerative Medicine, Integrative Anatomical Sciences Eli and Edythe Broad CIRM Center for Regenerative Medicine and Stem Cell Research at USC 21
  • 20. What Reviewers Look for in R01 Renewal • Productivity • ~1 last-author publication per year of grant (bioRxiv and other pre-prints count toward total) • Minimum 1-2 papers in higher impact journals ** if productivity lower, consider new R01 instead • Significant New Direction • Avoid appearance of incremental advance • At least one aim significantly different than prior R01 • Bring in new co-I/collaborator ** renewal needs some connection to prior R01 ** ok to change title of renewal R01, grant number stays same
  • 21. Unique Aspects of R01 Renewal • Progress Report • ~1 page summarizing progress on each aim of prior R01 • Part of Research Strategy (counts toward 12-page limit) • Flexible where to insert (I typically place between Background and Preliminary Studies) • Progress Report Publications • Reviewers receive Summary Statement of R01 being renewed • Based on previous reviewer comments will get a sense of your previous aims, but will not have access to previous Specific Aims or Research Strategy sections • Its Ok to have changed directions or not completed some aims as long as you have published well
  • 22. Why to Renew vs. Submitting New R01 • Leverage strong publications in previous period • Build on previous grant with exciting new findings • Sympathy scoring for legacy grants – i.e. reviewers impressed with long-standing grants (I’ve seen some for 45th year but >~15 years may help)
  • 23. Q&A Session with Dr. Crump (2 minutes) 25
  • 24. Panel Discussion and Q&A Session (50 minutes) Please use the Q&A box to submit questions anytime 26
  • 25. What is your general approach to reviewing grants for study section? • What do you look at most closely? • Are there sections you place less emphasis? • How might your approach be different if you are primary vs secondary reviewer? 27
  • 26. What is your general approach to reviewing grants for study section? • What do you look at most closely? • Are there sections you place less emphasis? • How might your approach be different if you are primary vs secondary reviewer? 28
  • 27. What is your general approach to reviewing grants for study section? • What do you look at most closely? • Are there sections you place less emphasis? • How might your approach be different if you are primary vs secondary reviewer? 29
  • 28. 30 2. Common Mistakes on NIH Research Applications and How to Avoid them: • Specific Aims • Research Strategy • Significance • Innovation • Approach • Preliminary studies • Overall strategy • Methodology and analysis
  • 29. 2. Common Mistakes on NIH Research Applications and How to Avoid them: • Specific Aims • Research Strategy • Significance • Innovation • Approach • Preliminary studies • Overall strategy • Methodology and analysis
  • 30. 2. Common Mistakes on NIH Research Applications and How to Avoid them: • Specific Aims • Research Strategy • Significance • Innovation • Approach • Preliminary studies • Overall strategy • Methodology and analysis
  • 31. 2. Common Mistakes on NIH Research Applications and How to Avoid them: • Specific Aims • Research Strategy • Significance • Innovation • Approach • Preliminary studies • Overall strategy • Methodology and analysis
  • 32. 2. Common Mistakes on NIH Research Applications and How to Avoid them: • Specific Aims • Research Strategy • Significance • Innovation • Approach • Preliminary studies • Overall strategy • Methodology and analysis
  • 33. 2. Common Mistakes on NIH Research Applications and How to Avoid them: • Specific Aims • Research Strategy • Significance • Innovation • Approach • Preliminary studies • Overall strategy • Methodology and analysis
  • 35. 3. The Summary Statement: Now what? a.What is the role of your program officer in assistant with your interpretation or response to a statement? b.How do you read and interpret it – what matters most? Least? c. Whether and how do you construct a response and revision? d.What should you do about inaccuracies?
  • 36. 3. The Summary Statement: Now what? a. What is the role of your program officer in assistant with your interpretation or response to a statement? b.How do you read and interpret it – what matters most? Least? c. Whether and how do you construct a response and revision? d.What should you do about inaccuracies?
  • 37. Your feedback matters. Please complete the post meeting survey.
  • 38. Inside NIH Study Sections and Common Mistakes on NIH Applications: Advice from the Battleground September 1, 2021 1-2:30 p.m.

Editor's Notes

  • #7: Who is discussed first. What percentage gets discussed in each category? Discussion of new investigators. --over ambitious --over interpretation -- wait until the last minute --need to give the grant to the worst enemy --the younger the reviewers, the harder they are. --needs to be a coherent story without loose ends --innovative but not too innovative --what is innovation? Conceptual innovation: Eistein: being a genius is looking at something that everyone else is looking at but seeing it in a different way. Unique perspective Scientific innovation: you’ve got the goods. Technical innovation: technology. Investigators: you need an investigative team. It’s about team. Science is a team sport. Resubmission– Timing when to prepare and how many to submit. Terrible mistakes, and what to do. R03 or R21 doesn’t have ESI privilege. Approach section– twice the space for alternative approach as the actual approach.