Changes is NIH Review Changes is NIH Review Process and Grant Process and Grant Application FormsApplication Forms

Shirley M. MooreShirley M. MooreProfessor of Nursing and Professor of Nursing and

Associate Dean for ResearchAssociate Dean for ResearchFrances Payne Bolton Frances Payne Bolton

School of NursingSchool of NursingCase Western Reserve Case Western Reserve

UniversityUniversity

PEER REVIEWPEER REVIEW

2

Changes to Proposal ReviewsChanges to Proposal ReviewsBegan in May/June 2009 ReviewsBegan in May/June 2009 Reviews

Enhanced Review Criteria– Significance, Investigator(s), Innovation,

Approach, Environment New Templates for Structured Critiques

Scoring of Individual Review Criteria

New 1-9 Scoring Scale

3

Goals of the ChangesGoals of the Changes

Clearer understanding of the basis of application ratings

More emphasis on impact and less emphasis on technical details

Succinct, well-focused critiques that evaluate, rather than describe, applications

Routine use of the entire rating scale

4

ReviewsReviews

When reading applications the assigned reviewers : Identify major strengths and

weaknesses Assign scores of 1-9 to each of 5

“core” criteria Assign an overall impact/priority

score that ranges from 1-9

5

CritiquesCritiques

Written critiques:

Use of bulleted points to make succinct, focused comments

Short narratives may occasionally be appropriate, but are rare

Focus is on major strengths and weaknesses (ones that impacted the overall rating of the application)

6

Excerpt from a Critique TemplateExcerpt from a Critique Template

List major strengths and weaknesses List major strengths and weaknesses that influenced the overall that influenced the overall impact/priority score impact/priority score

Text limited to ¼ page per criterion, Text limited to ¼ page per criterion, although more text may occasionally although more text may occasionally be neededbe needed 7

Scoring of Individual Review Scoring of Individual Review CriteriaCriteria

There are 5 “core” criteria for most types of grant applications

For example, the core criteria for R01s are:– Significance– Investigator(s) – Innovation– Approach– Environment

9-point scale (1 = exceptional, 9 = poor) for the five “core” review criteria.

8

Overall Impact/Priority ScoresOverall Impact/Priority Scores

Criterion strengths and weaknesses considered in determining the overall impact/priority score

Reviewers encouraged to use the entire 1-9 range

9

Score Descriptor Additional Guidance on Strengths/Weaknesses

1 Exceptional Exceptionally strong with essentially no weaknesses

2 Outstanding Extremely strong with negligible weaknesses

3 Excellent Very strong with only some minor weaknesses

4 Very Good Strong but with numerous minor weaknesses

5 Good Strong but with at least one moderate weakness

6 Satisfactory Some strengths but also some moderate weaknesses

7 Fair Some strengths but with at least one major weakness

8 Marginal A few strengths and a few major weaknesses

9 Poor Very few strengths and numerous major weaknesses

Minor Weakness: An easily addressable weakness that does not substantially lessen impactModerate Weakness: A weakness that lessens impactMajor Weakness: A weakness that severely limits impact

Scoring DescriptionsScoring Descriptions

Scoring DescriptionsScoring Descriptions

11

Summary StatementsSummary Statements

Overall impact/priority scores of discussed applications are the mean of scores voted by all eligible reviewers, multiplied by 10

Final scores will range from 10-90, in whole numbers

Summary statements for ALL applications will include the criterion scores and critiques posted by assigned reviewers

12

13

IAR: New Header Information in Critique Preliminary IAR Critique now includes

criterion scores

Early Investigator and Early Investigator and New Investigator StatusNew Investigator Status

New Investigator

Early Investigator

14

Major Changes to Applications Major Changes to Applications

Major changes for due dates on or after Major changes for due dates on or after January 25, 2010January 25, 2010

– Restructured application formsRestructured application forms

– Shorter page limits and new Shorter page limits and new instructions instructions

For ALL competing applications:For ALL competing applications:New, Renewal, Resubmission, and RevisionNew, Renewal, Resubmission, and Revision

NOT-OD-09-149, NOT-OD-09-149, http://grants.nih.gov/grants/guide/notice-files/NOT-OD-09-http://grants.nih.gov/grants/guide/notice-files/NOT-OD-09-149.html149.html

Applicants Must Download New Applicants Must Download New FormsForms

for due dates on or after 1/25/10for due dates on or after 1/25/10

Applicants must return to FOA or reissued Parent Announcement to download new forms.

Most forms will be available by DecemberMost forms will be available by December

Applications submitted using incorrect forms will be delayed and may not Applications submitted using incorrect forms will be delayed and may not be reviewed!be reviewed!

Overview of the ChangesOverview of the Changes

Goal:Goal: Align structure and content of Align structure and content of applications with review criteria applications with review criteria and improve efficiency and and improve efficiency and transparency of the review processtransparency of the review process

– Application forms revised in three Application forms revised in three sections:sections:

– Research PlanResearch Plan– Biographical SketchBiographical Sketch– ResourcesResources and Facilitiesand Facilities

– Shorter page limitsShorter page limits

Research Plan:Research Plan: Specific AimsSpecific Aims

– Includes new language about the impact of the proposed research

Research Strategy Research Strategy – Background and Significance, Innovation, Approach,

includes Preliminary Studies/Progress Report Select Agents ResearchSelect Agents Research

- - Reflect the criterion

Resources:Resources: – Statement of how environment supports the proposed

research

Biographical Sketch: Biographical Sketch: – Requires a Personal Statement and provide guidelines

for the inclusion of references

Forms Revised in Three Forms Revised in Three SectionsSections

Shorter Page LimitsShorter Page Limits

Current Page Limit (Section 2-5 of the

Research Plan)

New Page Limit (Research Strategy)

<25 6

25 12

>25 Follow FOA InstructionsFollow FOA Instructions

Note: Follow FOA page limit requirements if different from the application instructions.Note: Follow FOA page limit requirements if different from the application instructions.

Table of Page Limits: http://enhancing-peer-review.nih.gov/page_limits.html

Introductions for revised and Introductions for revised and resubmission applications are resubmission applications are limited to 1 pagelimited to 1 page

20

For additional information:For additional information:

Enhancing Peer Review at NIH Web SiteEnhancing Peer Review at NIH Web Site

http://enhancing-peer-review.nih.gov

Thank you for your review service Thank you for your review service

21