Last year we told you that NIH was seeking public input on its intention to potentially modify application review criteria. NIH has now released results from that request for information (RFI). We recap it for you below, but first a brief reminder of the proposed changes.
Under the existing criteria, applications for research project grants (the “R” grants) are evaluated based on Significance, Investigators, Innovation, Approach, and Environment.
Under the new scoring criteria, grants will be evaluated as follows:
- Factor 1: Importance of the Research (Significance, Innovation), numerical score (1-9)
- Factor 2: Rigor and Feasibility (Approach), numerical score (1-9)
- Factor 3: Expertise and Resources (Investigator, Environment), assessed and considered in the Overall Impact Score, but not individually scored.
If you want to read more about how the current criteria would map to the new one and the history behind this proposed change, check out our original post.
Results
NIH received nearly 800 responses from individuals, 30 from scientific societies, and 30 from academic institutions. There was majority support for the proposed changes. Respondents felt that the changes would achieve the intended goal of refocusing reviewers on the truly important elements that identify impactful research. This would be accomplished via: (1) reduced burden – reviewers would need to focus on fewer elements and a simplified process; (2) better emphasis on key evaluations, and (3) reduced impact of global reputation of the investigator and environment in favor of a focus on evaluation in the context of the research proposed.
Respondents also requested clearer definitions of Innovation, Feasibility and Rigor, and the investigative team, noting that better definitions would help reviewers make unbiased reviews. Respondents also commented that NIH should develop strong training for reviewers so that they are well-prepared to execute the new criteria.
A trans-NIH committee has been established to implement the changes for simplifying review criteria. A timeline is under development, as are a rollout and trainings. We’ll update you as soon as further information is shared.
The full report contains information regarding the methods of the RFI, detailed respondent feedback, and additional insight and considerations.
