Criteria for prioritizing topics for research
Visit NAP.edu/10766 to get more information about this book, to buy it in print, or to download it as a free PDF. Show « Previous: Appendix D: Approval Processes in Other Agencies and Other Countries Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Appendix E Examples of Criteria Used to Prioritize or Select Research ProjectsThis appendix provides excerpts from documents explaining project prioritization and selection criteria used by NSF, other agencies, and other countries. The majority of the text of this appendix consists of quoted material. The sources for these quotes are printed in italics, and explanatory material is enclosed in brackets. NATIONAL SCIENCE FOUNDATION (1)[Criteria for selecting projects for MREFC support, from Rita Colwell’s testimony before the House Committee on Science, Subcommittee on Research on September 6, 2001]
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × NATIONAL SCIENCE FOUNDATION (2)[Criteria for selection of projects for MREFC support, from Facilities Management and Oversight Guide, November 8, 2002]
NATIONAL SCIENCE FOUNDATION (3)[Criteria for selection of projects for future MREFC support, from Answers Provided by NSF to Questions from the House Science Committee Hearing on February 13, 2003]
NATIONAL SCIENCE FOUNDATION (4)[Criteria for placing highly rated projects in priority order, from Answers Provided by NSF to Questions from the House Science Committee Hearing on February 13, 2003]
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × NATIONAL SCIENCE BOARD[From NSB Resolution 02-191 adopted on November 21, 2002, Setting Priorities for Major Research Facilities]
HOUSE SCIENCE COMMITTEE[Priority setting, from H.R. 4664, Section 14A.3, the authorization bill for doubling NSF’s budget]
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × COSEPUP REPORT ON EVALUATING FEDERAL RESEARCH (1999)[Criteria for performance evaluation from Evaluating Federal Research Programs: Research and the Government Performance and Results Act, National Academies Press, 1999] For basic research programs, agencies should measure quality, relevance, and leadership.
OECD FORUM ON MEGASCIENCE POLICY ISSUES[Criteria for assigning priorities for major national research facilities, derived from Australian Science and Technology Council Reports by W. J. McG. Tegart, 1992] Benefits to Science and Technology Scientific objectives and their significance
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Unique characteristics
Degree of impact
International characteristics
Benefits to the Nation Industry objectives and their significance
Social objectives and their significance
International standing
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × NIH STRATEGY FOR SETTING RESEARCH PRIORITIES[From NIH Director Harold Varmus’s testimony before the House Appropriations Subcommittee on June 10, 1997]
THE NATIONAL RESEARCH PRIORITIES TASKFORCE[Discussion excerpted from a report commissioned by the Australian government, Developing National Research Priorities, 2002] Ultimately, for national priorities to be worthwhile they must have three important characteristics:
Based on this, the government has developed three criteria for assessing nominated priorities. These criteria will be used by the expert advisory committee in developing the short-list of priorities for government consideration.
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. ×
DECISION CRITERIA FOR EVALUATING AGRICULTURAL RESEARCH PRIORITIES[Report from Northeastern Regional Association of State Agricultural Experiment Station Directors, 1999] Selecting the topics for future research investments in agricultural science requires a rationale that is defensible, and a process that is, for the public sector, completely transparent. This document sets out a system of points-to-consider that could make up a new approach to setting criteria for decision making on resource allocations. The fundamental goal for setting agreed-to-decision criteria for allocating public sector agricultural research should be to gain the largest possible returns on research investment. This then requires consideration of four factors:
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. ×
SYSTEMATIC RESEARCH PRIORITY CRITERIA[From UK Systematics Forum on Priorities in Systematic (Biology) Research and Training, 1995]
UK DEPARTMENT OF HEALTH[Prioritization of the Policy Research Programme in collaboration with the R&D Directorate]
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. ×
GERMAN SCIENCE COUNCIL[From the German Wissenschaftsrat’s Large-scale Facilities for Basic Scientific Research, Working Group Report, 2003] Theses on the significance of large-scale facilities for basic scientific research:
Criteria and specific considerations: Expert Panel
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. ×
Policy Assessment Panel
[See Appendix D for additional information on this process.] UK OFFICE OF SCIENCE AND TECHNOLOGY[From UK Office of Science and Technology’s Large Facilities Strategic Roadmap Report, 2003] [The UK uses a “roadmap” portfolio approach to select projects for solicitation and a Gateway screening process that requires projects to meet certain conditions before moving forward. The concept behind the Gateway process is that all large capital investments should be managed as discrete projects and should be subject to review and independent scrutiny at all key stages in their life cycle. The Gateway Process is based on well-proven techniques that lead to more effective delivery of benefits together with more predictable costs and outcomes. The process considers the project at critical points in its development. These critical points are identified as Gateways. There are six Gateways during the lifecycle of a project, four before contract award and two looking at service implementation and confirmation of the operational benefits. The Process emphasizes early review for maximum added value.] The four-stage Gateway process:
Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. ×
[See Appendix D for additional information on this process.] Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × This page intentionally left blank. Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Suggested Citation:"Appendix E: Examples of Criteria Used to Prioritize or Select." National Research Council. 2004. Setting Priorities for Large Research Facility Projects Supported by the National Science Foundation. Washington, DC: The National Academies Press. doi: 10.17226/10895. × Next: Appendix F: NSF Background Materials » What are the prioritization criteria?Identify criteria for prioritization
Magnitude of the problem. Severity of the problem. Need among vulnerable populations. Community's capacity and willingness to act on the issue.
What is prioritization in research?Research prioritization deals with assigning ranks to research projects based on their importance to the science, organization, stakeholders, or the society at large so that the scare resources of the organization can be optimally employed.
How do you prioritize research findings?One thing is clear: Properly prioritizing research findings is a nuanced undertaking. Use these tips to get started in the right direction.. Align on internal objectives. ... . Know your users' priorities. ... . Consider impact versus effort. ... . Develop a prioritization rubric.. How do you prioritize a topic?How to prioritize work when everything's important. Have a list that contains all tasks in one.. Identify what's important: Understanding your true goals.. Highlight what's urgent.. Prioritize based on importance and urgency.. Avoid competing priorities.. Consider effort.. Review constantly and be realistic.. |