Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries
Policy research, particularly when focused on the problems of developing countries, is under pressure by key investors to justify its impact compared to other types of development assistance that produce more tangible outcomes (e.g., roads, schools, and plant breeding). This pressure has led to a gr...
| Autores principales: | , , , |
|---|---|
| Formato: | Artículo preliminar |
| Lenguaje: | Inglés |
| Publicado: |
International Food Policy Research Institute
2018
|
| Materias: | |
| Acceso en línea: | https://hdl.handle.net/10568/146894 |
| _version_ | 1855518982893731840 |
|---|---|
| author | Slade, Roger Renkow, Mitch Place, Frank Hazell, Peter B. R. |
| author_browse | Hazell, Peter B. R. Place, Frank Renkow, Mitch Slade, Roger |
| author_facet | Slade, Roger Renkow, Mitch Place, Frank Hazell, Peter B. R. |
| author_sort | Slade, Roger |
| collection | Repository of Agricultural Research Outputs (CGSpace) |
| description | Policy research, particularly when focused on the problems of developing countries, is under pressure by key investors to justify its impact compared to other types of development assistance that produce more tangible outcomes (e.g., roads, schools, and plant breeding). This pressure has led to a growing literature about appropriate methods for evaluating policy research as well as many evaluation case studies, particularly for policy research addressing agriculture, food and rural poverty issuesrural policy research for short. This paper reviews the relevant literature and finds that while many studies have successfully demonstrated plausible narratives about how specific lines of policy research have contributed to policy change, few have gone the next step and quantified the impact of the policy change that was influenced, and even fewer have gone the final step to calculate a rate of economic or social return to the policy research investment being evaluated. This is in marked contrast to the rapid growth in rigorous quantitative evaluations of many other types of development assistance investments. This paper seeks to identify factors constraining the rigorous evaluation of more policy research, and draws on existing evaluation studies of rural policy research to identify best practice lessons for each of the steps involved in an impact evaluation. The paper concludes that although underlying conceptual, data, and measurement problems constrain what can be done for many types of policy research, there is still scope for more quantitative assessments of policy research. However, a first priority should be good qualitative evaluations of policy influence, both as a means to better understanding how policy research can be more influential, but also as a necessary first step in any evaluation for without demonstrated policy influence there is no need to evaluate policy outcomes and impacts. A cautionary note is that too tight a focus on quantitative evaluations by investors could inadvertently bias the policy research agenda towards problems that are amenable to rigorous assessment and not necessarily to those that are most important or beneficial. |
| format | Artículo preliminar |
| id | CGSpace146894 |
| institution | CGIAR Consortium |
| language | Inglés |
| publishDate | 2018 |
| publishDateRange | 2018 |
| publishDateSort | 2018 |
| publisher | International Food Policy Research Institute |
| publisherStr | International Food Policy Research Institute |
| record_format | dspace |
| spelling | CGSpace1468942025-11-06T05:37:28Z Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries Slade, Roger Renkow, Mitch Place, Frank Hazell, Peter B. R. rural poverty food policies agricultural policies cost benefit analysis agricultural research evaluation policy analysis returns impact assessment Policy research, particularly when focused on the problems of developing countries, is under pressure by key investors to justify its impact compared to other types of development assistance that produce more tangible outcomes (e.g., roads, schools, and plant breeding). This pressure has led to a growing literature about appropriate methods for evaluating policy research as well as many evaluation case studies, particularly for policy research addressing agriculture, food and rural poverty issuesrural policy research for short. This paper reviews the relevant literature and finds that while many studies have successfully demonstrated plausible narratives about how specific lines of policy research have contributed to policy change, few have gone the next step and quantified the impact of the policy change that was influenced, and even fewer have gone the final step to calculate a rate of economic or social return to the policy research investment being evaluated. This is in marked contrast to the rapid growth in rigorous quantitative evaluations of many other types of development assistance investments. This paper seeks to identify factors constraining the rigorous evaluation of more policy research, and draws on existing evaluation studies of rural policy research to identify best practice lessons for each of the steps involved in an impact evaluation. The paper concludes that although underlying conceptual, data, and measurement problems constrain what can be done for many types of policy research, there is still scope for more quantitative assessments of policy research. However, a first priority should be good qualitative evaluations of policy influence, both as a means to better understanding how policy research can be more influential, but also as a necessary first step in any evaluation for without demonstrated policy influence there is no need to evaluate policy outcomes and impacts. A cautionary note is that too tight a focus on quantitative evaluations by investors could inadvertently bias the policy research agenda towards problems that are amenable to rigorous assessment and not necessarily to those that are most important or beneficial. 2018-12-20 2024-06-21T09:09:23Z 2024-06-21T09:09:23Z Working Paper https://hdl.handle.net/10568/146894 en https://hdl.handle.net/10568/150601 Open Access application/pdf International Food Policy Research Institute Slade, Roger; Renkow, Mitch; Place, Frank; and Hazell, Peter B. R. 2018. Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries. IFPRI Discussion Paper 1779. Washington, DC: International Food Policy Research Institute (IFPRI). https://hdl.handle.net/10568/146894 |
| spellingShingle | rural poverty food policies agricultural policies cost benefit analysis agricultural research evaluation policy analysis returns impact assessment Slade, Roger Renkow, Mitch Place, Frank Hazell, Peter B. R. Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries |
| title | Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries |
| title_full | Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries |
| title_fullStr | Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries |
| title_full_unstemmed | Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries |
| title_short | Evaluating the impact of policy research: Lessons from the evaluation of rural policy research in developing countries |
| title_sort | evaluating the impact of policy research lessons from the evaluation of rural policy research in developing countries |
| topic | rural poverty food policies agricultural policies cost benefit analysis agricultural research evaluation policy analysis returns impact assessment |
| url | https://hdl.handle.net/10568/146894 |
| work_keys_str_mv | AT sladeroger evaluatingtheimpactofpolicyresearchlessonsfromtheevaluationofruralpolicyresearchindevelopingcountries AT renkowmitch evaluatingtheimpactofpolicyresearchlessonsfromtheevaluationofruralpolicyresearchindevelopingcountries AT placefrank evaluatingtheimpactofpolicyresearchlessonsfromtheevaluationofruralpolicyresearchindevelopingcountries AT hazellpeterbr evaluatingtheimpactofpolicyresearchlessonsfromtheevaluationofruralpolicyresearchindevelopingcountries |