Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR)
Ex post impact assessment (epIA) is often promoted as a method of illustrating to funding bodies that agricultural research investments are effectively contributing to the achievement of development goals. In response, impact assessors have produced a great deal of evidence that international agr...
| Main Authors: | , |
|---|---|
| Format: | Informe técnico |
| Language: | Inglés |
| Published: |
CGIAR System Organization
2005
|
| Subjects: | |
| Online Access: | https://hdl.handle.net/10568/76143 |
| _version_ | 1855541633891696640 |
|---|---|
| author | Raitzer, David A. Winkel, Klaus |
| author_browse | Raitzer, David A. Winkel, Klaus |
| author_facet | Raitzer, David A. Winkel, Klaus |
| author_sort | Raitzer, David A. |
| collection | Repository of Agricultural Research Outputs (CGSpace) |
| description | Ex post impact assessment (epIA) is often promoted as a method of illustrating to funding
bodies that agricultural research investments are effectively contributing to the achievement
of development goals. In response, impact assessors have produced a great deal of evidence
that international agricultural research is an efficient and effective form of investment.
Despite these results, international agricultural research, including the activities of the Centres
of the CGIAR, has at times faced funding shortages. This may indicate that the evidence
produced has not been entirely persuasive.
To help foster a more demand-led approach to epIA, this analysis investigates the information
demands of CGIAR Members (donors), the primary audience for accountability–oriented
epIA studies. Two methods were applied to analyse information demands and uses. First, an
email survey of all CGIAR Members was conducted, so as to ascertain preferences for
different epIA approaches, methods, and metrics. Subsequently, a series of interviews of
donor representatives was used to explore in more detail how the results from epIA contribute
to funding decisions.
The 24 email survey responses received from 22 Member agencies indicate high demand for
impact related information. Analyses of impact “far down the impact pathway” with metrics
directly related to poverty and improved livelihoods are most frequently claimed to be most
useful. Similarly, a majority of respondents report that the “magnitude and distribution of
benefits” is the primary determinant of the use of epIA findings. EpIA conduct by an external
assessor is reported as important for credibility by most respondents.
Follow-up interviews of representatives of 26 CGIAR Members illustrate that agricultural
research funding decisions within Member agencies are complex, and the consideration of
patterns of past impact in these deliberations is often less than central. Other factors, such as
political priorities, perceptions of scientific quality, and desires for funding continuity also
play prominent roles in these decisions, and decision-makers face an onslaught of many forms
of information apart from epIA findings. In this context, brief summaries of epIA results are
critical to capture attention, and the influence of findings is often indirect and “conceptual.”
Despite the indirect nature of this influence, the interviews reiterated strong demands for
evidence of impact.
A number of Members indicated that the transparency of impact studies could be improved,
as certain analyses have been assumption-laden, and sufficient details about the assessed
research have not been provided in some cases. These audiences also appear to demand epIA
of a broader range of research activities, as “comprehensiveness of coverage” received
2
relatively low ratings. Finally, a greater focus on poverty-related metrics and the distribution
of assessed benefits was demanded by a large proportion of interviewees.
Responses are compared with patterns documented in the broader evaluation literature. The
observations of the present study are generally consistent with prior findings that indirect use
is predominant. In addition, the information preferences observed, when compared with
approaches advocated for internal feedback in the evaluation literature, suggest that the
information demands of donors may differ from those of internal audiences. |
| format | Informe técnico |
| id | CGSpace76143 |
| institution | CGIAR Consortium |
| language | Inglés |
| publishDate | 2005 |
| publishDateRange | 2005 |
| publishDateSort | 2005 |
| publisher | CGIAR System Organization |
| publisherStr | CGIAR System Organization |
| record_format | dspace |
| spelling | CGSpace761432025-08-18T06:41:19Z Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR) Raitzer, David A. Winkel, Klaus impact assessment funding gender Ex post impact assessment (epIA) is often promoted as a method of illustrating to funding bodies that agricultural research investments are effectively contributing to the achievement of development goals. In response, impact assessors have produced a great deal of evidence that international agricultural research is an efficient and effective form of investment. Despite these results, international agricultural research, including the activities of the Centres of the CGIAR, has at times faced funding shortages. This may indicate that the evidence produced has not been entirely persuasive. To help foster a more demand-led approach to epIA, this analysis investigates the information demands of CGIAR Members (donors), the primary audience for accountability–oriented epIA studies. Two methods were applied to analyse information demands and uses. First, an email survey of all CGIAR Members was conducted, so as to ascertain preferences for different epIA approaches, methods, and metrics. Subsequently, a series of interviews of donor representatives was used to explore in more detail how the results from epIA contribute to funding decisions. The 24 email survey responses received from 22 Member agencies indicate high demand for impact related information. Analyses of impact “far down the impact pathway” with metrics directly related to poverty and improved livelihoods are most frequently claimed to be most useful. Similarly, a majority of respondents report that the “magnitude and distribution of benefits” is the primary determinant of the use of epIA findings. EpIA conduct by an external assessor is reported as important for credibility by most respondents. Follow-up interviews of representatives of 26 CGIAR Members illustrate that agricultural research funding decisions within Member agencies are complex, and the consideration of patterns of past impact in these deliberations is often less than central. Other factors, such as political priorities, perceptions of scientific quality, and desires for funding continuity also play prominent roles in these decisions, and decision-makers face an onslaught of many forms of information apart from epIA findings. In this context, brief summaries of epIA results are critical to capture attention, and the influence of findings is often indirect and “conceptual.” Despite the indirect nature of this influence, the interviews reiterated strong demands for evidence of impact. A number of Members indicated that the transparency of impact studies could be improved, as certain analyses have been assumption-laden, and sufficient details about the assessed research have not been provided in some cases. These audiences also appear to demand epIA of a broader range of research activities, as “comprehensiveness of coverage” received 2 relatively low ratings. Finally, a greater focus on poverty-related metrics and the distribution of assessed benefits was demanded by a large proportion of interviewees. Responses are compared with patterns documented in the broader evaluation literature. The observations of the present study are generally consistent with prior findings that indirect use is predominant. In addition, the information preferences observed, when compared with approaches advocated for internal feedback in the evaluation literature, suggest that the information demands of donors may differ from those of internal audiences. 2005 2016-07-12T18:30:15Z 2016-07-12T18:30:15Z Report https://hdl.handle.net/10568/76143 en Open Access application/pdf CGIAR System Organization Raitzer, David; Winkel, Klaus. 2005. Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR). Cali, Colombia: CGIAR. |
| spellingShingle | impact assessment funding gender Raitzer, David A. Winkel, Klaus Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR) |
| title | Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR) |
| title_full | Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR) |
| title_fullStr | Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR) |
| title_full_unstemmed | Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR) |
| title_short | Donor demands and uses for evidence of research impact - the case of the Consultative Group on International Agricultural Research (CGIAR) |
| title_sort | donor demands and uses for evidence of research impact the case of the consultative group on international agricultural research cgiar |
| topic | impact assessment funding gender |
| url | https://hdl.handle.net/10568/76143 |
| work_keys_str_mv | AT raitzerdavida donordemandsandusesforevidenceofresearchimpactthecaseoftheconsultativegrouponinternationalagriculturalresearchcgiar AT winkelklaus donordemandsandusesforevidenceofresearchimpactthecaseoftheconsultativegrouponinternationalagriculturalresearchcgiar |