Evaluating quality of science in CGIAR research programs: Use of bibliometrics

When evaluating Quality of Science (QoS) in the context of development initiatives, it is essential to define adequate criteria. The objective of this perspective paper is to show how altmetric and bibliometric indicators have been used to support the evaluation of QoS in the 2020 Review of the Phas...

Full description

Bibliographic Details
Main Authors: Rünzel, Max, Sarfatti, Paolo., Negroustoueva, Svetlana
Format: Journal Article
Language:Inglés
Published: SAGE Publications 2021
Subjects:
Online Access:https://hdl.handle.net/10568/117659
_version_ 1855525742942617600
author Rünzel, Max
Sarfatti, Paolo.
Negroustoueva, Svetlana
author_browse Negroustoueva, Svetlana
Rünzel, Max
Sarfatti, Paolo.
author_facet Rünzel, Max
Sarfatti, Paolo.
Negroustoueva, Svetlana
author_sort Rünzel, Max
collection Repository of Agricultural Research Outputs (CGSpace)
description When evaluating Quality of Science (QoS) in the context of development initiatives, it is essential to define adequate criteria. The objective of this perspective paper is to show how altmetric and bibliometric indicators have been used to support the evaluation of QoS in the 2020 Review of the Phase 2-CGIAR Research Programs (CRPs, 2017–2022), where, for the first time, the Quality of Research for Development (QoR4D) frame of reference has been utilized across the entire CGIAR CRP portfolio. Overall, the CRP review showed a significant output of scientific publications during the period 2017–2020, with 4,872 articles, 220,101 references, and 7.1 citations per article. Additionally, wider interest in scientific publications is demonstrated by good to high altmetrics, with average attention scores ranging from 70.8 to 806.9 with an average of 425.1. The use of selected bibliometrics was shown to be an adequate tool, for use together with other qualitative indicators to evaluate the QoS in the 12 CRPs. The CRP review process clearly demonstrated that standardized, harmonized and consistent data on research output is paramount to provide high-quality quantitative instruments and should be a priority throughout the transition toward One CGIAR. Therefore, we conclude that the QoR4D framework should be augmented by standardized bibliometric indicators embedded in measurement frameworks within the new One CGIAR. Finally, its practical utilization in monitoring and evaluation should be supported with clear guidelines.
format Journal Article
id CGSpace117659
institution CGIAR Consortium
language Inglés
publishDate 2021
publishDateRange 2021
publishDateSort 2021
publisher SAGE Publications
publisherStr SAGE Publications
record_format dspace
spelling CGSpace1176592023-10-02T08:35:16Z Evaluating quality of science in CGIAR research programs: Use of bibliometrics Rünzel, Max Sarfatti, Paolo. Negroustoueva, Svetlana research agriculture evaluation When evaluating Quality of Science (QoS) in the context of development initiatives, it is essential to define adequate criteria. The objective of this perspective paper is to show how altmetric and bibliometric indicators have been used to support the evaluation of QoS in the 2020 Review of the Phase 2-CGIAR Research Programs (CRPs, 2017–2022), where, for the first time, the Quality of Research for Development (QoR4D) frame of reference has been utilized across the entire CGIAR CRP portfolio. Overall, the CRP review showed a significant output of scientific publications during the period 2017–2020, with 4,872 articles, 220,101 references, and 7.1 citations per article. Additionally, wider interest in scientific publications is demonstrated by good to high altmetrics, with average attention scores ranging from 70.8 to 806.9 with an average of 425.1. The use of selected bibliometrics was shown to be an adequate tool, for use together with other qualitative indicators to evaluate the QoS in the 12 CRPs. The CRP review process clearly demonstrated that standardized, harmonized and consistent data on research output is paramount to provide high-quality quantitative instruments and should be a priority throughout the transition toward One CGIAR. Therefore, we conclude that the QoR4D framework should be augmented by standardized bibliometric indicators embedded in measurement frameworks within the new One CGIAR. Finally, its practical utilization in monitoring and evaluation should be supported with clear guidelines. 2021-06 2022-01-20T18:41:49Z 2022-01-20T18:41:49Z Journal Article https://hdl.handle.net/10568/117659 en Open Access SAGE Publications Rünzel, M., Sarfatti, P., and Negroustoueva, S. (2021). Evaluating quality of science in CGIAR research programs: Use of bibliometrics. Outlook on Agriculture 50(2): 130-140.
spellingShingle research
agriculture
evaluation
Rünzel, Max
Sarfatti, Paolo.
Negroustoueva, Svetlana
Evaluating quality of science in CGIAR research programs: Use of bibliometrics
title Evaluating quality of science in CGIAR research programs: Use of bibliometrics
title_full Evaluating quality of science in CGIAR research programs: Use of bibliometrics
title_fullStr Evaluating quality of science in CGIAR research programs: Use of bibliometrics
title_full_unstemmed Evaluating quality of science in CGIAR research programs: Use of bibliometrics
title_short Evaluating quality of science in CGIAR research programs: Use of bibliometrics
title_sort evaluating quality of science in cgiar research programs use of bibliometrics
topic research
agriculture
evaluation
url https://hdl.handle.net/10568/117659
work_keys_str_mv AT runzelmax evaluatingqualityofscienceincgiarresearchprogramsuseofbibliometrics
AT sarfattipaolo evaluatingqualityofscienceincgiarresearchprogramsuseofbibliometrics
AT negroustouevasvetlana evaluatingqualityofscienceincgiarresearchprogramsuseofbibliometrics