Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review

The quantification of uncertainty is an increasingly popular topic, with clear importance for climate change policy. However, uncertainty assessments are open to a range of interpretations, each of which may lead to a different policy recommendation. In the EQUIP project researchers from the UK clim...

Full description

Bibliographic Details
Main Authors: Wesselink A, Challinor, Andrew J., Watson, J., Beven, K., Allen I, Hanlon H, López, A., Lorenz S, Otto F, Morse, Andy, Rye C, Saux-Picard S, Stainforth D, Suckling E
Format: Journal Article
Language:Inglés
Published: Springer 2015
Subjects:
Online Access:https://hdl.handle.net/10568/75780
_version_ 1855537966562148352
author Wesselink A
Challinor, Andrew J.
Watson, J.
Beven, K.
Allen I
Hanlon H
López, A.
Lorenz S
Otto F
Morse, Andy
Rye C
Saux-Picard S
Stainforth D
Suckling E
author_browse Allen I
Beven, K.
Challinor, Andrew J.
Hanlon H
Lorenz S
López, A.
Morse, Andy
Otto F
Rye C
Saux-Picard S
Stainforth D
Suckling E
Watson, J.
Wesselink A
author_facet Wesselink A
Challinor, Andrew J.
Watson, J.
Beven, K.
Allen I
Hanlon H
López, A.
Lorenz S
Otto F
Morse, Andy
Rye C
Saux-Picard S
Stainforth D
Suckling E
author_sort Wesselink A
collection Repository of Agricultural Research Outputs (CGSpace)
description The quantification of uncertainty is an increasingly popular topic, with clear importance for climate change policy. However, uncertainty assessments are open to a range of interpretations, each of which may lead to a different policy recommendation. In the EQUIP project researchers from the UK climate modelling, statistical modelling, and impacts communities worked together on ‘end-to-end’ uncertainty assessments of climate change and its impacts. Here, we use an experiment in peer review amongst project members to assess variation in the assessment of uncertainties between EQUIP researchers. We find overall agreement on key sources of uncertainty but a large variation in the assessment of the methods used for uncertainty assessment. Results show that communication aimed at specialists makes the methods used harder to assess. There is also evidence of individual bias, which is partially attributable to disciplinary backgrounds. However, varying views on the methods used to quantify uncertainty did not preclude consensus on the consequential results produced using those methods. Based on our analysis, we make recommendations for developing and presenting statements on climate and its impacts. These include the use of a common uncertainty reporting format in order to make assumptions clear; presentation of results in terms of processes and trade-offs rather than only numerical ranges; and reporting multiple assessments of uncertainty in order to elucidate a more complete picture of impacts and their uncertainties. This in turn implies research should be done by teams of people with a range of backgrounds and time for interaction and discussion, with fewer but more comprehensive outputs in which the range of opinions is recorded.
format Journal Article
id CGSpace75780
institution CGIAR Consortium
language Inglés
publishDate 2015
publishDateRange 2015
publishDateSort 2015
publisher Springer
publisherStr Springer
record_format dspace
spelling CGSpace757802024-05-15T05:12:09Z Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review Wesselink A Challinor, Andrew J. Watson, J. Beven, K. Allen I Hanlon H López, A. Lorenz S Otto F Morse, Andy Rye C Saux-Picard S Stainforth D Suckling E climate change agriculture food security The quantification of uncertainty is an increasingly popular topic, with clear importance for climate change policy. However, uncertainty assessments are open to a range of interpretations, each of which may lead to a different policy recommendation. In the EQUIP project researchers from the UK climate modelling, statistical modelling, and impacts communities worked together on ‘end-to-end’ uncertainty assessments of climate change and its impacts. Here, we use an experiment in peer review amongst project members to assess variation in the assessment of uncertainties between EQUIP researchers. We find overall agreement on key sources of uncertainty but a large variation in the assessment of the methods used for uncertainty assessment. Results show that communication aimed at specialists makes the methods used harder to assess. There is also evidence of individual bias, which is partially attributable to disciplinary backgrounds. However, varying views on the methods used to quantify uncertainty did not preclude consensus on the consequential results produced using those methods. Based on our analysis, we make recommendations for developing and presenting statements on climate and its impacts. These include the use of a common uncertainty reporting format in order to make assumptions clear; presentation of results in terms of processes and trade-offs rather than only numerical ranges; and reporting multiple assessments of uncertainty in order to elucidate a more complete picture of impacts and their uncertainties. This in turn implies research should be done by teams of people with a range of backgrounds and time for interaction and discussion, with fewer but more comprehensive outputs in which the range of opinions is recorded. 2015-09 2016-06-22T17:11:40Z 2016-06-22T17:11:40Z Journal Article https://hdl.handle.net/10568/75780 en Open Access Springer Wesselink A, Challinor AJ, Watson J, Beven K, Allen I, Hanlon H, Lopez A, Lorenz S, Otto F, Morse A, Rye C, Saux-Picard S, Stainforth D, Suckling E. 2015. Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review. Climatic Change 132(1):1-14.
spellingShingle climate change
agriculture
food security
Wesselink A
Challinor, Andrew J.
Watson, J.
Beven, K.
Allen I
Hanlon H
López, A.
Lorenz S
Otto F
Morse, Andy
Rye C
Saux-Picard S
Stainforth D
Suckling E
Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review
title Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review
title_full Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review
title_fullStr Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review
title_full_unstemmed Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review
title_short Equipped to deal with uncertainty in climate and impacts predictions: lessons from internal peer review
title_sort equipped to deal with uncertainty in climate and impacts predictions lessons from internal peer review
topic climate change
agriculture
food security
url https://hdl.handle.net/10568/75780
work_keys_str_mv AT wesselinka equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT challinorandrewj equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT watsonj equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT bevenk equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT alleni equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT hanlonh equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT lopeza equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT lorenzs equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT ottof equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT morseandy equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT ryec equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT sauxpicards equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT stainforthd equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview
AT sucklinge equippedtodealwithuncertaintyinclimateandimpactspredictionslessonsfrominternalpeerreview