Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research

There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to fa...

Descripción completa

Detalles Bibliográficos
Autores principales: Delaney, Aogán, Tamás, Peter A., Crane, Todd A., Chesterman, Sabrina
Formato: Journal Article
Lenguaje:Inglés
Publicado: Public Library of Science 2016
Materias:
Acceso en línea:https://hdl.handle.net/10568/89874
_version_ 1855537967682027520
author Delaney, Aogán
Tamás, Peter A.
Crane, Todd A.
Chesterman, Sabrina
author_browse Chesterman, Sabrina
Crane, Todd A.
Delaney, Aogán
Tamás, Peter A.
author_facet Delaney, Aogán
Tamás, Peter A.
Crane, Todd A.
Chesterman, Sabrina
author_sort Delaney, Aogán
collection Repository of Agricultural Research Outputs (CGSpace)
description There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts’ commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research.
format Journal Article
id CGSpace89874
institution CGIAR Consortium
language Inglés
publishDate 2016
publishDateRange 2016
publishDateSort 2016
publisher Public Library of Science
publisherStr Public Library of Science
record_format dspace
spelling CGSpace898742024-05-15T05:12:09Z Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research Delaney, Aogán Tamás, Peter A. Crane, Todd A. Chesterman, Sabrina climate change agriculture food security There is increasing interest in using systematic review to synthesize evidence on the social and environmental effects of and adaptations to climate change. Use of systematic review for evidence in this field is complicated by the heterogeneity of methods used and by uneven reporting. In order to facilitate synthesis of results and design of subsequent research a method, construct-centered methods aggregation, was designed to 1) provide a transparent, valid and reliable description of research methods, 2) support comparability of primary studies and 3) contribute to a shared empirical basis for improving research practice. Rather than taking research reports at face value, research designs are reviewed through inductive analysis. This involves bottom-up identification of constructs, definitions and operationalizations; assessment of concepts’ commensurability through comparison of definitions; identification of theoretical frameworks through patterns of construct use; and integration of transparently reported and valid operationalizations into ideal-type research frameworks. Through the integration of reliable bottom-up inductive coding from operationalizations and top-down coding driven from stated theory with expert interpretation, construct-centered methods aggregation enabled both resolution of heterogeneity within identically named constructs and merging of differently labeled but identical constructs. These two processes allowed transparent, rigorous and contextually sensitive synthesis of the research presented in an uneven set of reports undertaken in a heterogenous field. If adopted more broadly, construct-centered methods aggregation may contribute to the emergence of a valid, empirically-grounded description of methods used in primary research. These descriptions may function as a set of expectations that improves the transparency of reporting and as an evolving comprehensive framework that supports both interpretation of existing and design of future research. 2016-02-22 2017-12-31T15:45:59Z 2017-12-31T15:45:59Z Journal Article https://hdl.handle.net/10568/89874 en Open Access Public Library of Science Delaney A, Tamás PA, Crane TA, Chesterman S. 2016. Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research. PLoS One 11(2):e0149071.
spellingShingle climate change
agriculture
food security
Delaney, Aogán
Tamás, Peter A.
Crane, Todd A.
Chesterman, Sabrina
Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research
title Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research
title_full Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research
title_fullStr Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research
title_full_unstemmed Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research
title_short Systematic Review of Methods in Low-Consensus Fields: Supporting Commensuration through `Construct-Centered Methods Aggregation’ in the Case of Climate Change Vulnerability Research
title_sort systematic review of methods in low consensus fields supporting commensuration through construct centered methods aggregation in the case of climate change vulnerability research
topic climate change
agriculture
food security
url https://hdl.handle.net/10568/89874
work_keys_str_mv AT delaneyaogan systematicreviewofmethodsinlowconsensusfieldssupportingcommensurationthroughconstructcenteredmethodsaggregationinthecaseofclimatechangevulnerabilityresearch
AT tamaspetera systematicreviewofmethodsinlowconsensusfieldssupportingcommensurationthroughconstructcenteredmethodsaggregationinthecaseofclimatechangevulnerabilityresearch
AT cranetodda systematicreviewofmethodsinlowconsensusfieldssupportingcommensurationthroughconstructcenteredmethodsaggregationinthecaseofclimatechangevulnerabilityresearch
AT chestermansabrina systematicreviewofmethodsinlowconsensusfieldssupportingcommensurationthroughconstructcenteredmethodsaggregationinthecaseofclimatechangevulnerabilityresearch