How to keep it adequate: A protocol for ensuring validity in agent-based simulation

There has so far been no shared understanding of validity in agent-based simulation. We here conceptualise validation as systematically substantiating the premises on which conclusions from simulation analysis for a particular modelling context are built. Given such a systematic perspective, validit...

Descripción completa

Detalles Bibliográficos
Autores principales: Troost, Christian, Huber, Robert, Bell, Andrew, Delden, Hedwig, Filatova, Tatiana, Le, Quang Bao, Lippe, Melvin, Niamir, Leila, Polhill, Gareth, Sun, Zhanli, Berger, Thomas
Formato: Journal Article
Lenguaje:Inglés
Publicado: Elsevier 2023
Materias:
Acceso en línea:https://hdl.handle.net/10568/134582
_version_ 1855520101647777792
author Troost, Christian
Huber, Robert
Bell, Andrew
Delden, Hedwig
Filatova, Tatiana
Le, Quang Bao
Lippe, Melvin
Niamir, Leila
Polhill, Gareth
Sun, Zhanli
Berger, Thomas
author_browse Bell, Andrew
Berger, Thomas
Delden, Hedwig
Filatova, Tatiana
Huber, Robert
Le, Quang Bao
Lippe, Melvin
Niamir, Leila
Polhill, Gareth
Sun, Zhanli
Troost, Christian
author_facet Troost, Christian
Huber, Robert
Bell, Andrew
Delden, Hedwig
Filatova, Tatiana
Le, Quang Bao
Lippe, Melvin
Niamir, Leila
Polhill, Gareth
Sun, Zhanli
Berger, Thomas
author_sort Troost, Christian
collection Repository of Agricultural Research Outputs (CGSpace)
description There has so far been no shared understanding of validity in agent-based simulation. We here conceptualise validation as systematically substantiating the premises on which conclusions from simulation analysis for a particular modelling context are built. Given such a systematic perspective, validity of agent-based models cannot be ensured if validation is merely understood as an isolated step in the modelling process. Rather, valid conclusions from simulation analysis require context-adequate method choices at all steps of the simulation analysis including model construction, model and parameter inference, uncertainty analysis and simulation. We present a twelve-step protocol to highlight the (often hidden) premises for methodological choices and their link to the modelling context. It is designed to aid modelers in understanding their context and in choosing and documenting context-adequate and mutually consistent methods throughout the modelling process. Its purpose is to assist reviewers and the community as a whole in assessing and discussing context-adequacy.
format Journal Article
id CGSpace134582
institution CGIAR Consortium
language Inglés
publishDate 2023
publishDateRange 2023
publishDateSort 2023
publisher Elsevier
publisherStr Elsevier
record_format dspace
spelling CGSpace1345822026-01-14T02:04:31Z How to keep it adequate: A protocol for ensuring validity in agent-based simulation Troost, Christian Huber, Robert Bell, Andrew Delden, Hedwig Filatova, Tatiana Le, Quang Bao Lippe, Melvin Niamir, Leila Polhill, Gareth Sun, Zhanli Berger, Thomas agent-based models calibration model model validation model interface generalization regime shift There has so far been no shared understanding of validity in agent-based simulation. We here conceptualise validation as systematically substantiating the premises on which conclusions from simulation analysis for a particular modelling context are built. Given such a systematic perspective, validity of agent-based models cannot be ensured if validation is merely understood as an isolated step in the modelling process. Rather, valid conclusions from simulation analysis require context-adequate method choices at all steps of the simulation analysis including model construction, model and parameter inference, uncertainty analysis and simulation. We present a twelve-step protocol to highlight the (often hidden) premises for methodological choices and their link to the modelling context. It is designed to aid modelers in understanding their context and in choosing and documenting context-adequate and mutually consistent methods throughout the modelling process. Its purpose is to assist reviewers and the community as a whole in assessing and discussing context-adequacy. 2023-01-31 2023-11-21T16:37:24Z 2023-11-21T16:37:24Z Journal Article https://hdl.handle.net/10568/134582 en Open Access application/pdf Elsevier Troost, C. Huber, R. Bell, A. R. van Delden, H. Filatova, T. Le, Q. B. Lippe, M. Niamir, L. Polhill, J. G. Sun, Z. Berger, T. 2023. How to keep it adequate: A protocol for ensuring validity in agent-based simulation. Environmental Modelling & Software 159, 105559. DOI: https://doi.org/10.1016/j.envsoft.2022.105559
spellingShingle agent-based models
calibration model
model validation
model interface
generalization
regime shift
Troost, Christian
Huber, Robert
Bell, Andrew
Delden, Hedwig
Filatova, Tatiana
Le, Quang Bao
Lippe, Melvin
Niamir, Leila
Polhill, Gareth
Sun, Zhanli
Berger, Thomas
How to keep it adequate: A protocol for ensuring validity in agent-based simulation
title How to keep it adequate: A protocol for ensuring validity in agent-based simulation
title_full How to keep it adequate: A protocol for ensuring validity in agent-based simulation
title_fullStr How to keep it adequate: A protocol for ensuring validity in agent-based simulation
title_full_unstemmed How to keep it adequate: A protocol for ensuring validity in agent-based simulation
title_short How to keep it adequate: A protocol for ensuring validity in agent-based simulation
title_sort how to keep it adequate a protocol for ensuring validity in agent based simulation
topic agent-based models
calibration model
model validation
model interface
generalization
regime shift
url https://hdl.handle.net/10568/134582
work_keys_str_mv AT troostchristian howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT huberrobert howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT bellandrew howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT deldenhedwig howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT filatovatatiana howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT lequangbao howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT lippemelvin howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT niamirleila howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT polhillgareth howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT sunzhanli howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation
AT bergerthomas howtokeepitadequateaprotocolforensuringvalidityinagentbasedsimulation