A system of metrics for the assessment and improvement of aquatic ecosystem models

Matthew R. Hipsey; Gideon Gal; George B. Arhonditsis; Cayelan C. Carey; J. Alex Elliott; Marieke A. Frassl; Jan H. Janse; Lee de Mora; Barbara J. Robson

doi:10.1016/j.envsoft.2020.104697

A system of metrics for the assessment and improvement of aquatic ecosystem models

Matthew R. Hipsey (Co-auteur), Gideon Gal, George B. Arhonditsis, Cayelan C. Carey, J. Alex Elliott, Marieke A. Frassl, Jan H. Janse, Lee de Mora, Barbara J. Robson

NIOO - Aquatic Ecology (AqE)

Onderzoeksoutput: Bijdrage aan wetenschappelijk tijdschrift/periodieke uitgave › Artikel › Wetenschappelijk › peer review

78 Citaten (Scopus)

161 Downloads (Pure)

Samenvatting

In this paper, we introduce the CSPS framework for the hierarchical assessment of aquatic ecosystem models built on a range of metrics and characteristic signatures relevant to aquatic ecosystem condition. The framework is comprised of four levels: 0) conceptual validation; 1) comparison of simulated state variables with observations (‘state validation’); 2) comparison of fluxes with measured process rates (‘process validation’); and 3) assessment of system-level emergent properties, patterns and relationships (‘system validation’). Of these, only levels 0 and 1 are routinely undertaken at present. To highlight a diverse range of contexts relevant to the aquatic ecosystem modelling community, we present several case studies of improved validation approaches using the level 0–3 assessment hierarchy. We envision that the community–driven adoption of these metrics will lead to more rigorously assessed models, ultimately accelerating advances in model structure and function, and improved confidence in model predictions.

Originele taal-2	Engels
Tijdschrift	Environmental Modelling and Software
Volume	128
DOI's	https://doi.org/10.1016/j.envsoft.2020.104697
Status	Gepubliceerd - 2020

Toegang tot document

10.1016/j.envsoft.2020.104697Licentie: CC BY

6996_HipseyLicentie: CC BY

Andere bestanden en links

Data

Citeer dit

@article{917992c1ac8842d5bd8a5fbb63a1ed21,

title = "A system of metrics for the assessment and improvement of aquatic ecosystem models",

abstract = "In this paper, we introduce the CSPS framework for the hierarchical assessment of aquatic ecosystem models built on a range of metrics and characteristic signatures relevant to aquatic ecosystem condition. The framework is comprised of four levels: 0) conceptual validation; 1) comparison of simulated state variables with observations ({\textquoteleft}state validation{\textquoteright}); 2) comparison of fluxes with measured process rates ({\textquoteleft}process validation{\textquoteright}); and 3) assessment of system-level emergent properties, patterns and relationships ({\textquoteleft}system validation{\textquoteright}). Of these, only levels 0 and 1 are routinely undertaken at present. To highlight a diverse range of contexts relevant to the aquatic ecosystem modelling community, we present several case studies of improved validation approaches using the level 0–3 assessment hierarchy. We envision that the community–driven adoption of these metrics will lead to more rigorously assessed models, ultimately accelerating advances in model structure and function, and improved confidence in model predictions.",

keywords = "AEM, CSPS, Ecological modelling, Uncertainty, Water quality, Freshwater, Marine, international",

author = "Hipsey, {Matthew R.} and Gideon Gal and Arhonditsis, {George B.} and Carey, {Cayelan C.} and Elliott, {J. Alex} and Frassl, {Marieke A.} and Janse, {Jan H.} and {de Mora}, Lee and Robson, {Barbara J.}",

note = "6996, AqE; Data archiving: evolving collection on GitHub (not NIOO), no NIOO project",

year = "2020",

doi = "10.1016/j.envsoft.2020.104697",

language = "English",

volume = "128",

journal = "Environmental Modelling and Software",

issn = "1364-8152",

publisher = "Elsevier B.V.",

}

TY - JOUR

T1 - A system of metrics for the assessment and improvement of aquatic ecosystem models

AU - Hipsey, Matthew R.

AU - Gal, Gideon

AU - Arhonditsis, George B.

AU - Carey, Cayelan C.

AU - Elliott, J. Alex

AU - Frassl, Marieke A.

AU - Janse, Jan H.

AU - de Mora, Lee

AU - Robson, Barbara J.

N1 - 6996, AqE; Data archiving: evolving collection on GitHub (not NIOO), no NIOO project

PY - 2020

Y1 - 2020

N2 - In this paper, we introduce the CSPS framework for the hierarchical assessment of aquatic ecosystem models built on a range of metrics and characteristic signatures relevant to aquatic ecosystem condition. The framework is comprised of four levels: 0) conceptual validation; 1) comparison of simulated state variables with observations (‘state validation’); 2) comparison of fluxes with measured process rates (‘process validation’); and 3) assessment of system-level emergent properties, patterns and relationships (‘system validation’). Of these, only levels 0 and 1 are routinely undertaken at present. To highlight a diverse range of contexts relevant to the aquatic ecosystem modelling community, we present several case studies of improved validation approaches using the level 0–3 assessment hierarchy. We envision that the community–driven adoption of these metrics will lead to more rigorously assessed models, ultimately accelerating advances in model structure and function, and improved confidence in model predictions.

AB - In this paper, we introduce the CSPS framework for the hierarchical assessment of aquatic ecosystem models built on a range of metrics and characteristic signatures relevant to aquatic ecosystem condition. The framework is comprised of four levels: 0) conceptual validation; 1) comparison of simulated state variables with observations (‘state validation’); 2) comparison of fluxes with measured process rates (‘process validation’); and 3) assessment of system-level emergent properties, patterns and relationships (‘system validation’). Of these, only levels 0 and 1 are routinely undertaken at present. To highlight a diverse range of contexts relevant to the aquatic ecosystem modelling community, we present several case studies of improved validation approaches using the level 0–3 assessment hierarchy. We envision that the community–driven adoption of these metrics will lead to more rigorously assessed models, ultimately accelerating advances in model structure and function, and improved confidence in model predictions.

KW - AEM

KW - CSPS

KW - Ecological modelling

KW - Uncertainty

KW - Water quality

KW - Freshwater

KW - Marine

KW - international

UR - https://github.com/AquaticEcoDynamics/aem-metrics

U2 - 10.1016/j.envsoft.2020.104697

DO - 10.1016/j.envsoft.2020.104697

M3 - Article

SN - 1364-8152

VL - 128

JO - Environmental Modelling and Software

JF - Environmental Modelling and Software

ER -

A system of metrics for the assessment and improvement of aquatic ecosystem models

Samenvatting

Toegang tot document

Andere bestanden en links

Vingerafdruk

Citeer dit