A major effect of environment on crops is through crop phenology, and therefore, the capacity to predict phenology for new environments is important. Mechanistic crop models are a major tool for such predictions, but calibration of crop phenology models is difficult and there is no consensus on the best approach. We propose an original, detailed approach for calibration of such models, which we refer to as a calibration protocol. The protocol covers all the steps in the calibration workflow, namely choice of default parameter values, choice of objective function, choice of parameters to estimate from the data, calculation of optimal parameter values, and diagnostics. The major innovation is in the choice of which parameters to estimate from the data, which combines expert knowledge and data-based model selection. First, almost additive parameters are identified and estimated. This should make bias (average difference between observed and simulated values) nearly zero. These are "obligatory" parameters, that will definitely be estimated. Then candidate parameters are identified, which are parameters likely to explain the remaining discrepancies between simulated and observed values. A candidate is only added to the list of parameters to estimate if it leads to a reduction in BIC (Bayesian Information Criterion), which is a model selection criterion. A second original aspect of the protocol is the specification of documentation for each stage of the protocol. The protocol was applied by 19 modeling teams to three data sets for wheat phenology. All teams first calibrated their model using their "usual" calibration approach, so it was possible to compare usual and protocol calibration. Evaluation of prediction error was based on data from sites and years not represented in the training data. Compared to usual calibration, calibration following the new protocol reduced the variability between modeling teams by 22% and reduced prediction error by 11%.

Proposal and extensive test of a calibration protocol for crop phenology models / Wallach D.; Palosuo T.; Thorburn P.; Mielenz H.; Buis S.; Hochman Z.; Gourdain E.; Andrianasolo F.; Dumont B.; Ferrise R.; Gaiser T.; Garcia C.; Gayler S.; Harrison M.; Hiremath S.; Horan H.; Hoogenboom G.; Jansson P.-E.; Jing Q.; Justes E.; Kersebaum K.-C.; Launay M.; Lewan E.; Liu K.; Mequanint F.; Moriondo M.; Nendel C.; Padovan G.; Qian B.; Schutze N.; Seserman D.-M.; Shelia V.; Souissi A.; Specka X.; Srivastava A.K.; Trombi G.; Weber T.K.D.; Weihermuller L.; Wohling T.; Seidel S.J.. - In: AGRONOMY FOR SUSTAINABLE DEVELOPMENT. - ISSN 1774-0746. - ELETTRONICO. - 43:(2023), pp. 46.0-46.0. [10.1007/s13593-023-00900-0]

Proposal and extensive test of a calibration protocol for crop phenology models

Ferrise R.;Padovan G.;Trombi G.;
2023

Abstract

A major effect of environment on crops is through crop phenology, and therefore, the capacity to predict phenology for new environments is important. Mechanistic crop models are a major tool for such predictions, but calibration of crop phenology models is difficult and there is no consensus on the best approach. We propose an original, detailed approach for calibration of such models, which we refer to as a calibration protocol. The protocol covers all the steps in the calibration workflow, namely choice of default parameter values, choice of objective function, choice of parameters to estimate from the data, calculation of optimal parameter values, and diagnostics. The major innovation is in the choice of which parameters to estimate from the data, which combines expert knowledge and data-based model selection. First, almost additive parameters are identified and estimated. This should make bias (average difference between observed and simulated values) nearly zero. These are "obligatory" parameters, that will definitely be estimated. Then candidate parameters are identified, which are parameters likely to explain the remaining discrepancies between simulated and observed values. A candidate is only added to the list of parameters to estimate if it leads to a reduction in BIC (Bayesian Information Criterion), which is a model selection criterion. A second original aspect of the protocol is the specification of documentation for each stage of the protocol. The protocol was applied by 19 modeling teams to three data sets for wheat phenology. All teams first calibrated their model using their "usual" calibration approach, so it was possible to compare usual and protocol calibration. Evaluation of prediction error was based on data from sites and years not represented in the training data. Compared to usual calibration, calibration following the new protocol reduced the variability between modeling teams by 22% and reduced prediction error by 11%.
2023
43
0
0
Goal 13: Climate action
Wallach D.; Palosuo T.; Thorburn P.; Mielenz H.; Buis S.; Hochman Z.; Gourdain E.; Andrianasolo F.; Dumont B.; Ferrise R.; Gaiser T.; Garcia C.; Gayler S.; Harrison M.; Hiremath S.; Horan H.; Hoogenboom G.; Jansson P.-E.; Jing Q.; Justes E.; Kersebaum K.-C.; Launay M.; Lewan E.; Liu K.; Mequanint F.; Moriondo M.; Nendel C.; Padovan G.; Qian B.; Schutze N.; Seserman D.-M.; Shelia V.; Souissi A.; Specka X.; Srivastava A.K.; Trombi G.; Weber T.K.D.; Weihermuller L.; Wohling T.; Seidel S.J.
File in questo prodotto:
File Dimensione Formato  
s13593-023-00900-0.pdf

Accesso chiuso

Tipologia: Pdf editoriale (Version of record)
Licenza: Open Access
Dimensione 1.02 MB
Formato Adobe PDF
1.02 MB Adobe PDF   Richiedi una copia

I documenti in FLORE sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificatore per citare o creare un link a questa risorsa: https://hdl.handle.net/2158/1352813
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
social impact