The intrinsic predictability of ecological time series and its potential to guide forecasting


Contact
berenike.bick [ at ] hifmb.de

Abstract

Successfully predicting the future states of systems that are complex, stochastic, and potentially chaotic is a major challenge. Model forecasting error (FE) is the usual measure of success; however model predictions provide no insights into the potential for improvement. In short, the realized predictability of a specific model is uninformative about whether the system is inherently predictable or whether the chosen model is a poor match for the system and our observations thereof. Ideally, model proficiency would be judged with respect to the systems’ intrinsic predictability, the highest achievable predictability given the degree to which system dynamics are the result of deterministic vs. stochastic processes. Intrinsic predictability may be quantified with permutation entropy (PE), a model‐free, information‐theoretic measure of the complexity of a time series. By means of simulations, we show that a correlation exists between estimated PE and FE and show how stochasticity, process error, and chaotic dynamics affect the relationship. This relationship is verified for a data set of 461 empirical ecological time series. We show how deviations from the expected PE–FE relationship are related to covariates of data quality and the nonlinearity of ecological dynamics. These results demonstrate a theoretically grounded basis for a model‐free evaluation of a system's intrinsic predictability. Identifying the gap between the intrinsic and realized predictability of time series will enable researchers to understand whether forecasting proficiency is limited by the quality and quantity of their data or the ability of the chosen forecasting model to explain the data. Intrinsic predictability also provides a model‐free baseline of forecasting proficiency against which modeling efforts can be evaluated.



Item Type
Article
Authors
Divisions
Primary Division
Programs
Primary Topic
Peer revision
ISI/Scopus peer-reviewed
Publication Status
Published
Eprint ID
51372
DOI 10.1002/ecm.1359

Cite as
Pennekamp, F. , Iles, A. C. , Garland, J. , Brennan, G. , Brose, U. , Gaedke, U. , Jacob, U. , Kratina, P. , Matthews, B. , Munch, S. , Novak, M. , Palamara, G. M. , Rall, B. C. , Rosenbaum, B. , Tabi, A. , Ward, C. , Williams, R. , Ye, H. and Petchey, O. L. (2019): The intrinsic predictability of ecological time series and its potential to guide forecasting , Ecological Monographs, 89 (2) . doi: 10.1002/ecm.1359


Download
[img]
Preview
PDF
Pennekamp_et_al-2019-Ecological_Monographs.pdf

Download (1MB) | Preview

Share


Citation

Research Platforms
N/A

Campaigns


Actions
Edit Item Edit Item