Validation methods for plankton image classification systems


Contact
eva.alvarez [ at ] awi.de

Abstract

In recent decades, the automatic study and analysis of plankton communities using imaging techniques has advanced significantly. The effectiveness of these automated systems appears to have improved, reaching acceptable levels of accuracy. However, plankton ecologists often find that classification systems do not work as well as expected when applied to new samples. This paper proposes a methodology to assess the efficacy of learned models which takes into account the fact that the data distribution (the plankton composition of the sample) can vary between the model building phase and the production phase. As opposed to most validation methods that consider the individual organism as the unit of validation, our approach uses a validation‐by‐sample, which is more appropriate when the objective is to estimate the abundance of different morphological groups. We argue that, in these cases, the base unit to correctly estimate the error is the sample, not the individual. Thus, model assessment processes require groups of samples with sufficient variability in order to provide precise error estimates.



Item Type
Article
Authors
Divisions
Primary Division
Programs
Primary Topic
Peer revision
Peer-reviewed
Publication Status
Published
Eprint ID
47173
DOI 10.1002/lom3.10151

Cite as
González, P. , Alvarez, E. , Díaz, J. , López-Urrutia, Á. and del Coz, J. J. (2017): Validation methods for plankton image classification systems , Limnology and Oceanography-Methods, 15 (3), pp. 221-237 . doi: 10.1002/lom3.10151


Download
[img]
Preview
PDF
Gonzalez_et_al_2017_LandOMeths.pdf

Download (412kB) | Preview

Share


Citation

Research Platforms
N/A

Campaigns


Actions
Edit Item Edit Item