Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions


Contact
Ilse.van.Opzeeland [ at ] awi.de

Abstract

Automated detectors are important tools for processing large passive acoustic databases. Assessing the performance of a given method can be challenging and needs to be interpreted in the light of the overall purpose of analysis. Performance evaluation often involves comparison between thedetector output and a ground-truth data set, which often involves manual analyses of the data. Such analyses may be subjective depending on, e.g., interfering background noise conditions. In this study, we investigated the variability between two analysts in the detection of Antarctic blue whale Zcalls (Balaenoptera musculus intermedia), as well as the intra-analyst variability, in order to understand how this variability impacts the creation of a ground-truth and the assessment of detector performances. Analyses were conducted on two test datasets reflecting two basins and different situations of call abundance and background noise conditions. Using a ground-truth based on combined results of both analysts, we evaluated the performances of two automated detectors, one using spectrogram correlation and the other using a subspace-detection strategy. This evaluation allows understanding how recording sites, vocal activity, and interfering sounds affect the detector performances and highlights the advantages and limitations of each of the methods, and the possible solutions to overcome the main limitations.



Item Type
Conference (Invited talk)
Authors
Divisions
Primary Division
Programs
Primary Topic
Peer revision
Not peer-reviewed
Publication Status
Published
Event Details
Third Joint Meeting of the Acoustical Society of America and the European Acoustics Association, 25 Jun 2017 - 29 Jun 2017, Boston, Massachusetts.
Eprint ID
45309
Cite as
Leroy, E. , Thomisch, K. and van Opzeeland, I. (2017): Variability in ground-truth data sets and the performance of two automated detectors for Antarctic blue whale calls in different soundscape conditions , Third Joint Meeting of the Acoustical Society of America and the European Acoustics Association, Boston, Massachusetts, 25 June 2017 - 29 June 2017 .


Share

Research Platforms

Campaigns


Actions
Edit Item Edit Item