Automatic quality control and quality control schema in the Observation to Archive
Silva, Brenner ORCID: https://orcid.org/0000-0002-4640-441X,
Kaffashzadeh, Najmeh,
Nixdorf, Erik,
Immoor, Sebastian ORCID: https://orcid.org/0000-0002-7563-4521,
Fischer, Philipp ORCID: https://orcid.org/0000-0002-3357-5420,
Anselm, Norbert,
Gerchow, Peter,
Schäfer, Angela ORCID: https://orcid.org/0000-0003-1784-2979 and
Koppe, Roland ORCID: https://orcid.org/0000-0002-2826-3932
;
Contact
brenner.silva [ at ] awi.de
Abstract
The O2A (Observation to Archive) is a data-flow framework for heterogeneous sources, including multiple institutions and scales of Earth observation. In the O2A, once data transmission is set up, processes are executed to automatically ingest (i.e. collect and harmonize) and quality control data in near real-time. We consider a web-based sensor description application to support transmission and harmonization of observational time-series data. We also consider a product-oriented quality control, where a standardized and scalable approach should integrate the diversity of sensors connected to the framework. A review of literature and observation networks of marine and terrestrial environments is under construction to allow us, for example, to characterize quality tests in use for generic and specific applications. In addition, we use a standardized quality flag scheme to support both user and technical levels of information. In our outlook, a quality score should pair the quality flag to indicate the overall plausibility of each individual data value or to measure the flagging uncertainty. In this work, we present concepts under development and give insights into the data ingest and quality control currently operating within the O2A framework.
Item Type
Conference
(Poster)
Authors
Silva, Brenner ORCID: https://orcid.org/0000-0002-4640-441X,
Kaffashzadeh, Najmeh,
Nixdorf, Erik,
Immoor, Sebastian ORCID: https://orcid.org/0000-0002-7563-4521,
Fischer, Philipp ORCID: https://orcid.org/0000-0002-3357-5420,
Anselm, Norbert,
Gerchow, Peter,
Schäfer, Angela ORCID: https://orcid.org/0000-0003-1784-2979 and
Koppe, Roland ORCID: https://orcid.org/0000-0002-2826-3932
;
Divisions
Primary Division
Programs
Primary Topic
Publication Status
Published
Event Details
EGU General Assembly 2020, 04 May 2020 - 08 May 2020.
Eprint ID
52020
DOI
10.5194/egusphere-egu2020-15961
Cite as
Silva, B.
,
Kaffashzadeh, N.
,
Nixdorf, E.
,
Immoor, S.
,
Fischer, P.
,
Anselm, N.
,
Gerchow, P.
,
Schäfer, A.
and
Koppe, R.
,
Computing and data centre
(2020):
Automatic quality control and quality control schema in the Observation to Archive
,
EGU General Assembly 2020,
4 May 2020 - 8 May 2020
.
doi: 10.5194/egusphere-egu2020-15961
Download
Preview
Share
Citation
Geographical region
Research Platforms
Campaigns
N/A
Actions
Edit Item