Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Map Argo QC flags to Qartod QC flags #143

Open
tcarval opened this issue Oct 23, 2024 · 7 comments
Open

Map Argo QC flags to Qartod QC flags #143

tcarval opened this issue Oct 23, 2024 · 7 comments
Assignees
Labels

Comments

@tcarval
Copy link
Contributor

tcarval commented Oct 23, 2024

Argo QC flags are documented in RR2 and RD2 reference tables.
Qartoq QC flags scale is documented in http://dx.doi.org/10.25923/w8y6-d298

RR2 and RD2 Argo QC flags should be mapped to Qartod QC flag.

Here is the mapping proposal

<style> </style>
n Meaning Real-time comment Delayed-mode comment qartod flag qartod meaning
0 No QC is performed No QC is performed. No QC is performed. 2 Not evaluated
1 Good data Good data. All Argo real-time QC tests passed. These measurements are good within the limits of the Argo real-time QC tests. Good data. No adjustment is needed, or the adjusted value is statistically consistent with good quality reference data. An error estimate is supplied. 1 Pass
2 Probably good data Probably good data. These measurements are to be used with caution. Probably good data. Delayed-mode evaluation is based on insufficient information. An error estimate is supplied. 3 Suspect or Of High Interest
3 Probably bad data that are potentially adjustable Probably bad data. These measurements are not to be used without scientific adjustment, e.g. data affected by sensor drift but may be adjusted in delayed-mode. Probably bad data. An adjustment may (or may not) have been applied, but the value may still be bad. An error estimate is supplied. 3 Suspect or Of High Interest
4 Bad data Bad data. These measurements are not to be used. A flag '4' indicates that a relevant real-time qc test has failed. A flag '4' may also be assigned for bad measurements that are known to be not adjustable, e.g. due to sensor failure. Bad data. Not adjustable. Adjusted data are replaced by FillValue. 4 Fail
5 Value changed Value changed Value changed 1 Pass
6 Not used Not used Not used - -
7 Not used Not used Not used - -
8 Estimated value Estimated value (interpolated, extrapolated or other estimation). Estimated value (interpolated, extrapolated or other estimation). 1 Pass
9 Missing value Missing value. Data parameter will record FillValue. Missing value. Data parameter will record FillValue. 9 Missing data
‘ ‘ FillValue Empty space in NetCDF file. Empty space in NetCDF file. - -
@tcarval tcarval self-assigned this Oct 23, 2024
@tcarval tcarval added avtt Argo Vocabulary Task Team RR2 RD2 labels Oct 23, 2024
@tcarval tcarval changed the title RR2 RP2 map Argo QC flags to Qartod QC flags Map Argo QC flags to Qartod QC flags Oct 23, 2024
@tcarval tcarval added priority priority topic and removed avtt Argo Vocabulary Task Team labels Oct 23, 2024
@tcarval
Copy link
Contributor Author

tcarval commented Oct 24, 2024

@danibodc is the Qartod QC flag scale available on NVS ? If yes, it will be easy to perform the mapping.

@tcarval
Copy link
Contributor Author

tcarval commented Oct 24, 2024

@CandiceAOML , would you agree to check the Argo-Qartod QC flags mapping ?

@CandiceAOML
Copy link

@CandiceAOML , would you agree to check the Argo-Qartod QC flags mapping ?

@tcarval Sure! I'll share with the AOML DAC and we'll respond asap. Thanks!

@danibodc
Copy link

@tcarval there is an entry in the L27 collection 'SeaVoX data quality control flagging conventions' defining Qartod flags as a type of flagging convention, but the individual flags themselves aren't defined anywhere on the NVS as far as I can tell. So a new collection would be needed.

https://vocab.nerc.ac.uk/collection/L27/current/QARTOD_QC/

@CandiceAOML
Copy link

@tcarval Hi Thierry! We at the AOML DAC agree with your Argo-QARDOD mapping. Thanks for working on this!

@tcarval
Copy link
Contributor Author

tcarval commented Oct 31, 2024

@danibodc can you create this new collection ? Maybe along SeaDataNet collections (P39 ?)

<style> </style>
Qartod flag meaning description
1 Pass Data have passed critical real-time quality control tests and are deemed adequate for use as preliminary data.
2 Not evaluated Data have not been QC-tested, or the information on quality is not available.
3 Suspect or Of High Interest Data are considered to be either suspect or of high interest to data providers and users. They are flagged suspect to draw further attention to them by operators.
4 Fail Data are considered to have failed one or more critical real-time QC checks. If they are disseminated at all, it should be readily apparent that they are not of acceptable quality.
9 Missing data Data are missing; used as a placeholder.

@vturpin
Copy link

vturpin commented Feb 10, 2025

I would like to bring to your attention this work about QC mapping that may be usefull here : https://odv.awi.de/fileadmin/user_upload/odv/docs/ODV_quality_flag_sets.pdf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Status: No status
Development

No branches or pull requests

4 participants