@@ -10,32 +10,31 @@ data that is read using
10
10
ESMValCore also allows for some departures with compliance (see
11
11
:ref: `cmor_check_strictness `). Beyond that situation, some datasets
12
12
(either model or observations) contain (known) errors that would
13
- normally prevent them from being processed. The issues can be in the
14
- metadata describing the dataset and/or in the actual data. Typical
15
- examples of such errors are missing or wrong attributes (e.g.
16
- attribute ''units'' says 1e-9 but data are actually in 1e-6), missing
17
- or mislabeled coordinates (e.g. ''lev'' instead of ''plev'' or missing
13
+ normally prevent them from being processed. The issues can be in
14
+ the metadata describing the dataset and/or in the actual data.
15
+ Typical examples of such errors are missing or wrong attributes (e.g.
16
+ attribute ''units'' says 1e-9 but data are actually in 1e-6), missing or
17
+ mislabeled coordinates (e.g. ''lev'' instead of ''plev'' or missing
18
18
coordinate bounds like ''lat_bnds'') or problems with the actual data
19
- (e.g. cloud liquid water only instead of sum of liquid + ice as
20
- specified by the CMIP data request).
19
+ (e.g. cloud liquid water only instead of sum of liquid + ice as specified by the CMIP data request).
21
20
22
21
As an extreme case, some others data sources simply are not NetCDF
23
22
files and must go through other data load function.
24
23
25
24
The ESMValCore can apply on the fly fixes to such datasets when
26
- issues can be fixed automatically. This is implemented for a set
27
- of `Natively supported non-CMIP datasets `_. The following provide
25
+ issues can be fixed automatically. This is implemented for a set
26
+ of `Natively supported non-CMIP datasets `_. The following provide
28
27
details on how to design such fixes.
29
28
30
29
.. note ::
31
-
32
- **CMORizer scripts **. Support for many observational and reanalysis
33
- datasets is also possible through a priori reformating by
30
+
31
+ **CMORizer scripts **. Support for many observational and reanalysis
32
+ datasets is also possible through a priori reformatting by
34
33
:ref: `CMORizer scripts in the ESMValTool <esmvaltool:new-dataset >`,
35
34
which are rather relevant for datasets of small volume
36
35
37
36
.. _fix_structure :
38
-
37
+
39
38
Fix structure
40
39
=============
41
40
@@ -337,9 +336,38 @@ Natively supported non-CMIP datasets
337
336
Some fixed datasets and native models formats are supported through
338
337
the ` ` native6` ` project or through a dedicated project.
339
338
339
+ ERA5 and MSWEP datasets
340
+ -----------------------
341
+ Put the files containing the data in the directory that you have configured
342
+ for the ``native6`` project in your :ref:` user configuration file` , in a
343
+ subdirectory called ` ` Tier{tier}/{dataset}/{version}/{frequency}/{short_name}` ` .
344
+ Replace the items in curly braces by the values used in the variable/dataset
345
+ definition in the :ref:` recipe < recipe_overview> ` .
346
+ Below is a list of datasets currently supported.
347
+
348
+ ERA5
349
+ ~ ~~~
350
+
351
+ - Supported variables: ` ` clt` ` , ` ` evspsbl` ` , ` ` evspsblpot` ` , ` ` mrro` ` , ` ` pr` ` , ` ` prsn` ` , ` ` ps` ` , ` ` psl` ` , ` ` ptype` ` , ` ` rls` ` , ` ` rlds` ` , ` ` rsds` ` , ` ` rsdt` ` , ` ` rss` ` , ` ` uas` ` , ` ` vas` ` , ` ` tas` ` , ` ` tasmax` ` , ` ` tasmin` ` , ` ` tdps` ` , ` ` ts` ` , ` ` tsn` ` (` ` E1hr` ` /` ` Amon` ` ), ` ` orog` ` (` ` fx` ` )
352
+ - Tier: 3
353
+
354
+ MSWEP
355
+ ~ ~~~~
356
+
357
+ - Supported variables: ` ` pr` `
358
+ - Supported frequencies: ` ` mon` ` , ` ` day` ` , ` ` 3hr` ` .
359
+ - Tier: 3
360
+
361
+ For example for monthly data, place the files in the ` ` /Tier3/MSWEP/latestversion/mon/pr` ` subdirectory of your ` ` native6` ` project location.
362
+
363
+ .. note::
364
+ For monthly data (V220), the data must be postfixed with the date, i.e. rename ` ` global_monthly_050deg.nc` ` to ` ` global_monthly_050deg_197901-201710.nc` `
365
+
366
+ For more info: http://www.gloh2o.org/
367
+
340
368
.. _fixing_native_models:
341
369
342
- Native models : IPSL-CM6,...
370
+ Native models : IPSL-CM6,...
343
371
-----------------------------
344
372
345
373
The following models are natively supported through the procedure
@@ -355,13 +383,13 @@ described above (:ref:`fix_structure`) and at
355
383
datasets:
356
384
- {simulation: CM61-LR-hist-03.1950, exp: piControl, freq: Analyse/TS_MO,
357
385
account: p86caub, status: PROD, dataset: IPSL-CM6, project: IPSLCM,
358
- root: /thredds/tgcc/store}
386
+ root: /thredds/tgcc/store}
359
387
- {simulation: CM61-LR-hist-03.1950, exp: historical, freq: Output/MO,
360
388
account: p86caub, status: PROD, dataset: IPSL-CM6, project: IPSLCM,
361
- root: /thredds/tgcc/store}
389
+ root: /thredds/tgcc/store}
362
390
363
391
.. _ipslcm_extra_facets_example:
364
-
392
+
365
393
The ` ` Output` ` format is an example of a case where variables are
366
394
grouped in multi-variable files, which name cannot be computed
367
395
directly from datasets attributes alone but requires to use an
@@ -371,37 +399,6 @@ described above (:ref:`fix_structure`) and at
371
399
multi-variable files must also undergo some data selection, which
372
400
may involve an external process for performance purpose.
373
401
374
-
375
-
376
- ERA5 and MSWEP datasets
377
- -----------------------
378
- Put the files containing the data in the
379
- directory that you have configured for the ` ` native6` ` project in your
380
- :ref:` user configuration file` , in a subdirectory called
381
- ` ` Tier{tier}/{dataset}/{version}/{frequency}/{short_name}` ` . Replace
382
- the items in curly braces by the values used in the variable/dataset
383
- definition in the :ref:` recipe < recipe_overview> ` . Below is a list of
384
- datasets currently supported :
385
-
386
- - ** ERA5**
387
-
388
- - Supported variables: ` ` clt` ` , ` ` evspsbl` ` , ` ` evspsblpot` ` , ` ` mrro` ` , ` ` pr` ` , ` ` prsn` ` , ` ` ps` ` , ` ` psl` ` , ` ` ptype` ` , ` ` rls` ` , ` ` rlds` ` , ` ` rsds` ` , ` ` rsdt` ` , ` ` rss` ` , ` ` uas` ` , ` ` vas` ` , ` ` tas` ` , ` ` tasmax` ` , ` ` tasmin` ` , ` ` tdps` ` , ` ` ts` ` , ` ` tsn` ` (` ` E1hr` ` /` ` Amon` ` ), ` ` orog` ` (` ` fx` ` )
389
- - Tier: 3
390
-
391
- - ** MSWEP**
392
-
393
- - Supported variables: ` ` pr` `
394
- - Supported frequencies: ` ` mon` ` , ` ` day` ` , ` ` 3hr` ` .
395
- - Tier: 3
396
-
397
- For example for monthly data, place the files in the ` ` /Tier3/MSWEP/latestversion/mon/pr` ` subdirectory of your ` ` native6` ` project location.
398
-
399
- .. note::
400
-
401
- For monthly data (V220), the data must be postfixed with the date, i.e. rename ` ` global_monthly_050deg.nc` ` to ` ` global_monthly_050deg_197901-201710.nc` `
402
-
403
- For more info: http://www.gloh2o.org/
404
-
405
402
.. _extra-facets-fixes:
406
403
407
404
Use of extra facets in fixes
0 commit comments