File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -2,34 +2,11 @@ suppress_collection_display: false
22datasets :
33- name : control
44 type : IodaObsSpace
5- filenames :
6- - ${data_input_path}/ctrl_amsua_n19.20230726T030000Z.nc4
7- channels : 3,8
8- groups :
9- - name : ObsValue
10- variables :
11- - brightnessTemperature
12- - name : GsiHofXBc
13- - name : hofx0
14- - name : MetaData
15- - name : oman
16- - name : control
17- type : IodaObsSpace
18- filenames :
19- - ${data_input_path}/ctrl_amsua_n19.20230726T090000Z.nc4
20- channels : 3,8
21- groups :
22- - name : ObsValue
23- variables :
24- - brightnessTemperature
25- - name : GsiHofXBc
26- - name : hofx0
27- - name : MetaData
28- - name : oman
29- - name : experiment
30- type : IodaObsSpace
31- filenames :
32- - ${data_input_path}/exp_amsua_n19.20230726T030000Z.nc4
5+ filenames_template :
6+ template : ${data_input_path}/ctrl_amsua_n19.%Y%m%dT%H0000Z.nc4
7+ start : ' 2023-07-26T03:00:00'
8+ end : ' 2023-07-26T09:00:00'
9+ interval_hours : 6
3310 channels : 3,8
3411 groups :
3512 - name : ObsValue
@@ -40,9 +17,12 @@ datasets:
4017 - name : MetaData
4118 - name : oman
4219- name : experiment
20+ filenames_template :
21+ template : ${data_input_path}/exp_amsua_n19.%Y%m%dT%H0000Z.nc4
22+ start : ' 2023-07-26T03:00:00'
23+ end : ' 2023-07-26T09:00:00'
24+ interval_hours : 6
4325 type : IodaObsSpace
44- filenames :
45- - ${data_input_path}/exp_amsua_n19.20230726T090000Z.nc4
4626 channels : 3,8
4727 groups :
4828 - name : ObsValue
Original file line number Diff line number Diff line change 33import xarray as xr
44from eva .data .data_driver import data_driver
55from eva .data .data_collections import DataCollections
6-
6+ from eva . utilities . utils import generate_filenames_from_template
77
88filename_retrieval = {
99 "GsiObsSpace" : lambda dataset_config : dataset_config ["filenames" ],
1515def get_filenames (dataset_config , logger ):
1616 """ Retrieve filenames using given type """
1717
18+ if "filenames_template" in dataset_config :
19+ dataset_config ['filenames' ] = generate_filenames_from_template (
20+ dataset_config ['filenames_template' ], logger )
21+ del dataset_config ['filenames_template' ]
22+
1823 dataset_type = dataset_config ["type" ]
1924 logger .assert_abort (dataset_type in filename_retrieval ,
2025 f'Unknown dataset_type { dataset_type } ' )
You can’t perform that action at this time.
0 commit comments