You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
`<path>` starts from `REMOTE_DIR`, `LOCAL_DIR`, etc., and *must* start with `<simulation_round>/<product>/<sector>`. After that more levels can follow to restrict the files to be processed further.
`match_remote`, `fetch_files`, `write_jsons`, `ingest_datasets`, and `publish_datasets` can be combined using `run`:
160
154
161
155
```bash
162
-
isimip-publisher <path> run
156
+
isimip-publisher run <path>
163
157
```
164
158
165
159
For all commands a list of files with absolute pathes (as line separated txt file) can be provided to restrict the files processed, e.g.:
166
160
167
161
```bash
168
-
isimip-publisher -f /path/to/files.txt <path>run
162
+
isimip-publisher -e exclude.txt -i include.txt run <path>
169
163
```
170
164
171
165
Default values for the optional arguments are set in the code, but can also be provided via:
172
166
173
-
* a config file given by `--config-file`, or located at `isimip-qc.conf`, `~/.isimip-qc.conf`, or `/etc/isimip-qc.conf`. The config file needs to have a section `isimip-publisher` and uses lower case variables and underscores, e.g.:
167
+
* a config file given by `--config-file`, or located at `isimip.conf`, `~/.isimip.conf`, or `/etc/isimip.conf`. The config file needs to have a section `isimip-publisher` and uses lower case variables and underscores, e.g.:
174
168
```
175
169
[isimip-publisher]
176
170
log_level = ERROR
@@ -195,7 +189,7 @@ Test
195
189
Install test dependencies:
196
190
197
191
```
198
-
pip install -r requirements/dev.txt
192
+
pip install -r requirements/pytest.txt
199
193
```
200
194
201
195
Copy `.env.pytest` to `.env`. This sets the environment variables to the directories in `testing`.
0 commit comments