Skip to content

Commit 48ede49

Browse files
committed
adding config examples
1 parent 756e613 commit 48ede49

File tree

5 files changed

+117
-1
lines changed

5 files changed

+117
-1
lines changed

CF.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,8 +9,11 @@ The sample notebooks to access the datasets together with some description of th
99
- [cdse-notebooks](https://github.com/eurostat/eubd2025_docs/tree/main/cdse-notebooks)
1010
- [cf-notebooks](https://github.com/eurostat/eubd2025_docs/tree/main/cf-notebooks)
1111
- [docs](https://github.com/eurostat/eubd2025_docs/tree/main/docs)
12+
13+
In order to recreate the extended OSGeoLive image, follow [these instructions](osgeoplus.md).
1214
:::
13-
15+
16+
1417
## First steps at the hackathon
1518

1619
1. The hackathon participants receive a message with a link in your team private channel. Clicking on the link you get to 1password site.

data-catalogue.md

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -94,6 +94,7 @@ For more information:
9494

9595
:::{Note}
9696
Here is a sample code how to access and use the NUTS data in the platform: [NUTS data notebook](cf-notebooks/Example_NUTS.ipynb).
97+
To run this notebook, an `.s3cfg` [like this sample file](scripts/.s3cfg) is needed with credentials to the source bucket.
9798
:::
9899

99100
- **Population grid (geopackage and raster, 1km resolution)**
@@ -102,6 +103,7 @@ For more information: [https://ec.europa.eu/eurostat/web/gisco/geodata/populatio
102103

103104
:::{Note}
104105
Here is a sample code how to access and use the population grid data in the platform: [Census data notebook](cf-notebooks/Example_Census_GRID.ipynb).
106+
To run this notebook, an `.s3cfg` [like this sample file](scripts/.s3cfg) is needed with credentials to the source bucket.
105107
:::
106108

107109
- **GISCO Reference Grid**
@@ -110,6 +112,7 @@ For more information on Eurostat’s GISCO services, see also: [https://ec.europ
110112

111113
:::{Note}
112114
Here is a sample code how to access and use the reference grid data in the platform: [Reference grid notebook](cf-notebooks/Example_GISCO_Reference_Grid.ipynb).
115+
To run this notebook, an `.s3cfg` [like this sample file](scripts/.s3cfg) is needed with credentials to the source bucket.
113116
:::
114117

115118
- **Global Human Settlement layer (raster)**
@@ -118,6 +121,7 @@ For more information, see: [https://data.jrc.ec.europa.eu/collection/ghsl](https
118121

119122
:::{Note}
120123
Here is a sample code how to access and use the GHS data in the platform: [GHS notebook](cf-notebooks/Example_GHSL.ipynb).
124+
To run this notebook, an `.s3cfg` [like this sample file](scripts/.s3cfg) is needed with credentials to the source bucket.
121125
:::
122126

123127
- **Land cover (CORINE or ESA WorldCover)**
@@ -126,27 +130,31 @@ Interactively explore [Copernicus Global Land](https://link.dataspace.copernicus
126130

127131
:::{Note}
128132
Here is a sample code how to access and use the Land cover data in the platform: [Land cover notebook](cdse-notebooks/openeo-example.ipynb).
133+
To run this notebook, an `.s3cfg` [like this sample file](scripts/.s3cfg) is needed with credentials to the source bucket.
129134
:::
130135

131136
- **Field polygons for all countries over Europe for 2022**
132137
Vector dataset is available and described here: [https://zenodo.org/records/14229033](https://zenodo.org/records/14229033)
133138

134139
:::{Note}
135140
Here is a sample code how to access and use the Field polygons in the platform: [Field polygons notebook](cf-notebooks/Example_Field_boundaries.ipynb).
141+
To run this notebook, an `.s3cfg` [like this sample file](scripts/.s3cfg) is needed with credentials to the source bucket.
136142
:::
137143

138144
- **Natura 2000**
139145
Natura 2000 is an ecological network of protected areas, set up to ensure the survival of Europe's most valuable species and habitats. Natura 2000 is based on the 1979 Birds Directive and the 1992 Habitats Directive. Natura 2000 is the key instrument to protect biodiversity in the European Union. For the latest version (from 23.04.2024), see: [https://sdi.eea.europa.eu/catalogue/biodiversity/eng/catalog.search#/metadata/805a487f-a7ef-42e9-ba08-9501289a56c6](https://sdi.eea.europa.eu/catalogue/biodiversity/eng/catalog.search#/metadata/805a487f-a7ef-42e9-ba08-9501289a56c6)
140146

141147
:::{Note}
142148
Here is a sample code how to access and use the Natura 2000 data in the platform: [Natura 2000 notebook](cf-notebooks/Example_Natura_2000.ipynb).
149+
To run this notebook, an `.s3cfg` [like this sample file](scripts/.s3cfg) is needed with credentials to the source bucket.
143150
:::
144151

145152
- **Climate Data Store**
146153
The Climate Data Store provides authoritative information about the past, present and future climate in Europe and the rest of the World. For more information see: [https://cds.climate.copernicus.eu/#!/home](https://cds.climate.copernicus.eu/#!/home)
147154

148155
:::{Note}
149156
Here is a sample code how to access and use data from the climate data store in the platform: [Climate data store notebook](cdse-notebooks/climate-data-access.ipynb).
157+
To run this notebook, an `.cdsapirc` [like this sample file](scripts/.cdsapirc) is needed with credentials to the API.
150158
:::
151159

152160

osgeoplus.md

Lines changed: 95 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,95 @@
1+
# Step by step instructions to recreate the customized OSGeoLive image with additional services
2+
3+
1. After login in to the [Horizon dashboard](https://horizon.cloudferro.com/) go to the ***Instances*** in the left menu and choose ***Launch Instance***.
4+
5+
![Horizon dashboard instances](img/launch-instance.png)
6+
7+
2. In the new window first you give a name to your instance
8+
9+
![Instance name](img/instance-name.png)
10+
11+
3. Then select the source of the image: ***OSGeoLive 16.0***
12+
13+
![Image source](img/source.png)
14+
15+
4. The next step is to select the flavor of the instance e.g. size of CPU, RAM and disk.
16+
17+
:::{Important}
18+
The instance should have at least **40GB** of disk!
19+
:::
20+
21+
![Flavor](img/flavor.png)
22+
23+
5. Under the networks add both networks
24+
25+
![Networks](img/networks.png)
26+
27+
6. Under the Security Groups enable the following ports for incoming connections:
28+
29+
- 22 (SSH)
30+
- 3389 (RDP)
31+
- 3838 (Shiny)
32+
- 8000 (JupyterHub)
33+
- 8088 (Superset)
34+
- 8787 (Rstudio)
35+
36+
:::{Note}
37+
In the account there can be already predefined security groups contain these port. If not, you have to create it following [these instructions](https://creodias.docs.cloudferro.com/en/latest/cloud/How-to-use-Security-Groups-in-Horizon-on-Creodias.html)
38+
:::
39+
40+
![Security Groups](img/security-groups.png)
41+
42+
7. Finally you select or create an SSH key pair that will be used to connect to the instance for the first time.
43+
44+
![SSH key](img/key-pair.png)
45+
46+
8. Launch the instance and wait until it will be running
47+
48+
9. Create and associate an external IP following [these steps](https://creodias.docs.cloudferro.com/en/latest/networking/How-to-Add-or-Remove-Floating-IPs-to-your-VM-on-Creodias.html)
49+
50+
![Add IP](img/add-ip.png)
51+
52+
10. Then you can access your instance with an SSH client using the key from step 7 and the username is ***eouser***. Then the first step will be to create a password for the default user (eouser). After creating the password the connection will be automatically closed.
53+
54+
![Initialize password](img/pwd-change.png)
55+
56+
11. To enable RDP and add the additional services you have to run the following shell script: [add_services_nogpu.sh](scripts/add_services_nogpu.sh)
57+
For that, you have to upload/copy (e.g. WinSCP) to the server. Make it executable and run in a terminal.
58+
59+
```{code-block}
60+
chmod +x add_services_nogpu.sh
61+
./add_services_nogpu.sh
62+
```
63+
64+
:::{Important}
65+
Before you run the script replace in the script on row 136 the Superset admin password `<your_superset_password>` with your own password.
66+
:::
67+
68+
:::{Note}
69+
The script runs and install all the services and libraries. The script restarts several times the server during the installation process and can last up to 1 hour.
70+
You can check the installation status with `more ~/.service_install_status` in the terminal. When it finishes the status will be `everything went well`.
71+
![Instal finished](img/install-finished.png)
72+
:::
73+
74+
## Accessing the services
75+
76+
**RDP**
77+
78+
The service is available under the external IP:3389 created under step 9 above in standard RDP clients. In case you are behind proxy you can tunnel the internal IP:3389 through SSH to your localhost and connect to your localhost port with the RDP client.
79+
80+
**Shiny**
81+
82+
The service is available in a browser under the external IP:3838 created under step 9 above.
83+
84+
**JupyterHub**
85+
86+
The service is available in a browser under the external IP:8000 created under step 9 above. The username is `eouser` and password what is defined under step 10.
87+
88+
**Apache Superset**
89+
90+
The service is available in a browser under the external IP:8088 created under step 9 above. The username is `eouser` and password what is defined under step 11 defined in the `add_services_nogpu.sh`.
91+
92+
**Rstudio**
93+
94+
The service is available in a browser under the external IP:8787 created under step 9 above. The username is `eouser` and password what is defined under step 10.
95+

scripts/.cdsapirc

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
url: https://cds.climate.copernicus.eu/api
2+
key: <to be replaced with actual value>

scripts/.s3cfg

Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
[default]
2+
host_base = https://s3.waw3-2.cloudferro.com
3+
host_bucket = https://s3.waw3-2.cloudferro.com
4+
access_key = <to be replaced with actual value>
5+
secret_key = <to be replaced with actual value>
6+
human_readable_sizes = False
7+
use_https = true
8+
check_ssl_certificate = true

0 commit comments

Comments
 (0)