The data is saved on the EPSG:32632 grid. The pixels align to those of the Sentinel-2 satellite data in the UTM zone 32. The extent of the grid is defined by the bounding box of the MeteoSuisse data, which extends slightly beyond the administrative borders of Switzerland.
The grid has a resolution of 1280m x 1280m, meaning 128x128 Sentinel-2 pixels (10m resolution) are included per grid cell. To create the grid, run the QGIS model in grid_creator.model3 in QGIS. The inputs are:
- a weather file from MeteoSuisse (e.g.
O:/Data-Raw/27_Natural_Resources-RE/99_Meteo_Public/MeteoSwiss_netCDF/__griddedData/lv95updated/TminY_ch01r.swiss.lv95_202301010000_202301010000.nc) - an image from the Sentinel-2 tile T32TPS (e.g.
~/mnt/eo-nas1/data/satellite/sentinel2/CH/2020/S2A_MSIL2A_20200228T101021_N0214_R022_T32TPS_20200228T114852.SAFE/GRANULE/L2A_T32TPS_A024472_20200228T101400/IMG_DATA/R10m/T32TPS_20200228T101021_B03_10m.jp2)
The resulting grid will start at the first pixel of T32TPS covering the weather file. This corresponds to the eastern most point of the data. The grid is then extended to cover the entire weather file. It is provided at the following path:
~/mnt/eo-nas1/eoa-share/projects/012_EO_dataInfrastructure/Project layers/gridface_s2tiles.shp
Sentinel-2 aligned grid covering the bounding box of MeteoSuisse file (shown in background)
Since this grid is a rectangle and contains multiple tiles outside of Switzerland, it is cropped such as to keep only the grid cells that fall over the MeteoSuisse file:
python crop_grid.py
The final grid is saved at
~/mnt/eo-nas1/eoa-share/projects/012_EO_dataInfrastructure/Project layers/gridface_s2tiles_CH.shp
Sentinel-2 aligned grid cropped to MeteoSuisse file
The Sentinel-2 data is downloaded using the grid created above. Each grid tile is 1280m x 1280m, containing 128 x 128 pixels with a resolution of 10m.
For each grid tile, the data is queried using the minicuber code which takes care of reprojecting all data to a common, 10m resolution pixel size and aligned to the coordinates of the grid (EPSG:32632). Details on other processing steps are included in the minicuber documentation.
To download the data:
python S2/download_pipeline.py
- More about interrupting and restarting the download
Multiple grid tiles can be queried together (up to 4x4) and are split back to single tiles upon data saving. The returned data cube includes the following bands and variables:
- "S2_AOT", "S2_B01", "S2_B02", "S2_B03", "S2_B04", "S2_B05", "S2_B06", "S2_B07", "S2_B08", "S2_B8A", "S2_B09", "S2_B11", "S2_B12", "S2_WVP", "s2_SCL", "S2_mask"
- "product_uri", "mean_sensor_zenith", "mean_sensor_azimuth", "mean_solar_zenith", "mean_solar_azimuth"
You may find the data in ~/mnt/eo-nas1/data/satellite/sentinel2/raw/CH
The data is saved year by year in a zarr store (https://zarr.readthedocs.io/en/stable/index.html) with the following name system:
S2_minx_maxy_startyeastartmonthstartday_endyearendmonthendday.zarr
where (minx, maxy) will correspond to the upper left coordinate of the grid tile. There are two chunks per zarr file, where the data has been split in hald along the longitude dimension.
The original data are netCDF files stored at
O:/Data-Raw/27_Natural_Resources-RE/99_Meteo_Public/MeteoSwiss_netCDF/__griddedData/lv95updated/```
The daily variables were processed by reprojecting the data to EPSG:32632 and regridding the 1km data to 10m resolution (nearest-neighbor interpolation) aligned to Sentinel-2 pixels.\
You may find the data in ~/mnt/eo-nas1/data/meteo/
The files are named <datavar>/MeteoSwiss_<datavar>D_<minx>_<maxx>_<year>0101_<year>1231.zarr
The data variables are Rhires (daily precipitation [mm]), Srel (daily relative sunshine duraiton [%]), Tabs (daily mean air temprature [°C]), Tmin (daily min air temperature [°C]), Tmax (daily max temperature [°C]). For more information about the raw data please consult: https://www.meteoswiss.admin.ch/dam/jcr:215c313a-dc13-4b67-bca0-dbd966597f9a/ProdDoc_Cover-dfie.pdf.
To download the dataset provided by Swisstopo (TIF files) run
python SwissImage/si_download.py --urls_path path/to/urls.csv --downloads_path path/to/output/folder
The URLS for download are provided in ch.swisstopo.swissimage-dop10-DOp5jXFT.csv (0.1m resolution) and ch.swisstopo.swissimage-dop10-vWuyN4vG.csv (2m resolution).\
The original TIF files store RGB values, for a 1km x 1km area. The data is in EPSG:2056 and the filenames follow the structure
swissimage-dop10_YEAR_MINX_MINY_RESOLUTION_2056.tif.
MINX and MINY correspond to the coordinates of the bottom left corner of the file, in kms (EPSG:2056). The resolution is provided at 10cm (0.1m) but also 2m,
with cubic resampling done by Swisstopo. They are stored in ~/mnt/eo-nas1/data/swisstopo/SwissImage/raw/10cm and ~/mnt/eo-nas1/data/swisstopo/SwissImage/raw/2m respectively.
For more information on the products please visit here
The data was then reprojected to EPSG:32632 and resampled to be aligned to the Sentinel-2 grid (keeping a 10cm or 2m resolution).
You may find the data in ~/mnt/eo-nas1/data/swisstopo/SwissImage/cubes/10cm or ~/mnt/eo-nas1/data/swisstopo/SwissImage/cubes/2m.\
A Digital Elevation Model (DEM) of Switzerland at 2m resolution produced by swisstopo was added to the dataset. The product was reprojected from EPSG:2056 to EPSG:32632 and resampled using nearest inteprolation to align to the custom grid (i.e. align to Sentinel-2 pixels).
You may find the data in ~/mnt/eo-nas1/data/swisstopo/DEM
The files are named sa3D_MINX_MAXY.zarr where MINX and MINY correspond to the coordinates of the top left corner of the file, in meters (EPSG:32632).
For more information on swissalti3D please visit here
The download history is tracked here:
| Date | Jobs | Notes |
|---|---|---|
| 31.05.2024 | Run S2 downloading | Package versions: sen2nbar==2023.8.1 minicuber (commit version) |
| 18.07.2024 | Completed S2 download | |
| 26.07.2024 | Downloaded SwissImage 2m | |
| 29.07.2024 | Downloaded SwissImage 0.1m | |
| 09.09.2024 | Processed SwissImage 0.1m and 2m to cubes | |
| 09.09.2024 | Downloaded S2 2016 | Package versions: sen2nbar==2023.8.1 minicuber (commit version) |
| 25.11.2024 | Processed MeteoSwiss variables to cubes | |
| 02.12.2024 | Processed swissalti3D to cubes |
📁 \\eo-nas1\data
├── satellite
│ └── sentinel2
│ └── raw
│ └── CH
│
├── swisstopo
│ ├── SwissImage
│ │ ├── raw
│ │ │ ├── 10cm
│ │ │ └── 2m
│ │ └── cubes
│ │ ├── 10cm
│ │ └── 2m
│ └── dem
│
└── meteo
├── Rhires
├── Srel
├── Tabs
├── Tmax
└── Tmin
Code examples and function to extract the data and process the zarr files with the xarray package can be found here