Code

Add support for remote datasets#842

Code

Draft

berombau wants to merge 21 commits intoscverse:mainscverse/spatialdata:mainfrom berombau:remote2berombau/spatialdata:remote2Copy head branch name to clipboard

+367-98

Commits

Commits on Jan 24, 2025

• add basic support and remote SpatialData tests

  berombau

  committed
  5718cba

  Copy full SHA for 5718cba

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for a8be620
  pre-commit-ci[bot]

  committed
  a8be620

  Copy full SHA for a8be620

Commits on Jan 31, 2025

• fix pre-commit

  LucaMarconato

  committed
  ce686e4

  Copy full SHA for ce686e4

• Revert "Update pyproject.toml"

  Show description for e7fa020
  LucaMarconato

  committed
  e7fa020

  Copy full SHA for e7fa020

• removed 3.13 from test ci

  LucaMarconato

  committed
  a9c0801

  Copy full SHA for a9c0801

• Merge branch 'no_python_313' into remote2

  LucaMarconato

  committed
  5cfdaec

  Copy full SHA for 5cfdaec

• fix

  LucaMarconato

  committed
  4fe6a47

  Copy full SHA for 4fe6a47

• uploading sdata to local s3 storage

  LucaMarconato

  committed
  d97a1d2

  Copy full SHA for d97a1d2

• add _open_zarr_store

  berombau

  committed
  5e26b5e

  Copy full SHA for 5e26b5e

• revert changing write function signature

  Show description for 5794871
  

  berombau

  and

  LucaMarconato

  committed
  5794871

  Copy full SHA for 5794871

• update _open_zarr_store with StoreLike

  berombau

  committed
  0207ff7

  Copy full SHA for 0207ff7

• read image element from base store

  berombau

  committed
  7e497ff

  Copy full SHA for 7e497ff

Commits on Feb 1, 2025

• clean up remote mock tests, focus only on reading raster elements

  berombau

  committed
  c674281

  Copy full SHA for c674281

• improve remote http test, add alternative

  berombau

  committed
  fb953a0

  Copy full SHA for fb953a0

• add support for consolidated metadata store in util function, add _create_upath function

  berombau

  committed
  52bb5fc

  Copy full SHA for 52bb5fc

• allow for groups as store input

  berombau

  committed
  ca82493

  Copy full SHA for ca82493

• handle consolidated metadata with upath

  berombau

  committed
  ecea0e6

  Copy full SHA for ecea0e6

• split remote reading tests between http and http with consolidated metadata

  berombau

  committed
  734eb45

  Copy full SHA for 734eb45

• remove f_store_path, support remote raster types fully and keep local support for other elements

  berombau

  committed
  c0ffb1c

  Copy full SHA for c0ffb1c

• Fix metadata_key bug now that store is not always FSStore. Add extra comments.

  berombau

  committed
  d60bd85

  Copy full SHA for d60bd85

• add mypy fixes

  berombau

  committed
  c3fa8cf

  Copy full SHA for c3fa8cf