Code

use tusd datastorages#4148

Code

Closed

butonic wants to merge 81 commits intocs3org:edgecs3org/reva:edgefrom butonic:use-tus-data-storagebutonic/reva:use-tus-data-storageCopy head branch name to clipboard

+3,578-1,507

Commits

Commits on Nov 1, 2023

• use tusd datastorages

  Show description for 1293660
  butonic

  committed
  1293660

  Copy full SHA for 1293660

• add comments

  Show description for 7d2a741
  butonic

  committed
  7d2a741

  Copy full SHA for 7d2a741

• test msgpack metadata

  Show description for 27936aa
  butonic

  committed
  27936aa

  Copy full SHA for 27936aa

• run all tests again

  Show description for 11ebb76
  butonic

  committed
  11ebb76

  Copy full SHA for 11ebb76

• test copy

  Show description for 80cad58
  butonic

  committed
  80cad58

  Copy full SHA for 80cad58

• log error when trying to read upload info

  Show description for 21301b4
  butonic

  committed
  21301b4

  Copy full SHA for 21301b4

• log upload info details when copying fails

  Show description for 6d1eb80
  butonic

  committed
  6d1eb80

  Copy full SHA for 6d1eb80

• log as error

  Show description for aa14928
  butonic

  committed
  aa14928

  Copy full SHA for aa14928

Commits on Nov 2, 2023

• reinitialze logger

  Show description for eaf5632
  butonic

  committed
  eaf5632

  Copy full SHA for eaf5632

• more logging

  Show description for 69b14f5
  butonic

  committed
  69b14f5

  Copy full SHA for 69b14f5

• declare length

  Show description for fb88329
  butonic

  committed
  fb88329

  Copy full SHA for fb88329

Commits on Nov 9, 2023

• use oc mtime as revision mtime

  Show description for 32f5141
  butonic

  committed
  32f5141

  Copy full SHA for 32f5141

• fix lint

  Show description for 1afb42a
  butonic

  committed
  1afb42a

  Copy full SHA for 1afb42a

• Merge branch 'edge' into use-tus-data-storage

  butonic

  committed
  1aaec6c

  Copy full SHA for 1aaec6c

• declare length only if it is available

  Show description for 96ece53
  butonic

  committed
  96ece53

  Copy full SHA for 96ece53

Commits on Nov 13, 2023

• allow overwriting existing revisions

  Show description for b421107
  butonic

  committed
  b421107

  Copy full SHA for b421107

• do not hide current revision

  Show description for 366dbd4
  butonic

  committed
  366dbd4

  Copy full SHA for 366dbd4

• Revert "do not hide current revision"

  Show description for 303440a
  butonic

  committed
  303440a

  Copy full SHA for 303440a

• persist revisions by current time, not oc mtime

  Show description for 8fc873a
  butonic

  committed
  8fc873a

  Copy full SHA for 8fc873a

Commits on Nov 14, 2023

• filter multiple revisions for the same mtime in ocdav

  Show description for 30ab0b6
  butonic

  committed
  30ab0b6

  Copy full SHA for 30ab0b6

• use metadata to store and filter current revision

  Show description for 2204836
  butonic

  committed
  2204836

  Copy full SHA for 2204836

• use oc mtime as revision time if given

  Show description for 7e295be
  butonic

  committed
  7e295be

  Copy full SHA for 7e295be

• reuse current revision if upload has same mtime

  Show description for 1b8c07c
  butonic

  committed
  1b8c07c

  Copy full SHA for 1b8c07c

• use mtime as revision time if given

  Show description for 052b04a
  butonic

  committed
  052b04a

  Copy full SHA for 052b04a

Commits on Nov 15, 2023

• track uploads in dedicated metadata

  Show description for 7bf1c79
  butonic

  committed
  7bf1c79

  Copy full SHA for 7bf1c79

• convert uploads to revisions

  Show description for 0b7abc5
  butonic

  committed
  0b7abc5

  Copy full SHA for 0b7abc5

• restore old revision logic

  Show description for 0df306e
  butonic

  committed
  0df306e

  Copy full SHA for 0df306e

Commits on Nov 16, 2023

• fix blobid passing

  Show description for d75bf9e
  butonic

  committed
  d75bf9e

  Copy full SHA for d75bf9e

• fix HasUploadMetadata interface

  Show description for 0077f19
  butonic

  committed
  0077f19

  Copy full SHA for 0077f19

• fix legacy chunking

  Show description for a832581
  butonic

  committed
  a832581

  Copy full SHA for a832581

• fix chinkung v1

  Show description for 84b9b8f
  butonic

  committed
  84b9b8f

  Copy full SHA for 84b9b8f

• only create revision on first overwrite

  Show description for 1ec133d
  butonic

  committed
  1ec133d

  Copy full SHA for 1ec133d

• restore writing revision before async processing

  Show description for c520b49
  butonic

  committed
  c520b49

  Copy full SHA for c520b49

Commits on Nov 17, 2023

• fix oldchunking revisions

  Show description for ba50382
  butonic

  committed
  ba50382

  Copy full SHA for ba50382

• refactor revisionkey split and join

  Show description for 90092e4
  butonic

  committed
  90092e4

  Copy full SHA for 90092e4

• no deet to store the current revision, use mtime

  Show description for 01b80cd
  butonic

  committed
  01b80cd

  Copy full SHA for 01b80cd

• fix mtime handling

  Show description for 508780c
  butonic

  committed
  508780c

  Copy full SHA for 508780c

• try to fix versions

  Show description for 53c509b
  butonic

  committed
  53c509b

  Copy full SHA for 53c509b

Commits on Nov 20, 2023

• Merge branch 'edge' into use-tus-data-storage

  butonic

  committed
  b91e7b3

  Copy full SHA for b91e7b3

• make test helper always send size

  Show description for a4b88d2
  butonic

  committed
  a4b88d2

  Copy full SHA for a4b88d2

• fix nc upload mock

  Show description for b4cbd8e
  butonic

  committed
  b4cbd8e

  Copy full SHA for b4cbd8e

• more test fixes

  Show description for ea4d951
  butonic

  committed
  ea4d951

  Copy full SHA for ea4d951

Commits on Nov 22, 2023

• revert dying if dataprovider does not support tus

  Show description for d790238
  butonic

  committed
  d790238

  Copy full SHA for d790238

• tus datatx logging cleanup

  Show description for 26524bf
  butonic

  committed
  26524bf

  Copy full SHA for 26524bf

• remove unused enable_home config for decomposedfs

  Show description for 88d4cb9
  butonic

  committed
  88d4cb9

  Copy full SHA for 88d4cb9

• cleanup

  Show description for aae59e3
  butonic

  committed
  aae59e3

  Copy full SHA for aae59e3

• fix linting

  Show description for ad21320
  butonic

  committed
  ad21320

  Copy full SHA for ad21320

• Merge branch 'edge' into use-tus-data-storage

  butonic

  committed
  39c6bb4

  Copy full SHA for 39c6bb4

• always send upload length

  Show description for 12b9979
  butonic

  committed
  12b9979

  Copy full SHA for 12b9979

• if index does not exist return empty list of matches

  Show description for 7bfc0e7
  butonic

  committed
  7bfc0e7

  Copy full SHA for 7bfc0e7

Commits on Nov 23, 2023

• do not require sending upload length

  Show description for 22f68c1
  butonic

  committed
  22f68c1

  Copy full SHA for 22f68c1

Commits on Nov 24, 2023

• Merge branch 'edge' into use-tus-data-storage

  butonic

  committed
  25ad42b

  Copy full SHA for 25ad42b

• also send content length to dataprovider

  Show description for b9e0f3e
  butonic

  committed
  b9e0f3e

  Copy full SHA for b9e0f3e

• fmt.Println debugging

  Show description for f3b262b
  butonic

  committed
  f3b262b

  Copy full SHA for f3b262b

Commits on Nov 27, 2023

• Add logging around file locks

  aduffeck

  committed
  98250c7

  Copy full SHA for 98250c7

Commits on Nov 28, 2023

• More logging

  Show description for e8155c8
  

  aduffeck

  authored and

  butonic

  committed
  e8155c8

  Copy full SHA for e8155c8

Commits on Nov 29, 2023

• Test if the hang is related to closing the response body

  aduffeck

  committed
  3538d62

  Copy full SHA for 3538d62

• More logging

  aduffeck

  committed
  cd73b5c

  Copy full SHA for cd73b5c

Commits on Dec 4, 2023

• Merge branch 'edge' into use-tus-data-storage

  butonic

  committed
  767df60

  Copy full SHA for 767df60

• Merge branch 'edge' into use-tus-data-storage

  butonic

  committed
  5e8383c

  Copy full SHA for 5e8383c

• remove debug logging

  Show description for 89f9606
  butonic

  committed
  89f9606

  Copy full SHA for 89f9606

• more cleanup

  Show description for a5edbe5
  butonic

  committed
  a5edbe5

  Copy full SHA for a5edbe5

Commits on Dec 5, 2023

• Apply suggestions from code review

  Show description for d99a424
  

  butonic

  and

  aduffeck

  authored
  d99a424

  Copy full SHA for d99a424

• use log from context

  Show description for 2d95dcc
  butonic

  committed
  2d95dcc

  Copy full SHA for 2d95dcc

• simplify if conditions

  Show description for 87916ac
  butonic

  committed
  87916ac

  Copy full SHA for 87916ac

• fix typo

  Show description for 5053013
  butonic

  committed
  5053013

  Copy full SHA for 5053013

• fix listing and purging upload sessions

  Show description for 1a35958
  butonic

  committed
  1a35958

  Copy full SHA for 1a35958

• drop comment

  Show description for ea559e1
  butonic

  committed
  ea559e1

  Copy full SHA for ea559e1

• fix upload progress creation and read offset from tus upload

  Show description for 829df6d
  butonic

  committed
  829df6d

  Copy full SHA for 829df6d

• read uploads concurrently

  Show description for 747f8f7
  butonic

  committed
  747f8f7

  Copy full SHA for 747f8f7

• fix loading upload sessions

  Show description for b643432
  butonic

  committed
  b643432

  Copy full SHA for b643432

• Purge both the metadata and the upload info when finalizing

  aduffeck

  committed
  5c9beca

  Copy full SHA for 5c9beca

• Use Size when reporting the size

  aduffeck

  committed
  9c2ed70

  Copy full SHA for 9c2ed70

Commits on Dec 6, 2023

• Implement tus datastores which support cleaning up metadata only

  aduffeck

  committed
  9167e4b

  Copy full SHA for 9167e4b

Commits on Dec 7, 2023

• Directly write blob to the right location in s3

  aduffeck

  committed
  086e321

  Copy full SHA for 086e321

• Clarify naming

  aduffeck

  committed
  c11ca05

  Copy full SHA for c11ca05

• WIP: Get rid of separate tus fileinfo metadata

  Show description for be393b3
  aduffeck

  committed
  be393b3

  Copy full SHA for be393b3

• make filestore upload session compatible

  Show description for f8264b5
  butonic

  committed
  f8264b5

  Copy full SHA for f8264b5

• Do not read the session we just created just to get the ID

  aduffeck

  committed
  7d3ae90

  Copy full SHA for 7d3ae90

• Simplify finishing the upload

  aduffeck

  committed
  d41ec1e

  Copy full SHA for d41ec1e

• Retrieve the upload offset from the session instead of reading the parts

  aduffeck

  committed
  e3ba91d

  Copy full SHA for e3ba91d