Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Individual version directories can be stored external to the OCFL object #27

Closed
ahankinson opened this issue Jun 5, 2018 · 9 comments
Closed
Labels
Confirmed: Out-of-scope Use case will not be included in the upcoming version of the spec or implementation notes. duplicate

Comments

@ahankinson
Copy link
Contributor

ahankinson commented Jun 5, 2018

A library has limited on-site storage and is using an external provider with an object store for hosting the majority of its bitstreams. The OCFL Object inventory should be able to accommodate multiple remote storage locations for a version directory to allow for multi-site, off-site storage with the on-site inventory being used for local lookups.

There can be multiple storage roots, and these can be a mixture of both local and remote.

Related to #10

See: OCFL/spec#22

@ahankinson ahankinson added the Proposed: In-Scope Use case is up for discussion and may change the spec, implementation notes, or become an extension. label Jun 5, 2018
@ahankinson
Copy link
Contributor Author

Additionally, multi-site storage can be used to provide distributed content resolution, e.g., distributing content to multiple cloud providers while still maintaining a local copy.

@zimeon
Copy link
Contributor

zimeon commented Jun 19, 2018

It seems that putting storage location information INTO the inventory would break the idea that the OCFL object is an archival object because you'd have to change it when you change/migrate storage (something we know happens every few years).

If we want to add storage management into the scope of this work then I think we need a layered approach where there is still a core notion of an archival object that doesn't know where it lives (and thus doesn't change when it moves) at the core, and at a higher layer some notion of locations and distributions.

@zimeon
Copy link
Contributor

zimeon commented Jun 19, 2018

... it could be that the core archival object becomes a version of a URI identified thing so that versions can live in different places. Rules from completeness and reconstitution may become complex however.

@ahankinson
Copy link
Contributor Author

I think this comes from the idea that the 'archival object' is multi-homed; that is, redundant resolution endpoints are part of the process of archiving it.

Point taken about the 'change/migrate' and the associated updates to your objects, though.

@zimeon
Copy link
Contributor

zimeon commented Jun 20, 2018

I note similarity with fetch.txt in bagit, and also idea of Complete and Valid bags

@ahankinson ahankinson added Confirmed: Out-of-scope Use case will not be included in the upcoming version of the spec or implementation notes. and removed Proposed: In-Scope Use case is up for discussion and may change the spec, implementation notes, or become an extension. labels Sep 5, 2018
@ahankinson
Copy link
Contributor Author

F2F 2018.09.05: This is out-of-scope for v1; it may be in-scope for v2.

@zimeon
Copy link
Contributor

zimeon commented Aug 20, 2019

Per 2018-09-05 comment, reconsider for v2

@zimeon zimeon reopened this Aug 20, 2019
@zimeon zimeon added Proposed: In-Scope V2 and removed Confirmed: Out-of-scope Use case will not be included in the upcoming version of the spec or implementation notes. labels Aug 20, 2019
@rosy1280 rosy1280 added Proposed: In-Scope Use case is up for discussion and may change the spec, implementation notes, or become an extension. and removed Proposed: In-Scope V2 labels Nov 17, 2020
@rosy1280
Copy link
Contributor

potentially a sub-use case of #39

@neilsjefferies neilsjefferies added Confirmed: Out-of-scope Use case will not be included in the upcoming version of the spec or implementation notes. duplicate and removed Proposed: In-Scope Use case is up for discussion and may change the spec, implementation notes, or become an extension. labels Sep 22, 2023
@neilsjefferies
Copy link
Member

Editors 2023.09.22:
Replication is outside the remit of OCFL since it concerns objects in motion and logically sits above the storage root conceptual level.
Storage roots should be internally consistent and complete so sharding object versions between them should be avoided.
Other cases are covered by #39

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Confirmed: Out-of-scope Use case will not be included in the upcoming version of the spec or implementation notes. duplicate
Projects
None yet
Development

No branches or pull requests

4 participants