Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

P2P Download #678

Open
AlexCheema opened this issue Feb 4, 2025 · 0 comments
Open

P2P Download #678

AlexCheema opened this issue Feb 4, 2025 · 0 comments

Comments

@AlexCheema
Copy link
Contributor

AlexCheema commented Feb 4, 2025

With the new shard download, we have Content-Range resumable downloads with integrity checks so we should be able to give a list of candidate download URLs (in list of priority) and exo can try downloading from each one in turn.

This should be an easy way to get P2P downloads working - each node exposes a HTTP endpoint to serve models to others with Content-Range support. Should just work.

we probably want to keep downloading from the same URL but periodically (e.g. every 5 secs) check if a better candidate is available. any error means try next candidate. also we would want to make sure we don't have partial writes to the file that can corrupt it - this wouldn't ever lead to a corrupt download since we have an integrity check but it might lead to infinite download loop

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant