Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

do not re-zip entire project if only cloudexec.toml changes #51

Open
0xalpharush opened this issue Jul 15, 2024 · 1 comment
Open

do not re-zip entire project if only cloudexec.toml changes #51

0xalpharush opened this issue Jul 15, 2024 · 1 comment

Comments

@0xalpharush
Copy link
Contributor

Each invocation of cloudexec creates a new entry in blob storage even if only one line changes. This probably is inconsequential normally but I had a binary in my local directory and very quickly stored a gig in blob storage.

@bohendo
Copy link
Collaborator

bohendo commented Jul 26, 2024

First thought: hash the zip and don't upload it if it's the same as a previous upload.. Obviously the whole repo will be re-zipped every time, but we could at least skip the upload step.

Second thought: we could check the git status and re-zip everything if the commit changes or if there are uncommitted changes in any file besides cloudexec.toml.

Either way, we'll need to add some kind of repo info to the job's state + the ability to use a previous job's input + logic for replacing the previous job's input with a new cloudexec.toml.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants