Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test a long running batch job #61

Open
claudiofahey opened this issue Jun 17, 2020 · 0 comments
Open

Test a long running batch job #61

claudiofahey opened this issue Jun 17, 2020 · 0 comments

Comments

@claudiofahey
Copy link
Contributor

A Spark batch job that writes to Pravega will use the transactional writer. Transactions may be in an open state for the entire duration of the job and they will be committed only at the end. Determine if there are any limits on the duration or size (in bytes) of such a batch job. We should test at least 3 TB and 24 hours.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants