Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Storage requirements #74

Open
lcebaman opened this issue Aug 12, 2020 · 3 comments
Open

Storage requirements #74

lcebaman opened this issue Aug 12, 2020 · 3 comments

Comments

@lcebaman
Copy link

What are the storage requirements to run the io500.sh config-minimal.ini benchmark ? Does this depend on the number of MPI processes? With just 2 MPI processes 2 files of more than 200GB each are created, this can quickly scale out of control if run on 10 fully populated nodes.

@JulianKunkel
Copy link
Contributor

It depends on the performance of your system. As the write phase runs for at least 300s a first estimate is the write performance of your system * 300. But that is for IOR Easy only. IOR hard typically leads to less throughput but runs as well for 300s.

@lcebaman
Copy link
Author

we are quite storage capacity limited at the moment. Will the IO500 results on 2 MPI processes be a good indicator of our IO performance?

@JulianKunkel
Copy link
Contributor

You could run the benchmark for a shorter stonewall time (e.g. 30s) instead.
It depends on how many (storage) servers you may have. Having two MPI processes but 10 storage servers will not be able to exploit the available bandwidth as it will be bound by the performance of the two clients.
Personally, I would say it isn't sensible to run with less MPI processes than storage servers. Probably 2x clients are at least needed to somewhat get close to available performance.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants