Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Installation instruction does not mention which CUDA or NVIDIA drivers are required #554

Closed
SupermicroML opened this issue Oct 26, 2023 · 2 comments

Comments

@SupermicroML
Copy link

SupermicroML commented Oct 26, 2023

When we follow the instructions below

_pip3 install -e '.[pytorch_cpu]'
pip3 install -e '.[jax_gpu]' -f 'https://storage.googleapis.com/jax-releases/jax_cuda_releases.html'
pip3 install -e '.[full]'
TL;DR to install the PyTorch version for GPU run:

pip3 install -e '.[jax_cpu]'
pip3 install -e '.[pytorch_gpu]' -f 'https://download.pytorch.org/whl/torch_stable.html'
pip3 install -e '.[full]'_

They automatically install torch for CUDA 11.8. However the host system may have different CUDA version and NVIDIA driver at the time of installation. Perhaps it is good to add a seciton "Prerequsites" and add CUDA version details inside. This will prevent mismatch between package versions. The same is also valid for the Docker build steps.

For example, if the developers have CUDA > 12.0, can they still install the package or they need to downgrade CUDA to 11.8?

Best Regards,
Nikola

@priyakasimbeg
Copy link
Contributor

priyakasimbeg commented Nov 14, 2023

Hi Nikola,
Thanks for the suggestion! We will document the driver and CUDA version.

The same is also valid for Docker build steps.

The CUDA version (11.8) is built into the Docker image and your global system level CUDA installation does not affect anything in the docker build process.

For example, if the developers have CUDA > 12.0, can they still install the package or they need to downgrade CUDA to 11.8?

If developers have a different version of CUDA we recommend running the container build from the image in docker/Dockerfile.

Does this address your concerns?

@priyakasimbeg
Copy link
Contributor

Updated documentation in #570

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants