-
Notifications
You must be signed in to change notification settings - Fork 25
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Amg comm cali v2 #318
base: develop
Are you sure you want to change the base?
Amg comm cali v2 #318
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This file should not be in this PR.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@gracenansamba Please test this on Dane using the Dane config I just added. We should stop using the Magma config on other systems. Please also test the develop on Dane.
@@ -34,7 +34,8 @@ ramble: | |||
software: | |||
packages: | |||
osu-micro-benchmarks: | |||
pkg_spec: osu-micro-benchmarks | |||
pkg_spec: osu-micro-benchmarks@comm_cali +mpi+openmp{modifier_spack_variant} | |||
# pkg_spec: osu-micro-benchmarks |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@gracenansamba @pearce8 osu-micro-benchmarks does not support the mpi and openmp variants (mpi is always enabled). We also need to add the comm_cali branch to the osu-micro-benchmarks package.py. It may be better to separate the amg2023 and OSU changes into two PRs. amg2023 comm_cali changes work on ruby and can be taken to main as its own PR.
@@ -31,7 +31,7 @@ class Amg2023(CMakePackage, CudaPackage, ROCmPackage): | |||
depends_on("caliper", when="+caliper") | |||
depends_on("adiak", when="+caliper") | |||
depends_on("hypre+caliper", when="+caliper") | |||
depends_on("[email protected]:") | |||
depends_on("hypre@3.1_comm_cali") #depends_on("hypre@2.31.0:") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
depends_on("hypre@3.1_comm_cali") #depends_on("hypre@2.31.0:") | |
depends_on("[email protected]:", when="~caliper") | |
depends_on("[email protected]_comm_cali", when="+caliper") |
2a2ff50
to
480cedf
Compare
480cedf
to
1fde852
Compare
On this branch, I have added the new version on hypre and build on both
LLNL-Magma-Penguin-icelake-OmniPath and LLNL-Ruby-icelake-OmniPath but it gives the error below
Error: mvapich2-2.3.7-gcc1211-ba7pgawdzevxpglrdk24r535qxzwjig6 cannot be installed locally: is external
[+] /usr/tce/packages/mvapich2/mvapich2-2.3.7-gcc-12.1.1 (external mvapich2-2.3.7-gcc1211-ba7pgawdzevxpglrdk24r535qxzwjig6)
[+] /usr/tce/backend/installations/linux-rhel8-x86_64/intel-19.0.4/intel-oneapi-mkl-2022.1.0-sksz67twjxftvwchnagedk36gf7plkrp (external intel-oneapi-mkl-2022.1.0-7llgckpv3lwue4s5wvqv5v5kl4ffwttk)
[+] /usr/tce/packages/cmake/cmake-3.23.1 (external cmake-3.23.1-6iyz3a45sv25ts5ztlhpcegyj6lm57jr)
[+] /usr (external glibc-2.28-beut3q26btehwxb2iorw4r5ujpbfgpo3)
[+] /usr (external gmake-4.2.1-k6pc4zc3jem34sxxp32fal6o5ydskw2b)
==> Error: Command exited with status 1:
'/g/g91/nansamba1/intern/benchparkRunsJuly22_amg2023/spack/bin/spack' 'install' '--add' '--keep-stage'
==> Error: Error running spack command: /g/g91/nansamba1/intern/benchparkRunsJuly22_amg2023/spack/bin/spack install --add --keep-stage
==> Error: For more details, see the log file: /g/g91/nansamba1/intern/benchparkRunsJuly22_laghos/amg2023/openmp/LLNL-Ruby-icelake-OmniPath/workspace/logs/setup.2024-07-22_16.35.57/amg2023.problem1.amg2023_omp_problem1_1_4_2_2_2_55_55_55.out