fprof pfind can't be built without OpenMPI

[glennklockwood]

In trying to build the new pfind in build/pfind, it appears that pfind depends on libcircle, and libcircle depends on OpenMPI. Unfortunately OpenMPI is not always available or viable (e.g., in Cray Linux Environments), so pfind cannot be run on these systems.

Is there a way to build some form of parallel find that doesn't have these dependencies that would still comply with the IO500 run rules?

[adilger]

On Jun 12, 2018, at 4:40 PM, Glenn K. Lockwood ***@***.***> wrote: In trying to build the new pfind in build/pfind, it appears that pfind depends on libcircle, and libcircle depends on OpenMPI. Unfortunately OpenMPI is not always available or viable (e.g., in Cray Linux Environments), so pfind cannot be run on these systems. Is there a way to build some form of parallel find that doesn't have these dependencies that would still comply with the IO500 run rules?

Actually, I see hpc/libcircle#27 "Compiling in Cray Env" that was opened 4 days ago already discusses this... I was going to suggest to chime in to get some attention there, but that project hasn't been updated in a few years... I know that ORNL and LLNL are also actively working on https://github.com/olcf/pcircle which is a parallel filesystem scanning tool, but it is written in Python so we would need a different pfind implementation for that. I've submitted a feature request for that to pcircle, since my python skills are largely non-existent. Cheers, Andreas

[gmarkomanolis]

Hi Glenn, Here is how I installed libcircle, it is a bit dirty solution. 1. I did follow Julian’s instructions here: hpc/libcircle#27 1. Then I did modify the configure file In the line 13664, edit only the below lx_ commands lx_mpi_compile_line=`$MPICC --version` if [ "$?" -eq 0 ]; then echo yes lx_mpi_command_line="$MPICC" lx_mpi_compile_line="$MPICC" else … I used GNU environment (it will fail with Cray as there are used some other arguments) I did execute: export MPICC=cc then ./configure --prefix=/path/ make & make install Then use LD_PRELOAD_PATH for the installation of pfind. regards, George

…

On Wed, Jun 13, 2018 at 2:21 AM, adilger ***@***.***> wrote: On Jun 12, 2018, at 4:40 PM, Glenn K. Lockwood ***@***.***> wrote: > > In trying to build the new pfind in build/pfind, it appears that pfind depends on libcircle, and libcircle depends on OpenMPI. Unfortunately OpenMPI is not always available or viable (e.g., in Cray Linux Environments), so pfind cannot be run on these systems. > > Is there a way to build some form of parallel find that doesn't have these dependencies that would still comply with the IO500 run rules? Actually, I see hpc/libcircle#27 "Compiling in Cray Env" that was opened 4 days ago already discusses this... I was going to suggest to chime in to get some attention there, but that project hasn't been updated in a few years... I know that ORNL and LLNL are also actively working on https://github.com/olcf/pcircle which is a parallel filesystem scanning tool, but it is written in Python so we would need a different pfind implementation for that. I've submitted a feature request for that to pcircle, since my python skills are largely non-existent. Cheers, Andreas — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#25 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/ACZAe9h9sL_6TAM20-ZmNCwYxmF7rHaeks5t8EzhgaJpZM4UlQ6f> .