I am using a HPC system in which the folder /usr/ is not NFS. Therefore, the libraries installed in the master node do not seem available in the computation nodes, that is, if I ssh to a computer node and do ls /usr/lib/, the libraries installed in the master node do not show up. Is that normal?

If that is the expected behavior, how can I execute certain programs requiring these libraries in the computation nodes? Adding /usr/lib to LD_LIBRARY_PATH does not work because the libraries are not there (and apparently anywhere) in the nodes. Should I install all the libraries in all the computation nodes or is there a more efficient way to proceed?

My apologies if the question is too naive, I am a newbie in this topic and I have failed to find a clear answer in the web.

3 Replies 3

What's stopping you from installing said files? Let's assume compute nodes consist of alternating hardware and OS; in Unix, you wouldn't remotely mount one common set of executables or dependencies from a different system

Q: "If I ssh to a computer node and do ls /usr/lib/, the libraries installed in the Master Node do not show up. Is that normal?"

A: Usually, yes. But it might depend on the design and infrastructure. You may need get in contact with the administrator or operator of the HPC. Maybe there is a Cluster Manager or other cluster software in place which could do the job for you.

Q: "If that is the expected behavior, how can I execute certain programs requiring these libraries in the Computation Nodes?"

A: You could resolve the dependencies on all the Compute Nodes, means pre-install the necessary libraries there. You could pack your program or tools with all the necessary dependencies together, maybe as zip file, transfer it over, unpack, unzip and execute. You could compile your program or tool with static linked libraries which contains everything you need.

What stops me from installing all those libraries is that the IT that made the HPC installation said it was not necessary because the architectures of the nodes were very similar. But then I tried to install a few programs and I did not find the way, unless the libraries were also installed in /usr/lib at each CN. I asked the IT for clarification but his company required 3000€ for that. After a few weeks struggling and looking for info, I had the suspicious that maybe the IT was wrong, but since I am a newbie I wanted to be sure.

I have followed your answers and everything works fine in the CN. Many thanks!!

Your Reply

By clicking “Post Your Reply”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.