66 questions
0
votes
0
answers
22
views
How can i let the process to different ranks not only on rank 0?
I got some MISTAKE when trying to bind the program with IntelMPI.
#define _GNU_SOURCE
#include <stdio.h>
#include <unistd.h>
#include <string.h>
#include <sched.h>
#include <...
0
votes
0
answers
95
views
Unrecognised compiler commands in a compiler config file ran using the mpiifort command
Hi I'm trying to compile and run a .f90 code using the intel fortran compiler (ifx) and the intel mpi library on a linux HPC.
I'm invoking the compiler through a .sh script with the following lines:
...
- 15
1
vote
2
answers
110
views
intelmpi 2021.1 error on RHEL 8 with error integer divide by zero
After upgrade computation nodes of a HPC cluster from CentOS 7 to a RHEL8.6 Linux distribution (KeyarchOS 5.8), I get report that some software compiled with Intel OneAPI 2021.1 failed to run with ...
- 1,979
0
votes
0
answers
45
views
Different behavior between mpich and intel mpi when using MPI_Isend with higher buffer size
This is the example code:
#include <mpi.h>
#include <cstdlib>
#include <iostream>
using namespace std;
int main(int argc, char *argv[]) {
int size, rank;
const int root = 0;
...
1
vote
0
answers
340
views
Specifying Network Interface When Using Slurm and Intel MPI
I am trying to run a pytorch application that uses DDP and MPI as a communication backend.
I am running it on a cluster that has two network interfaces on all the nodes, a fast ethernet network ...
0
votes
1
answer
2k
views
mpirun ERROR : No PMIx server was reachable
When I use mpirun to run the osu_bw , it errors ,here is my log:
$ which mpirun
/data/software/install/oneapi/mpi/latest/bin/mpirun
# I'm using Intel MPI
$ mpirun -np 2 ./osu_bw
No PMIx server was ...
- 1
0
votes
1
answer
643
views
Why Intel Fortran + Intel MPI report warn(error) when using MPI_Bcast?
Here is a simple code of fortran with MPI:
program mpi_broadcast_example
use mpi
implicit none
integer :: ierr, rank, size, root
integer :: a
call MPI_Init(ierr)
call ...
0
votes
1
answer
761
views
SLURM: Run two MPI jobs with different settings on same set of nodes
I have a slurm batch script, and I'm running Intel MPI.
I want to run two different MPI codes on the same set of nodes with different process placement configurations.
I'm running two MPI codes, one ...
- 11
7
votes
0
answers
3k
views
Intel OneAPI MPI MKL with AMD, is there an AMD flavor?
I've always happened to use Intel cpus in intel chipset based servers, as such have used Intel's MPI and MKL for the past 20 years that's all I kinda know. With their OneAPI I only need and use MPI, ...
- 1,035
0
votes
0
answers
107
views
Running a dlsym function with high risk of segfault
Hi im trying to open libraries (openMPI & IntelMPI) (.so) files to list all of thoses present in my system and get their version.
so i made some code to list of versions of openMPI and IntelMPI ...
0
votes
2
answers
911
views
Fatal error in PMPI_Send: Invalid tag, error stack: MPI_Send(
I am using MPI to parallelise my Fortran code. The code below is the parellelisation part. I use 2 nodes to run the program.
1 DO i = 1, km(1), 1
2 DO j = 1, km(2), 1
3 DO k = 1, ...
- 271
0
votes
1
answer
162
views
MPI_Scatterv from Intel MPI (mpiifort) using MPI data types is much slower (23 times) compared to flattening array and scattering. Why it could be?
ifort version: (IFORT) 2021.8.0 20221119
OS: WSL Ubuntu 20.04LTS
I have a (1000x1000x1000) 3D array to distribute among procs. In the first approach, I flatten the array and then distribute arrays ...
- 106
0
votes
1
answer
45
views
How to trace individual point-to-point events of MPI collective routines?
MPI Collective routines are implemented using p2p routines. I am trying to find out what p2p events (in terms of sender,receiver,message size) make up the collective routines. In other words, I want ...
- 53
0
votes
1
answer
66
views
Makefile: fail to compile and link due to missing separator error
I wrote a Makefile to compile my C source codes and generate .o, .d files which aim to be stored at another directory different from where the source .c codes reside. Here is a copy of my Makefile:
...
- 37
1
vote
1
answer
391
views
List all the collective algorithm for Intel MPI
How to find the available collective algorithm for Broadcast in Intel MPI.
In case of OpenMPI, we can list all the available MPI collective algorithm for Broadcast using
ompi_info --param coll tuned -...
- 1,674
0
votes
1
answer
333
views
Pass IntelMPI flag to SLURM environment
How is it possible to pass the IntelMPI flag -print-rank-map as input to the srun command or as an environment variable into the batch script which is submitted in a SLURM system via the sbatch ...
- 141
0
votes
1
answer
215
views
Usage of all available threads for OMP inside Master MPI only part - hybrid parallel programming
Is it possible to use all available threads for OMP on a region where only master MPI is active?. I mean something like this:
START
|
MPI-I --------- MPI-II
(master)
| ...
- 1
1
vote
1
answer
1k
views
mpirun hangs without an error message or debug
ISSUE: MPIRUN hangs and does not display any error message even with I_MPI_DEBUG 100
example:
tried with any IMB-* benchmarks or even simple task as display hostname.
mpirun -n 2 hostname
it will ...
- 11
0
votes
0
answers
210
views
MPI allocating massive amounts of memory on startup
I am trying to run an MPI application compiled with mpiifort (ifort (IFORT) 2021.6.0 20220226) using mpiexec.hydra (Intel(R) MPI Library for Linux* OS, Version 2021.6 Build 20220227 (id: 28877f3f32)), ...
- 136
0
votes
1
answer
738
views
Slots command in hostfile for mpirun not recognised
I saw another question that seemed similar mpirun: token slots not supported but their solution did not work for me.
I get the error
token slots not supported at this time
when running the command ...
- 11
1
vote
0
answers
192
views
Is there an environment variable to force multithreading for IntelMPI on Linux?
MPICH and OpenMPI both are implementations of MPI and have each an environment variable, respectively MPIR_CVAR_DEFAULT_THREAD_LEVEL and OMPI_MPI_THREAD_LEVEL, to force the level of thread support, ...
0
votes
0
answers
748
views
Error while running a slurm job through crontab which uses Intel MPI for parallization
I am trying to run WRF (real.exe, wrf.exe) through the crontab using compute nodes but compute nodes are not able to run slurm job. I think there is some issue with the MPI library when it's running ...
- 1
0
votes
0
answers
1k
views
Error while running a slurm job through crontab which uses Intel MPI
I am trying to run WRF (real.exe, wrf.exe) through the crontab using compute nodes but compute nodes are not able to run slurm job. I think there is some issue with the MPI library when it's running ...
- 1
2
votes
1
answer
509
views
Intel MPI 2019 always using gcc version 4.9.3
Is there a way to specify the GCC version in intel MPI while I use the mpicc command to compile a program?
- 91
1
vote
0
answers
106
views
Strange occurrence with a send/recv MPI pair
I have an application where the root rank is sending messages to all ranks in the following way:
tag = 22
if( myrankid == 0 )then
do i = 1, nproc
if(I==1)then
do j = 1, nvert
...
- 1,546
0
votes
1
answer
109
views
How to check if all the pre-requisites required for MPI to run has been applied?
How to check if all the pre-requisites required for MPI to run has been applied? I want to verify whether the cluster is configured as expected or not.
- 622
0
votes
0
answers
66
views
Cache-Misses in OSU Unidirectional Bandwidth Test
We are measuring the cache-misses in MPI_Isend()+MPI_Waitall() at the Sender and MPI_Irecv()+MPI_Waitall() at the receiver for the OSU unidrectional bandwidth benchmark. Suprisingly, the cache-misses ...
- 729
0
votes
1
answer
4k
views
mpiicpc: Command not found
I have a problem when trying to compile a code in C++. I installed the Intel Parallel Studio XE Cluster Edition 2020 but when i try to compile i have the following error : "mpiicpc: Command not ...
1
vote
0
answers
104
views
Why does fortran child cause mpi4py error when spawning?
I have an mpi4py python code that spawns a Fortran executable.
The code prceeds happily enough, spawning and disconnecting from the Fortran child - however occasionally the code fails with the ...
- 849
0
votes
1
answer
2k
views
Running MPI job on multiple nodes with slurm scheduler
I'm trying to run an MPI application with a specific task/node configuration. I need to run a total of 8 MPI tasks 4 of which on one node and 4 on another node.
This is the script file I'm using:
#!/...
1
vote
0
answers
2k
views
Is process-pinning like with Intel-MPI possible in OpenMPI?
With Intel-MPI I can pin the MPI processes started by mpirun to a certain cores on a node.
For example with 24 cores and Intel-MPI:
mpirun -np 12 -genv I_MPI_PIN_PROCESSOR_LIST=0-11 ./some.exe &
...
- 173
0
votes
1
answer
626
views
Having trouble installing mpi4py with Intel MPI
The title says it all. I have Intel MPI installed on my AWS instance and have sourced it to activate, and which mpiexec works and tells me its the Intel MPI. I don't have any other MPI installed right ...
1
vote
0
answers
334
views
Uploading Program to OpenMPI gives initialization error, on IntelMPI memory leak
I am a graduate student (master's) and use an in-house code for running my simulations that use MPI. Earlier, I used OpenMPI on a supercomputer we used to access and since it shut down I've been ...
- 11
2
votes
0
answers
1k
views
can't compile OpenFOAM v1912 with intel icc and intelmpi
! UPDATE on 28 Feb, 2020:
The problem is solved. please refer to :https://develop.openfoam.com/Development/openfoam/issues/1608
Summary
I'm new to OpenFOAM and I'm trying to compile OpenFOAM-v1912 ...
- 21
0
votes
1
answer
62
views
What is the best job scheduler policy to prioritize small HPC jobs for weak-scaling tests?
I am interested in performing weak scaling tests on an HPC cluster. In order to achieve this, I run several small tests on 1,2,4,8,16,32,64 nodes with each simulation taking less than a minute to ...
- 369
6
votes
1
answer
1k
views
How to load balance a simple loop using MPI in C++
I am writing some code which is computationally expensive, but highly parallelisable. Once parallelised, I intend to run it on a HPC, however to keep the runtime down to within a week, the problem ...
- 325
3
votes
2
answers
352
views
Seg fault in fortran MPI_COMM_CREATE_GROUP if using a group not directly created from MPI_COMM_WORLD
I'm having a segmentation fault that I can not really understand in a simple code, that just:
calls the MPI_INIT
duplicates the global communicator, via MPI_COMM_DUP
creates a group with half of ...
- 145
2
votes
1
answer
703
views
OpenMPI MPI_Send vs Intel MPI MPI_Send
I have a code which I compile and run using openmpi. Lately, I wanted to run this same code using Intel MPI. But my code is not working as expected.
I digged into the code and found out that MPI_Send ...
- 189
0
votes
1
answer
429
views
What is the use of status of MPI_Isend obtained using MPI_Wait?
Case: 1. What is the use of status obtained using MPI_Wait()
if(rank==0)
MPI_Isend(&buffer0, count, MPI_INT, 1, 0, MPI_COMM_WORLD, &request0);
if(rank==1)
MPI_Recv(&buffer1, count, ...
- 649
0
votes
1
answer
184
views
Intel MPI benchmark fails when # bytes > 128: IMB-EXT
I just installed Linux and Intel MPI to two machines:
(1) Quite old (~8 years old) SuperMicro server, which has 24 cores (Intel Xeon X7542 X 4). 32 GB memory.
OS: CentOS 7.5
(2) New HP ProLiant ...
- 1
5
votes
1
answer
1k
views
Get number of MPI Communicators in use
I have a large code, that crashes with the following error:
Fatal error in PMPI_Comm_split: Other MPI error, error stack:
PMPI_Comm_split(532)................: MPI_Comm_split(comm=0xc4027cf0, color=0,...
- 3,281
1
vote
1
answer
507
views
What is the differences between "-genvall" and "-envall"?
When I need to pass my environment variables in my mpi job, what is the differences between "-genvall" and "-envall" options? I really cannot understand the description in man file.
- 41
3
votes
1
answer
2k
views
How to link mpi4py against intelmpi
I would like to install mpi4py against intelmpi and this is exactly what i see when i do a module list.
however mpi4py.get_config() shows openmpi after these trials:
pip install mpi4py
env MPICC=/...
- 651
1
vote
0
answers
2k
views
why does mpirun behave as it does when used with slurm?
I am using Intel MPI and have encountered some confusing behavior when using mpirun in conjunction with slurm.
If I run (in a login node)
mpirun -n 2 python -c "from mpi4py import MPI; print(MPI....
- 1,622
0
votes
1
answer
786
views
IntelMPI error (Works with openMPI)
I am getting this error and was wondering how I fix it. A little background: it works in open mpi but not intel mpi.
The error:
Fatal error in MPI_Recv: Invalid argument, error stack:
MPI_Recv(200): ...
- 94
1
vote
0
answers
3k
views
Performance comparison issue between OpenMPI and Intel MPI
I am working with a C++ MPI code which when compiled with openMPI takes 1min12 seconds and 16 seconds with Intel MPI (I have tested it on other inputs too, difference is similar. Both compiled codes ...
- 11
0
votes
0
answers
160
views
connect infiniband with intel mpi or other mpi(like openMPI)
I'm new about how to build a infiniband network, and i have not find some useful url about how to do it in windows OS.
I wanna to do that need to connect 5~8 servers with infiniband network in windows ...
- 3
0
votes
0
answers
214
views
How can DAPL offer more functionality than OFA does if DAPL relies solely on OFA as the only layer beneath it?
In my understanding if a system that only has underlying Infiniband connectivity (i.e. not iWarp or anything else which DAPL could use as an alternative) then DAPL exists solely as an abstracted layer ...
- 175
1
vote
1
answer
4k
views
Why does Intel MPI use DAPL and OpenMPI native ibverbs?
I don't understand why Intel MPI use DAPL, if native ibverbs are faster than DAPL, OpenMPI use native ibverbs.
However, in this benchmark IntelMPI achieves better performance.
http://www....
- 175
0
votes
1
answer
4k
views
Intel MPI - mpiexec.exe does not run, only gives a blank screen
I have some problem running mpiexec.exe on my computer. I installed intel parallel studio xe cluster edition on my windows 10 laptop, which includes intel-mpi. Then I registered my mpi following this ...
- 11