MPI application hangs without any output.
Application does not use MPI in a correct way.
Run your MPI application with the -check_mpi option to perform correctness checking. The correctness checker is specifically designed to find MPI errors, and provides tight integration with the Intel® MPI Library. In case of a deadlock, the checker will set up a one-minute timeout and show the state of each rank.
For more information, refer to this page.
The remote service (for example, SSH) is not running on all nodes or it is not configured properly.
Check the state of the remote service on the nodes and connection to all nodes.
The Intel® MPI Library runtime scripts are not available, so the shared space cannot be reached.
Check if the shared path is available across all the nodes.
Different CPU architectures are used in a single MPI run.
Set export I_MPI_PLATFORM=<arch> , where <arch> is the oldest platform you have, for example skx. Note that usage of different CPU architectures in a single MPI job negatively affects application performance, so it is recommended not to mix different CPU architecture in a single MPI job.