SU2_CFD can run with parallel ，but can not run serial

[Zcaic]

Desktop (please complete the following information):

• OS: [ WSL (Mint 21.2)]
• C++ compiler and version: [g++ (GCC) 11.4.0]
• MPI implementation and version: [OpenMPI 4.1.2]
• SU2 Version: [v7.5.1]

I compile SU2 with

export CXXFLAGS="-march=native -funroll-loops -O2"
./meson.py build -Denable-autodiff=true -Denable-directdiff=true --prefix=/opt/su2
./ninja -C build install

And it compiles successfully. When I run QuickStart with mpirun -n 2 SU2_CFD inv_NACA0012.cfg, it can run sucessfully, but when I run serial with SU2_CFD inv_NACA0012.cfg, I get a error:

[DESKTOP-7ALPJDS:00356] *** An error occurred in MPI_Win_create
[DESKTOP-7ALPJDS:00356] *** reported by process [235864065,0]
[DESKTOP-7ALPJDS:00356] *** on communicator MPI_COMM_WORLD
[DESKTOP-7ALPJDS:00356] *** MPI_ERR_WIN: invalid window
[DESKTOP-7ALPJDS:00356] *** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
[DESKTOP-7ALPJDS:00356] ***    and potentially your MPI job)

It seems that SU2 was able to run successfully in parallel, but something went wrong with running serially.

[kursatyurt]

Try to run with mpirun -n 1 SU2_CFD inv_NACA0012.cfg if you only want to run on one process.

This error probably happens with the call

@pcarruscag does this behavior can be count as a bug?

[pcarruscag]

🤷 I don't see anything in the docs saying the function can't be called in serial, at most it's something we can work around.

[pcarruscag]

https://www.open-mpi.org/doc/v4.0/man3/MPI_Win_create.3.php

[kursatyurt]

Sounds like an OpenMPI issue open-mpi/ompi#10726 mpi4py/mpi4py#146

[Zcaic]

Thanks! I did what you said, too.
I'm just curious why this error happened. I can run SU2_CFD inv_NACA0012.cfg in Arch (WSL), it work well.
In Arch (WSL), I run ldd SU2_CFD, it shows:

$ ldd SU2_CFD
        linux-vdso.so.1 (0x00007ffd053a8000)
        libz.so.1 => /usr/lib/libz.so.1 (0x00007f0656d9f000)
        libmpi.so.40 => /usr/lib/libmpi.so.40 (0x00007f0656c74000)
        libmpi_cxx.so.40 => /usr/lib/libmpi_cxx.so.40 (0x00007f0656c5c000)
        libstdc++.so.6 => /usr/lib/libstdc++.so.6 (0x00007f06569e1000)
        libm.so.6 => /usr/lib/libm.so.6 (0x00007f06568f4000)
        libgcc_s.so.1 => /usr/lib/libgcc_s.so.1 (0x00007f06568cf000)
        libc.so.6 => /usr/lib/libc.so.6 (0x00007f06566e3000)
        libopen-rte.so.40 => /usr/lib/libopen-rte.so.40 (0x00007f0656619000)
        libopen-pal.so.40 => /usr/lib/libopen-pal.so.40 (0x00007f065656d000)
        libhwloc.so.15 => /usr/lib/libhwloc.so.15 (0x00007f0656510000)
        /lib64/ld-linux-x86-64.so.2 => /usr/lib64/ld-linux-x86-64.so.2 (0x00007f06580d6000)
        libevent_core-2.1.so.7 => /usr/lib/libevent_core-2.1.so.7 (0x00007f06564de000)
        libevent_pthreads-2.1.so.7 => /usr/lib/libevent_pthreads-2.1.so.7 (0x00007f06564d7000)
        libudev.so.1 => /usr/lib/libudev.so.1 (0x00007f06564a3000)
        libcap.so.2 => /usr/lib/libcap.so.2 (0x00007f0656497000)

And I also run it in Debian (WSL) or Mint (WSL), it shows:

$ ldd SU2_CFD
        linux-vdso.so.1 (0x00007fff3497b000)
        libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007f5076577000)
        libmpi.so.40 => /lib/x86_64-linux-gnu/libmpi.so.40 (0x00007f5076440000)
        libmpi_cxx.so.40 => /lib/x86_64-linux-gnu/libmpi_cxx.so.40 (0x00007f5076426000)
        libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007f50761fa000)
        libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f5076113000)
        libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007f50760f1000)
        libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f5075ec9000)
        libopen-rte.so.40 => /lib/x86_64-linux-gnu/libopen-rte.so.40 (0x00007f5075e0c000)
        libopen-pal.so.40 => /lib/x86_64-linux-gnu/libopen-pal.so.40 (0x00007f5075d59000)
        libhwloc.so.15 => /lib/x86_64-linux-gnu/libhwloc.so.15 (0x00007f5075cfd000)
        /lib64/ld-linux-x86-64.so.2 (0x00007f50778e1000)
        libevent_core-2.1.so.7 => /lib/x86_64-linux-gnu/libevent_core-2.1.so.7 (0x00007f5075cc6000)
        libevent_pthreads-2.1.so.7 => /lib/x86_64-linux-gnu/libevent_pthreads-2.1.so.7 (0x00007f5075cc1000)
        libudev.so.1 => /lib/x86_64-linux-gnu/libudev.so.1 (0x00007f5075c97000)

In Debian (WSL) or Mint (WSL), SU2_CFD doesn't seem to link libcap.so.2, but Arch (WSL) does.
I don't know if that's the reason.

[Zcaic]

I have solved it. I compiled OpenMPI 4.1.5 myself instead of apt install libopenmpi-dev openmpi-bin and SU2_CFD -d inv_NACA0012.cfg can work as expected.