Skip to content
This repository has been archived by the owner on Jul 22, 2024. It is now read-only.

mpi4py support #267

Open
zyndagj opened this issue Jul 24, 2020 · 3 comments
Open

mpi4py support #267

zyndagj opened this issue Jul 24, 2020 · 3 comments

Comments

@zyndagj
Copy link

zyndagj commented Jul 24, 2020

Hello,

I support an IBM AC922 system with InfiniBand, Spectrum MPI, and the xl compiler. We rely on PowerAI for delivering customizable python environments backed by an ecosystem of pre-tuned machine learning packages. We were recently asked to support mpi4py and I have been unable to compile it in a conda environment. It will compile with the system python, so xl and spectrum seem to be configured fine - issues only arise in a conda environment. I'd appreciate any help.

Thanks,
Greg

$ conda config --show
add_anaconda_token: True
add_pip_as_python_dependency: True
aggressive_update_packages:
  - ca-certificates
  - certifi
  - openssl
allow_conda_downgrades: False
allow_cycles: True
allow_non_channel_urls: False
allow_softlinks: False
always_copy: False
always_softlink: False
always_yes: None
anaconda_upload: None
auto_activate_base: True
auto_stack: 0
auto_update_conda: False
bld_path: 
changeps1: True
channel_alias: https://conda.anaconda.org
channel_priority: strict
channels:
  - https://public.dhe.ibm.com/ibmdl/export/pub/software/server/ibm-ai/conda/
  - defaults
client_ssl_cert: None
client_ssl_cert_key: None
clobber: False
conda_build: {}
create_default_packages: []
croot: /home/03076/gzynda/conda-bld
custom_channels:
  pkgs/main: https://repo.anaconda.com
  pkgs/r: https://repo.anaconda.com
  pkgs/pro: https://repo.anaconda.com
custom_multichannels:
  defaults: 
    - https://repo.anaconda.com/pkgs/main
    - https://repo.anaconda.com/pkgs/r
  local: 
debug: False
default_channels:
  - https://repo.anaconda.com/pkgs/main
  - https://repo.anaconda.com/pkgs/r
default_python: 3.7
default_threads: 4
deps_modifier: not_set
dev: False
disallowed_packages: []
download_only: False
dry_run: False
enable_private_envs: False
env_prompt: ({default_env}) 
envs_dirs:
  - /scratch/03076/gzynda/conda_local/envs
  - /scratch/apps/conda/4.8.3/envs
  - /home/03076/gzynda/.conda/envs
error_upload_url: https://conda.io/conda-post/unexpected-error
execute_threads: 4
extra_safety_checks: False
force: False
force_32bit: False
force_reinstall: False
force_remove: False
ignore_pinned: False
json: False
local_repodata_ttl: 1
migrated_channel_aliases: []
migrated_custom_channels: {}
non_admin_enabled: True
notify_outdated_conda: True
offline: False
override_channels_enabled: True
path_conflict: clobber
pinned_packages: []
pip_interop_enabled: False
pkgs_dirs:
  - /scratch/03076/gzynda/conda_local/pkgs
  - /scratch/apps/conda/4.8.3/pkgs
proxy_servers: {}
quiet: False
remote_backoff_factor: 1
remote_connect_timeout_secs: 9.15
remote_max_retries: 3
remote_read_timeout_secs: 60.0
repodata_fns:
  - current_repodata.json
  - repodata.json
repodata_threads: 4
report_errors: None
restore_free_channel: False
rollback_enabled: True
root_prefix: /scratch/apps/conda/4.8.3
safety_checks: warn
sat_solver: pycosat
separate_format_cache: False
shortcuts: True
show_channel_urls: None
solver_ignore_timestamps: False
ssl_verify: True
subdir: linux-ppc64le
subdirs:
  - linux-ppc64le
  - noarch
target_prefix_override: 
track_features: []
unsatisfiable_hints: True
unsatisfiable_hints_check_depth: 2
update_modifier: update_specs
use_index_cache: False
use_local: False
use_only_tar_bz2: False
verbosity: 0
verify_threads: 4
whitelist_channels: []
$ conda create -n pai17 python=3 powerai=1.7
Collecting package metadata (current_repodata.json): done
Solving environment: failed with repodata from current_repodata.json, will retry with next repodata source.
Collecting package metadata (repodata.json): done
Solving environment: done

## Package Plan ##

  environment location: /scratch/03076/gzynda/conda_local/envs/pai17

  added / updated specs:
    - powerai=1.7
    - python=3


The following NEW packages will be INSTALLED:

  _libgcc_mutex      pkgs/main/linux-ppc64le::_libgcc_mutex-0.1-main
  _py-xgboost-mutex  ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::_py-xgboost-mutex-1.0-gpu_645.ge505a9a
  _pytorch_select    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::_pytorch_select-2.0-gpu_21940.g1a3a219
  _tflow_select      ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::_tflow_select-2.1.0-gpu_929.g59c9804
  absl-py            pkgs/main/linux-ppc64le::absl-py-0.8.1-py37_0
  apex               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::apex-0.1.0_1.7.0-py37_662.gb1ba068
  astor              pkgs/main/linux-ppc64le::astor-0.8.0-py37_0
  atomicwrites       pkgs/main/noarch::atomicwrites-1.4.0-py_0
  attrs              pkgs/main/noarch::attrs-19.3.0-py_0
  blas               pkgs/main/linux-ppc64le::blas-1.0-openblas
  bokeh              pkgs/main/linux-ppc64le::bokeh-1.4.0-py37_0
  boost              pkgs/main/linux-ppc64le::boost-1.67.0-py37_4
  brotlipy           pkgs/main/linux-ppc64le::brotlipy-0.7.0-py37h7b6447c_1000
  bzip2              pkgs/main/linux-ppc64le::bzip2-1.0.8-h7b6447c_0
  c-ares             pkgs/main/linux-ppc64le::c-ares-1.15.0-h7b6447c_1001
  ca-certificates    pkgs/main/linux-ppc64le::ca-certificates-2020.6.24-0
  caffe              ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::caffe-1.0_1.7.0-5247.g03f78fb
  caffe-base         ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::caffe-base-1.0_1.7.0-gpu_py37_5247.g03f78fb
  cairo              pkgs/main/linux-ppc64le::cairo-1.14.12-h8948797_3
  certifi            pkgs/main/linux-ppc64le::certifi-2020.6.20-py37_0
  cffi               pkgs/main/linux-ppc64le::cffi-1.12.3-py37h2e261b9_0
  chardet            pkgs/main/linux-ppc64le::chardet-3.0.4-py37_1003
  click              pkgs/main/linux-ppc64le::click-7.0-py37_0
  cloudpickle        pkgs/main/noarch::cloudpickle-1.2.2-py_0
  coverage           pkgs/main/linux-ppc64le::coverage-4.5.4-py37h7b6447c_0
  cryptography       pkgs/main/linux-ppc64le::cryptography-2.9.2-py37h1ba5d50_0
  cudatoolkit        ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::cudatoolkit-10.2.89-680.g0f7a43a
  cudnn              ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::cudnn-7.6.5_10.2-650.g338a052
  cxxfilt            ibmdl/export/pub/software/server/ibm-ai/conda/noarch::cxxfilt-0.2.0-py_622.gbc2955e
  cycler             pkgs/main/linux-ppc64le::cycler-0.10.0-py37_0
  cytoolz            pkgs/main/linux-ppc64le::cytoolz-0.10.1-py37h7b6447c_0
  dask               pkgs/main/noarch::dask-2.9.2-py_0
  dask-core          pkgs/main/noarch::dask-core-2.9.2-py_0
  dask-cuda          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::dask-cuda-0.11.0-py37_630.g2290d8e
  dask-xgboost       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::dask-xgboost-0.1.9-py37_647.g2eb49b6
  ddl                ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::ddl-1.5.1-py37_1364.ged89432
  ddl-tensorflow     ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::ddl-tensorflow-1.5.1-py37_1073.g105e407
  decorator          pkgs/main/noarch::decorator-4.4.2-py_0
  distributed        pkgs/main/noarch::distributed-2.9.3-py_0
  ffmpeg             pkgs/main/linux-ppc64le::ffmpeg-4.2.2-h20bf706_0
  fontconfig         pkgs/main/linux-ppc64le::fontconfig-2.13.0-h9420a91_0
  freeglut           pkgs/main/linux-ppc64le::freeglut-3.0.0-hf484d3e_5
  freetype           pkgs/main/linux-ppc64le::freetype-2.9.1-h8a8886c_0
  fsspec             pkgs/main/noarch::fsspec-0.7.4-py_0
  future             pkgs/main/linux-ppc64le::future-0.17.1-py37_0
  gast               pkgs/main/linux-ppc64le::gast-0.2.2-py37_0
  gflags             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::gflags-2.2.2-1679.g1bcb8ab
  giflib             pkgs/main/linux-ppc64le::giflib-5.1.4-h14c3975_1
  glib               pkgs/main/linux-ppc64le::glib-2.63.1-h5a9c865_0
  glog               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::glog-0.3.5-1668.g110e904
  gmp                pkgs/main/linux-ppc64le::gmp-6.1.2-h7f7056e_2
  gnutls             pkgs/main/linux-ppc64le::gnutls-3.6.5-h71b1129_1002
  google-pasta       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::google-pasta-0.1.8-py37_622.gd00f35a
  graphite2          pkgs/main/linux-ppc64le::graphite2-1.3.14-h23475e2_0
  graphsurgeon       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::graphsurgeon-0.4.1-py37_697.g9922bde
  grpcio             pkgs/main/linux-ppc64le::grpcio-1.16.1-py37hf8bcb03_1
  h5py               pkgs/main/linux-ppc64le::h5py-2.8.0-py37h8d01980_0
  harfbuzz           pkgs/main/linux-ppc64le::harfbuzz-1.8.8-hffaf4a1_0
  hdf5               pkgs/main/linux-ppc64le::hdf5-1.10.2-hba1933b_1
  heapdict           pkgs/main/noarch::heapdict-1.0.1-py_0
  horovod            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::horovod-0.19.0-py37_1105.g5e1e5d1
  hypothesis         pkgs/main/linux-ppc64le::hypothesis-3.59.1-py37h39e3cac_0
  icu                pkgs/main/linux-ppc64le::icu-58.2-he6710b0_3
  idna               pkgs/main/linux-ppc64le::idna-2.8-py37_0
  imageio            pkgs/main/noarch::imageio-2.9.0-py_0
  importlib-metadata pkgs/main/linux-ppc64le::importlib-metadata-1.7.0-py37_0
  importlib_metadata pkgs/main/noarch::importlib_metadata-1.7.0-0
  jasper             pkgs/main/linux-ppc64le::jasper-2.0.14-h07fcdf6_1
  jinja2             pkgs/main/noarch::jinja2-2.11.2-py_0
  joblib             pkgs/main/linux-ppc64le::joblib-0.13.2-py37_0
  jpeg               pkgs/main/linux-ppc64le::jpeg-9b-hcb7ba68_2
  keras-applications pkgs/main/noarch::keras-applications-1.0.8-py_1
  keras-preprocessi~ pkgs/main/noarch::keras-preprocessing-1.1.0-py_1
  kiwisolver         pkgs/main/linux-ppc64le::kiwisolver-1.2.0-py37hfd86e86_0
  lame               pkgs/main/linux-ppc64le::lame-3.100-h7b6447c_0
  ld_impl_linux-ppc~ pkgs/main/linux-ppc64le::ld_impl_linux-ppc64le-2.33.1-h0f24833_7
  leveldb            pkgs/main/linux-ppc64le::leveldb-1.20-hf484d3e_1
  libboost           pkgs/main/linux-ppc64le::libboost-1.67.0-h46d08c1_4
  libedit            pkgs/main/linux-ppc64le::libedit-3.1.20191231-h14c3975_1
  libffi             pkgs/main/linux-ppc64le::libffi-3.2.1-hf62a594_5
  libgcc-ng          pkgs/main/linux-ppc64le::libgcc-ng-8.2.0-h822a55f_1
  libgfortran-ng     pkgs/main/linux-ppc64le::libgfortran-ng-7.3.0-h822a55f_1
  libglu             pkgs/main/linux-ppc64le::libglu-9.0.0-hf484d3e_1
  libopenblas        pkgs/main/linux-ppc64le::libopenblas-0.3.6-h5a2b251_1
  libopencv          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::libopencv-3.4.8-py37_784.g5a642ca
  libopus            pkgs/main/linux-ppc64le::libopus-1.3.1-h7b6447c_0
  libpng             pkgs/main/linux-ppc64le::libpng-1.6.36-hbc83047_0
  libprotobuf        ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::libprotobuf-3.8.0-634.g08dc819
  libstdcxx-ng       pkgs/main/linux-ppc64le::libstdcxx-ng-8.2.0-h822a55f_1
  libtiff            pkgs/main/linux-ppc64le::libtiff-4.1.0-h2733197_1
  libuuid            pkgs/main/linux-ppc64le::libuuid-1.0.3-h1bed415_2
  libvpx             pkgs/main/linux-ppc64le::libvpx-1.7.0-hf484d3e_0
  libwebp            pkgs/main/linux-ppc64le::libwebp-1.0.1-h8e7db2f_0
  libxcb             pkgs/main/linux-ppc64le::libxcb-1.14-h7b6447c_0
  libxgboost-base    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::libxgboost-base-0.90-gpu_645.ge505a9a
  libxml2            pkgs/main/linux-ppc64le::libxml2-2.9.10-he19cac6_1
  llvmlite           pkgs/main/linux-ppc64le::llvmlite-0.31.0-py37hd408876_0
  lmdb               pkgs/main/linux-ppc64le::lmdb-0.9.22-hf484d3e_1
  locket             pkgs/main/linux-ppc64le::locket-0.2.0-py37_1
  lz4-c              pkgs/main/linux-ppc64le::lz4-c-1.9.2-he6710b0_0
  markdown           pkgs/main/linux-ppc64le::markdown-3.1.1-py37_0
  markupsafe         pkgs/main/linux-ppc64le::markupsafe-1.1.1-py37h7b6447c_0
  matplotlib         pkgs/main/linux-ppc64le::matplotlib-3.0.3-py37h5429711_0
  mock               pkgs/main/linux-ppc64le::mock-3.0.5-py37_0
  more-itertools     pkgs/main/noarch::more-itertools-8.4.0-py_0
  msgpack-python     pkgs/main/linux-ppc64le::msgpack-python-1.0.0-py37hfd86e86_1
  nccl               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::nccl-2.5.6-645.g51c2e94
  ncurses            pkgs/main/linux-ppc64le::ncurses-6.2-he6710b0_1
  nettle             pkgs/main/linux-ppc64le::nettle-3.4.1-hbb512f6_0
  networkx           pkgs/main/noarch::networkx-2.3-py_0
  ninja              pkgs/main/linux-ppc64le::ninja-1.9.0-py37hfd86e86_0
  nomkl              pkgs/main/linux-ppc64le::nomkl-3.0-0
  numactl            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::numactl-2.0.12-628.gb5e1afd
  numba              pkgs/main/linux-ppc64le::numba-0.47.0-py37h962f231_0
  numpy              pkgs/main/linux-ppc64le::numpy-1.17.4-py37hd5be1e1_0
  numpy-base         pkgs/main/linux-ppc64le::numpy-base-1.17.4-py37h2f8d375_0
  olefile            pkgs/main/linux-ppc64le::olefile-0.46-py37_0
  onnx               ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::onnx-1.6.0-py37_671.g75d3229
  openblas           pkgs/main/linux-ppc64le::openblas-0.3.6-1
  openblas-devel     pkgs/main/linux-ppc64le::openblas-devel-0.3.6-1
  opencv             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::opencv-3.4.8-py37_784.g5a642ca
  openh264           pkgs/main/linux-ppc64le::openh264-2.1.0-hd408876_0
  openssl            pkgs/main/linux-ppc64le::openssl-1.1.1g-h7b6447c_0
  opt_einsum         pkgs/main/noarch::opt_einsum-3.1.0-py_0
  packaging          pkgs/main/noarch::packaging-20.4-py_0
  pai4sk             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pai4sk-1.6.0-py37_1156.g99299fc
  pandas             pkgs/main/linux-ppc64le::pandas-1.0.5-py37h0573a6f_0
  partd              pkgs/main/noarch::partd-1.1.0-py_0
  pciutils           ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pciutils-3.6.2-627.g804ec60
  pcre               pkgs/main/linux-ppc64le::pcre-8.44-he6710b0_0
  pillow             pkgs/main/linux-ppc64le::pillow-7.1.2-py37haac5956_0
  pip                pkgs/main/linux-ppc64le::pip-20.1.1-py37_1
  pixman             pkgs/main/linux-ppc64le::pixman-0.40.0-h7b6447c_0
  pluggy             pkgs/main/linux-ppc64le::pluggy-0.13.1-py37_0
  powerai            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-1.7.0-679.g5b5a006
  powerai-license    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-license-1.7.0-778.g91a0fd9
  powerai-release    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-release-1.7.0-627.g1c389a2
  powerai-tools      ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::powerai-tools-1.7.0-623.g843ad38
  protobuf           ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::protobuf-3.8.0-py37_642.gdc7b773
  psutil             pkgs/main/linux-ppc64le::psutil-5.6.7-py37h7b6447c_0
  py                 pkgs/main/noarch::py-1.9.0-py_0
  py-boost           pkgs/main/linux-ppc64le::py-boost-1.67.0-py37h04863e7_4
  py-opencv          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::py-opencv-3.4.8-py37_784.g5a642ca
  py-xgboost-base    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::py-xgboost-base-0.90-gpu_py37_645.ge505a9a
  py-xgboost-gpu     ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::py-xgboost-gpu-0.90-645.ge505a9a
  pycparser          pkgs/main/noarch::pycparser-2.20-py_2
  pynvml             ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pynvml-8.0.3-py37_618.g443d2aa
  pyopenssl          pkgs/main/noarch::pyopenssl-19.1.0-py_1
  pyparsing          pkgs/main/noarch::pyparsing-2.4.7-py_0
  pysocks            pkgs/main/linux-ppc64le::pysocks-1.7.1-py37_1
  pytest             pkgs/main/linux-ppc64le::pytest-4.4.2-py37_0
  python             pkgs/main/linux-ppc64le::python-3.7.7-ha29dc6b_0_cpython
  python-dateutil    pkgs/main/noarch::python-dateutil-2.8.1-py_0
  python-lmdb        pkgs/main/linux-ppc64le::python-lmdb-0.98-py37he6710b0_0
  pytorch            ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pytorch-1.3.1-21940.g1a3a219
  pytorch-base       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::pytorch-base-1.3.1-gpu_py37_21940.g1a3a219
  pytz               pkgs/main/noarch::pytz-2020.1-py_0
  pywavelets         pkgs/main/linux-ppc64le::pywavelets-1.1.1-py37h7b6447c_0
  pyyaml             pkgs/main/linux-ppc64le::pyyaml-5.3.1-py37h7b6447c_1
  readline           pkgs/main/linux-ppc64le::readline-8.0-h7b6447c_0
  requests           pkgs/main/linux-ppc64le::requests-2.22.0-py37_1
  scikit-image       pkgs/main/linux-ppc64le::scikit-image-0.15.0-py37he6710b0_0
  scikit-learn       pkgs/main/linux-ppc64le::scikit-learn-0.22.1-py37h22eb022_0
  scipy              pkgs/main/linux-ppc64le::scipy-1.3.1-py37he2b7bc3_0
  setuptools         pkgs/main/linux-ppc64le::setuptools-49.2.0-py37_0
  simsearch          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::simsearch-1.6.0-py37_882.ga3f4a67
  six                pkgs/main/linux-ppc64le::six-1.13.0-py37_0
  snapml-spark       ibmdl/export/pub/software/server/ibm-ai/conda/noarch::snapml-spark-1.6.0-py_1020.gc01d7a8
  snappy             pkgs/main/linux-ppc64le::snappy-1.1.7-h1532aa0_3
  sortedcontainers   pkgs/main/noarch::sortedcontainers-2.2.2-py_0
  spectrum-mpi       ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::spectrum-mpi-10.03-678.ga72dafb
  sqlite             pkgs/main/linux-ppc64le::sqlite-3.32.3-hbc83047_0
  tabulate           pkgs/main/linux-ppc64le::tabulate-0.8.2-py37_0
  tbb                pkgs/main/linux-ppc64le::tbb-2020.0-hfd86e86_0
  tblib              pkgs/main/noarch::tblib-1.6.0-py_0
  tensorboard        ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorboard-2.1.0-py37_3dc74fe_3959.g2372771
  tensorflow         ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-2.1.1-gpu_py37_934.g2372771
  tensorflow-base    ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-base-2.1.1-gpu_py37_3ffdb91_72692.g44a6283
  tensorflow-benchm~ ibmdl/export/pub/software/server/ibm-ai/conda/noarch::tensorflow-benchmarks-0.1-gpu_py_627.gb971bf9
  tensorflow-estima~ ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-estimator-2.1.0-py37_7ec4e5d_1477.g59c9804
  tensorflow-gpu     ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-gpu-2.1.1-934.g2372771
  tensorflow-probab~ ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-probability-0.9.0-py37_356cfdd_3242.g59c9804
  tensorflow-servin~ ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorflow-serving-api-2.1.0-py37_d83512c_5308.gf3d82d3
  tensorrt           ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::tensorrt-7.0.0.11-py37_697.g9922bde
  termcolor          pkgs/main/linux-ppc64le::termcolor-1.1.0-py37_1
  tk                 pkgs/main/linux-ppc64le::tk-8.6.10-hbc83047_0
  toolz              pkgs/main/noarch::toolz-0.10.0-py_0
  torchtext          ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::torchtext-0.4.0-py37_633.g16a90d7
  torchvision-base   ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::torchvision-base-0.4.2-gpu_py37_661.g37d5d4d
  tornado            pkgs/main/linux-ppc64le::tornado-6.0.4-py37h7b6447c_1
  tqdm               pkgs/main/noarch::tqdm-4.36.1-py_0
  typing             pkgs/main/linux-ppc64le::typing-3.6.4-py37_0
  uff                ibmdl/export/pub/software/server/ibm-ai/conda/linux-ppc64le::uff-0.6.5-py37_697.g9922bde
  urllib3            pkgs/main/noarch::urllib3-1.25.9-py_0
  werkzeug           pkgs/main/noarch::werkzeug-0.16.0-py_0
  wheel              pkgs/main/linux-ppc64le::wheel-0.34.2-py37_0
  wrapt              pkgs/main/linux-ppc64le::wrapt-1.11.2-py37h7b6447c_0
  x264               pkgs/main/linux-ppc64le::x264-1!157.20191217-h7b6447c_0
  xz                 pkgs/main/linux-ppc64le::xz-5.2.5-h7b6447c_0
  yaml               pkgs/main/linux-ppc64le::yaml-0.2.5-h7b6447c_0
  zict               pkgs/main/noarch::zict-2.0.0-py_0
  zipp               pkgs/main/noarch::zipp-3.1.0-py_0
  zlib               pkgs/main/linux-ppc64le::zlib-1.2.11-h7b6447c_3
  zstd               pkgs/main/linux-ppc64le::zstd-1.4.5-h0b5b093_0


Proceed ([y]/n)? y

Preparing transaction: done
Verifying transaction: done
Executing transaction: done
#
# To activate this environment, use
#
#     $ conda activate pai17
#
# To deactivate an active environment, use
#
#     $ conda deactivate
$ conda activate pai17
(pai17) $ pip install mpi4py
Collecting mpi4py
  Using cached mpi4py-3.0.3.tar.gz (1.4 MB)
Building wheels for collected packages: mpi4py
  Building wheel for mpi4py (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /scratch/03076/gzynda/conda_local/envs/pai17/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-tjsbidsb
       cwd: /tmp/pip-install-j_4pv84w/mpi4py/
  Complete output (134 lines):
  running bdist_wheel
  running build
  running build_src
  running build_py
  creating build
  creating build/lib.linux-ppc64le-3.7
  creating build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py
  creating build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
  copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
  copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
  creating build/lib.linux-ppc64le-3.7/mpi4py/include
  creating build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
  running build_clib
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
  MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
  MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
  MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
  MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
  checking for library 'lmpe' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'mpe' dylib library
  creating build/temp.linux-ppc64le-3.7
  creating build/temp.linux-ppc64le-3.7/src
  creating build/temp.linux-ppc64le-3.7/src/lib-pmpi
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/mpe.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "mpe" failed
  
  checking for library 'vt-mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt' dylib library
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt" failed
  
  checking for library 'vt-mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-mpi' dylib library
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-mpi.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-mpi" failed
  
  checking for library 'vt-hyb' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.ompi' ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-hyb' dylib library
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-hyb.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-hyb" failed
  
  running build_ext
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
  MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
  MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
  MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
  MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
  checking for dlopen() availability ...
  checking for header 'dlfcn.h' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  success!
  removing: _configtest.c _configtest.o
  success!
  checking for library 'dl' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'dlopen' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  building 'mpi4py.dl' extension
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c src/dynload.c -o build/temp.linux-ppc64le-3.7/src/dynload.o
  gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.7/src/dynload.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o build/lib.linux-ppc64le-3.7/mpi4py/dl.cpython-37m-powerpc64le-linux-gnu.so
  checking for MPI compile and link ...
  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  error: Cannot compile MPI programs. Check your configuration!!!
  ----------------------------------------
  ERROR: Failed building wheel for mpi4py
  Running setup.py clean for mpi4py
Failed to build mpi4py
Installing collected packages: mpi4py
    Running setup.py install for mpi4py ... error
    ERROR: Command errored out with exit status 1:
     command: /scratch/03076/gzynda/conda_local/envs/pai17/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-2c9mz01o/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m/mpi4py
         cwd: /tmp/pip-install-j_4pv84w/mpi4py/
    Complete output (134 lines):
    running install
    running build
    running build_src
    running build_py
    creating build
    creating build/lib.linux-ppc64le-3.7
    creating build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py
    creating build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.7/mpi4py/futures
    copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
    copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.7/mpi4py
    creating build/lib.linux-ppc64le-3.7/mpi4py/include
    creating build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.7/mpi4py/include/mpi4py
    running build_clib
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
    MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
    MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
    MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
    MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
    checking for library 'lmpe' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'mpe' dylib library
    creating build/temp.linux-ppc64le-3.7
    creating build/temp.linux-ppc64le-3.7/src
    creating build/temp.linux-ppc64le-3.7/src/lib-pmpi
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/mpe.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "mpe" failed
    
    checking for library 'vt-mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt' dylib library
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt" failed
    
    checking for library 'vt-mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-mpi' dylib library
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-mpi.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-mpi" failed
    
    checking for library 'vt-hyb' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.ompi' ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-hyb' dylib library
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.7/src/lib-pmpi/vt-hyb.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-hyb" failed
    
    running build_ext
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc
    MPI C++ compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicxx
    MPI F compiler:    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpifort
    MPI F90 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif90
    MPI F77 compiler:  /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpif77
    checking for dlopen() availability ...
    checking for header 'dlfcn.h' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    success!
    removing: _configtest.c _configtest.o
    success!
    checking for library 'dl' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    checking for function 'dlopen' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    building 'mpi4py.dl' extension
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c src/dynload.c -o build/temp.linux-ppc64le-3.7/src/dynload.o
    gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/pai17/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.7/src/dynload.o -Lbuild/temp.linux-ppc64le-3.7 -ldl -o build/lib.linux-ppc64le-3.7/mpi4py/dl.cpython-37m-powerpc64le-linux-gnu.so
    checking for MPI compile and link ...
    /scratch/03076/gzynda/conda_local/envs/pai17/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/pai17/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    error: Cannot compile MPI programs. Check your configuration!!!
    ----------------------------------------
ERROR: Command errored out with exit status 1: /scratch/03076/gzynda/conda_local/envs/pai17/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-j_4pv84w/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-2c9mz01o/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/pai17/include/python3.7m/mpi4py Check the logs for full command output.

Compiling it using the system spectrum MPI in a new python3 environment with only setuptools and wheel also fails.

$ conda create -n py3 python=3 setuptools wheel
$ conda activate py3
(py3) $ pip install mpi4py
Collecting mpi4py
  Using cached mpi4py-3.0.3.tar.gz (1.4 MB)
Building wheels for collected packages: mpi4py
  Building wheel for mpi4py (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /scratch/03076/gzynda/conda_local/envs/py3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-xg6jrxrt
       cwd: /tmp/pip-install-v8o084bu/mpi4py/
  Complete output (134 lines):
  running bdist_wheel
  running build
  running build_src
  running build_py
  creating build
  creating build/lib.linux-ppc64le-3.8
  creating build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py
  creating build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  creating build/lib.linux-ppc64le-3.8/mpi4py/include
  creating build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  running build_clib
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
  MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
  MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
  MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
  MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
  checking for library 'lmpe' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'mpe' dylib library
  creating build/temp.linux-ppc64le-3.8
  creating build/temp.linux-ppc64le-3.8/src
  creating build/temp.linux-ppc64le-3.8/src/lib-pmpi
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/mpe.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "mpe" failed
  
  checking for library 'vt-mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt" failed
  
  checking for library 'vt-mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-mpi' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-mpi.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-mpi" failed
  
  checking for library 'vt-hyb' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.ompi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-hyb' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-hyb.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-hyb" failed
  
  running build_ext
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
  MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
  MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
  MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
  MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
  checking for dlopen() availability ...
  checking for header 'dlfcn.h' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  success!
  removing: _configtest.c _configtest.o
  success!
  checking for library 'dl' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'dlopen' ...
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  building 'mpi4py.dl' extension
  gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c src/dynload.c -o build/temp.linux-ppc64le-3.8/src/dynload.o
  gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.8/src/dynload.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o build/lib.linux-ppc64le-3.8/mpi4py/dl.cpython-38-powerpc64le-linux-gnu.so
  checking for MPI compile and link ...
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
  failure.
  removing: _configtest.c _configtest.o
  error: Cannot compile MPI programs. Check your configuration!!!
  ----------------------------------------
  ERROR: Failed building wheel for mpi4py
  Running setup.py clean for mpi4py
Failed to build mpi4py
Installing collected packages: mpi4py
    Running setup.py install for mpi4py ... error
    ERROR: Command errored out with exit status 1:
     command: /scratch/03076/gzynda/conda_local/envs/py3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-p8_jcrcb/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/mpi4py
         cwd: /tmp/pip-install-v8o084bu/mpi4py/
    Complete output (134 lines):
    running install
    running build
    running build_src
    running build_py
    creating build
    creating build/lib.linux-ppc64le-3.8
    creating build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py
    creating build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
    copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
    copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
    creating build/lib.linux-ppc64le-3.8/mpi4py/include
    creating build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
    running build_clib
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
    MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
    MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
    MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
    MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
    checking for library 'lmpe' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'mpe' dylib library
    creating build/temp.linux-ppc64le-3.8
    creating build/temp.linux-ppc64le-3.8/src
    creating build/temp.linux-ppc64le-3.8/src/lib-pmpi
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/mpe.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "mpe" failed
    
    checking for library 'vt-mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt' dylib library
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt" failed
    
    checking for library 'vt-mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.mpi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-mpi' dylib library
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-mpi.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-mpi" failed
    
    checking for library 'vt-hyb' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    checking for library 'vt.ompi' ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    building 'vt-hyb' dylib library
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-hyb.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
    
    warning: build_clib: building optional library "vt-hyb" failed
    
    running build_ext
    MPI configuration: [mpi] from 'mpi.cfg'
    MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
    MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
    MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
    MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
    MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
    checking for dlopen() availability ...
    checking for header 'dlfcn.h' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    success!
    removing: _configtest.c _configtest.o
    success!
    checking for library 'dl' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    checking for function 'dlopen' ...
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
    success!
    removing: _configtest.c _configtest.o _configtest
    building 'mpi4py.dl' extension
    gcc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c src/dynload.c -o build/temp.linux-ppc64le-3.8/src/dynload.o
    gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.8/src/dynload.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o build/lib.linux-ppc64le-3.8/mpi4py/dl.cpython-38-powerpc64le-linux-gnu.so
    checking for MPI compile and link ...
    /opt/ibm/spectrum_mpi/bin/mpicc -pthread -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
    /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/xlCentry - No such file or directory
    failure.
    removing: _configtest.c _configtest.o
    error: Cannot compile MPI programs. Check your configuration!!!
    ----------------------------------------
ERROR: Command errored out with exit status 1: /scratch/03076/gzynda/conda_local/envs/py3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-v8o084bu/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-p8_jcrcb/install-record.txt --single-version-externally-managed --compile --install-headers /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/mpi4py Check the logs for full command output.
@zyndagj
Copy link
Author

zyndagj commented Jul 24, 2020

Forcing python to compile using xl instead of gcc also fails

(py3) $ CC=xlc CXX=xlC pip install mpi4py
Collecting mpi4py
  Using cached mpi4py-3.0.3.tar.gz (1.4 MB)
Building wheels for collected packages: mpi4py
  Building wheel for mpi4py (setup.py) ... error
  ERROR: Command errored out with exit status 1:
   command: /scratch/03076/gzynda/conda_local/envs/py3/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-r23rv445/mpi4py/setup.py'"'"'; __file__='"'"'/tmp/pip-install-r23rv445/mpi4py/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-c9oysz7d
       cwd: /tmp/pip-install-r23rv445/mpi4py/
  Complete output (490 lines):
  running bdist_wheel
  running build
  running build_src
  running build_py
  creating build
  creating build/lib.linux-ppc64le-3.8
  creating build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/run.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/bench.py -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py
  creating build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/__main__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/_base.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/server.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/pool.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/_lib.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/__init__.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/futures/aplus.py -> build/lib.linux-ppc64le-3.8/mpi4py/futures
  copying src/mpi4py/MPI.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/__init__.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  copying src/mpi4py/libmpi.pxd -> build/lib.linux-ppc64le-3.8/mpi4py
  creating build/lib.linux-ppc64le-3.8/mpi4py/include
  creating build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI_api.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.MPI.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.h -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi4py.i -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  copying src/mpi4py/include/mpi4py/mpi.pxi -> build/lib.linux-ppc64le-3.8/mpi4py/include/mpi4py
  running build_clib
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
  MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
  MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
  MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
  MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
  checking for library 'lmpe' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -llmpe -o _configtest
  /usr/bin/ld: cannot find -llmpe
  failure.
  removing: _configtest.c _configtest.o
  building 'mpe' dylib library
  creating build/temp.linux-ppc64le-3.8
  creating build/temp.linux-ppc64le-3.8/src
  creating build/temp.linux-ppc64le-3.8/src/lib-pmpi
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/mpe.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/mpe.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  creating build/lib.linux-ppc64le-3.8/mpi4py/lib-pmpi
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ -Wl,--no-as-needed build/temp.linux-ppc64le-3.8/src/lib-pmpi/mpe.o -o build/lib.linux-ppc64le-3.8/mpi4py/lib-pmpi/libmpe.so
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/ld - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "mpe" failed
  
  checking for library 'vt-mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -lvt-mpi -o _configtest
  /usr/bin/ld: cannot find -lvt-mpi
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -lvt.mpi -o _configtest
  /usr/bin/ld: cannot find -lvt.mpi
  failure.
  removing: _configtest.c _configtest.o
  building 'vt' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ -Wl,--no-as-needed build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt.o -o build/lib.linux-ppc64le-3.8/mpi4py/lib-pmpi/libvt.so
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/ld - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt" failed
  
  checking for library 'vt-mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -lvt-mpi -o _configtest
  /usr/bin/ld: cannot find -lvt-mpi
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.mpi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -lvt.mpi -o _configtest
  /usr/bin/ld: cannot find -lvt.mpi
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-mpi' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-mpi.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-mpi.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ -Wl,--no-as-needed build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-mpi.o -o build/lib.linux-ppc64le-3.8/mpi4py/lib-pmpi/libvt-mpi.so
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/ld - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-mpi" failed
  
  checking for library 'vt-hyb' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -lvt-hyb -o _configtest
  /usr/bin/ld: cannot find -lvt-hyb
  failure.
  removing: _configtest.c _configtest.o
  checking for library 'vt.ompi' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -lvt.ompi -o _configtest
  /usr/bin/ld: cannot find -lvt.ompi
  failure.
  removing: _configtest.c _configtest.o
  building 'vt-hyb' dylib library
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -c src/lib-pmpi/vt-hyb.c -o build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-hyb.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ -Wl,--no-as-needed build/temp.linux-ppc64le-3.8/src/lib-pmpi/vt-hyb.o -o build/lib.linux-ppc64le-3.8/mpi4py/lib-pmpi/libvt-hyb.so
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/ld - No such file or directory
  warning: build_clib: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  
  warning: build_clib: building optional library "vt-hyb" failed
  
  running build_ext
  MPI configuration: [mpi] from 'mpi.cfg'
  MPI C compiler:    /opt/ibm/spectrum_mpi/bin/mpicc
  MPI C++ compiler:  /opt/ibm/spectrum_mpi/bin/mpicxx
  MPI F compiler:    /opt/ibm/spectrum_mpi/bin/mpifort
  MPI F90 compiler:  /opt/ibm/spectrum_mpi/bin/mpif90
  MPI F77 compiler:  /opt/ibm/spectrum_mpi/bin/mpif77
  checking for dlopen() availability ...
  checking for header 'dlfcn.h' ...
  xlc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  success!
  removing: _configtest.c _configtest.o
  success!
  checking for library 'dl' ...
  xlc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  xlc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'dlopen' ...
  xlc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  xlc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  building 'mpi4py.dl' extension
  xlc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c src/dynload.c -o build/temp.linux-ppc64le-3.8/src/dynload.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  gcc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.8/src/dynload.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o build/lib.linux-ppc64le-3.8/mpi4py/dl.cpython-38-powerpc64le-linux-gnu.so
  checking for MPI compile and link ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  success!
  removing: _configtest.c _configtest.o
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for missing MPI functions/symbols ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  success!
  removing: _configtest.c _configtest.o
  checking for function 'MPI_Type_create_f90_integer' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'MPI_Type_create_f90_real' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'MPI_Type_create_f90_complex' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'MPI_Status_c2f' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'MPI_Status_f2c' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for symbol 'MPI_LB' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for symbol 'MPI_UB' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for dlopen() availability ...
  checking for header 'dlfcn.h' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  success!
  removing: _configtest.c _configtest.o
  success!
  checking for library 'dl' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  checking for function 'dlopen' ...
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c _configtest.c -o _configtest.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  1 warning generated.
  /opt/ibm/spectrum_mpi/bin/mpicc _configtest.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o _configtest
  success!
  removing: _configtest.c _configtest.o _configtest
  building 'mpi4py.MPI' extension
  /opt/ibm/spectrum_mpi/bin/mpicc -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -DHAVE_DLFCN_H=1 -DHAVE_DLOPEN=1 -I/scratch/03076/gzynda/conda_local/envs/py3/include/python3.8 -c src/MPI.c -o build/temp.linux-ppc64le-3.8/src/MPI.o
  warning: 1540-5200 The option "-fwrapv" is not supported.
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:154182:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:154467:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:154677:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:154762:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:154847:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:155048:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:155235:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:155431:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:155650:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:155820:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:156162:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:156262:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:156391:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:156514:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:156645:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:156730:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:156830:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:157141:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:157417:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:157593:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:157689:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:157835:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:157965:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:158132:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:158260:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:158374:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:158504:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:158626:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:158764:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:158878:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:159029:3: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
    0, /*tp_print*/
    ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  In file included from src/MPI.c:4:
  src/mpi4py.MPI.c:176327:5: warning: 'tp_print' is deprecated [-Wdeprecated-declarations]
      0,
      ^
  /scratch/03076/gzynda/conda_local/envs/py3/include/python3.8/cpython/object.h:260:30: note: 'tp_print' has been explicitly marked deprecated here
      Py_DEPRECATED(3.8) int (*tp_print)(PyObject *, FILE *, int);
                               ^
  33 warnings generated.
  /opt/ibm/spectrum_mpi/bin/mpicc -pthread -shared -B /scratch/03076/gzynda/conda_local/envs/py3/compiler_compat -L/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,-rpath=/scratch/03076/gzynda/conda_local/envs/py3/lib -Wl,--no-as-needed -Wl,--sysroot=/ build/temp.linux-ppc64le-3.8/src/MPI.o -Lbuild/temp.linux-ppc64le-3.8 -ldl -o build/lib.linux-ppc64le-3.8/mpi4py/MPI.cpython-38-powerpc64le-linux-gnu.so
  /opt/ibm/xlC/16.1.1/bin/.orig/xlc_r: error: 1501-221 cannot exec program /lib/o/ld - No such file or directory
  error: command '/opt/ibm/spectrum_mpi/bin/mpicc' failed with exit status 255
  ----------------------------------------
  ERROR: Failed building wheel for mpi4py
  Running setup.py clean for mpi4py
Failed to build mpi4py

@den-run-ai
Copy link

@zyndagj there is official Anaconda package for mpi4py with support for ppc64. But it relies on openmpi or mpich which are not linked with LSF, so would be limited to one node with the scheduler.

https://anaconda.org/anaconda/mpi4py
https://anaconda.org/anaconda/openmpi
https://anaconda.org/anaconda/mpich

@zyndagj
Copy link
Author

zyndagj commented Jul 24, 2020

That's for the suggestion. However, multi-node execution is a requirement. It also appears that installing it with anything besides spectrum will cause issues with the distributed ML packages.

#26

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants