You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We've encountered the following error on some systems. The problem appears to be related to NUMA Affinity being unset, which manifests as MRC raising the error below and hanging during initialization.
Version
v24.06.01-runtime
Which installation method(s) does this occur on?
Docker
Describe the bug.
We've encountered the following error on some systems. The problem appears to be related to NUMA Affinity being unset, which manifests as MRC raising the error below and hanging during initialization.
F20241008 18:43:21.473876 19 partitions.cpp:83] Check failed: node_set.weight() == 1 (2 vs. 1)
MRC should be updated to fail gracefully or have a default fallback for node_set assignments.
Minimum reproducible example
This appears to be reproducible on systems where nvidia-smi's topo print shows NUMA Affinity as (N/A)
Relevant log output
No response
Full env printout
No response
Other/Misc.
No response
Code of Conduct
The text was updated successfully, but these errors were encountered: