RuntimeError: Not compiled with GPU support (my eviroment is pytorch 1.4.0 ubuntu18.04) #79
Comments
Were you able to solve this issue? I am facing the same problem with pytorch 1.4.0-py3.6_cuda101_cudnn7_0 and torchvision 0.5.0-py36_cu101. It is invoked by _backend.dcn_v2_forward where _backend should be _ext built from make.sh. I'm not sure if _ext refers to this _ext.cp36-win_amd64.pyd file. Not sure how to proceed from here. |
|
Hi. I am also facing the same issue with pytorch=1.2.0, cudatoolkit 10.0.130, torchvision=0.8.1, under ubuntu 20.04 and Cuda version 11.0. I would appreciate any hint on how to resolve it. |
|
I managed to fix it by getting pytorch==1.4.0, torchvision==0.5.0 installed under my conda environment, so during setting up your conda environment type in:
Before installing the requirements at step 4, comment the
You can have multiple gcc and g++ version installed on your machine, and you can switch between them. Follow the instructions here. Finally finish steps 5 and 6, making sure your DCNv2 compiles properly. Afterwards, you should be good to go. |
|
@Meteroo @wenjiey2 Since the issue has been linked with #XX, enclose it as a code block with ``` ``` as shown below. |
|
I am faceing the same prolem. |
Have u solved it？ |
|
@BruceYu-Bit , @zpge , @Keiku any news on this? |
|
After some research, I understood that the problem was that I actually did not have CUDA installed. You can find it out by doing: If nothing is returned it means that you did not install CUDA I followed all this: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/ And I installed CUDA with the following official link I think that the following is optional and not needed to solve the problem of
However, after what's explained above, I did installed the
Then you can do:
(before doing it you should check that this is the folder in which CUDA has been installed on your machine) I hope this helps someone else in the same situation. |
|
yes, same issue i face, it is so weird, and annoying, my environment is ubuntu18.04, rtx3090 nvidia, so i have to use (https://github.com/MatthewHowe/DCNv2/branches) to compile DCNv2, my torch version is Name: torch , Version: 1.7.0+cu110, Name: torchvision,Version: 0.8.1+cu110, finally, i successfully complied the DCN. and import DCN success!!!!! However, i still get the error of RuntimeError: Not compiled with GPU support |
|
hi @sainttelant , could you give us the result of the following commands:
and
I might help you understing what is the problem. Also, are you using a virtual environment (conda, virtualenv, or similar)? |
|
@fabrizioschiano, as following shows: nvcc-V and nvidia driver has been installed, rtx3090, so it is so weired, why there is still not compiled with GPU support errors!
|
|
@fabrizioschiano That is great, i solved it , it is so tricky that the system can't find the path of ....../nvcc file even though it can display when input nvcc-V. i tryed to grant the account of soder authority, after that operations, i recompiled the ./make.sh in DNCv2. then the problem is solved. i hope it will be helpful if someone faced a similar issue..... NICE, thanks anyway. |
|
Good! Thanks that I could help you @sainttelant . |
|
Using a docker container following the instructions at #176 was the only thing that helped in my case |
Hi, could you please clarify the meaning of "soder authority"? was it "sudo authority"? |
/home/mts/anaconda3/envs/CenterTrack/bin/python /home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py tracking --load_model ../models/coco_tracking.pth --demo ../image/images --gpu 0
/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/sklearn/utils/linear_assignment_.py:22: FutureWarning: The linear_assignment_ module is deprecated in 0.21 and will be removed from 0.23. Use scipy.optimize.linear_sum_assignment instead.
FutureWarning)
Running tracking
Using tracking threshold for out threshold! 0.3
Fix size testing.
training chunk_sizes: [32]
input h w: 512 512
heads {'hm': 80, 'reg': 2, 'wh': 2, 'tracking': 2}
weights {'hm': 1, 'reg': 1, 'wh': 0.1, 'tracking': 1}
head conv {'hm': [256], 'reg': [256], 'wh': [256], 'tracking': [256]}
../image/images
Creating model...
Using node type: (<class 'model.networks.dla.DeformConv'>, <class 'model.networks.dla.DeformConv'>)
Warning: No ImageNet pretrain!!
loaded ../models/coco_tracking.pth, epoch 70
Drop parameter base.pre_hm_layer.0.weight.
Drop parameter base.pre_hm_layer.1.weight.
Drop parameter base.pre_hm_layer.1.bias.
Drop parameter base.pre_hm_layer.1.running_mean.
Drop parameter base.pre_hm_layer.1.running_var.
Drop parameter base.pre_hm_layer.1.num_batches_tracked.
Initialize tracking!
Traceback (most recent call last):
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py", line 129, in
demo(opt)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/demo.py", line 84, in demo
ret = detector.run(img)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/detector.py", line 119, in run
images, self.pre_images, pre_hms, pre_inds, return_time=True)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/detector.py", line 339, in process
output = self.model(images, pre_images, pre_hms)[-1]
File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call
result = self.forward(*input, **kwargs)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/base_model.py", line 75, in forward
feats = self.imgpre2feats(x, pre_img, pre_hm)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 635, in imgpre2feats
x = self.dla_up(x)
File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call
result = self.forward(*input, **kwargs)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 574, in forward
ida(layers, len(layers) -i - 2, len(layers))
File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call
result = self.forward(*input, **kwargs)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 545, in forward
layers[i] = upsample(project(layers[i]))
File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call
result = self.forward(*input, **kwargs)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/dla.py", line 518, in forward
x = self.conv(x)
File "/home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/nn/modules/module.py", line 541, in call
result = self.forward(*input, kwargs)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 128, in forward
self.deformable_groups)
File "/home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/dcn_v2.py", line 31, in forward
ctx.deformable_groups)
RuntimeError: Not compiled with GPU support (dcn_v2_forward at /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/src/dcn_v2.h:35)
frame #0: c10::Error::Error(c10::SourceLocation, std::string const&) + 0x47 (0x7f157763c687 in /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/lib/libc10.so)
frame #1: dcn_v2_forward(at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, at::Tensor const&, int, int, int, int, int, int, int, int, int) + 0x178 (0x7f155ba59c08 in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so)
frame #2: + 0x193bb (0x7f155ba673bb in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so)
frame #3: + 0x15c6c (0x7f155ba63c6c in /home/mts/Desktop/Pycharmpj/CenterTrack/src/lib/model/networks/DCNv2/_ext.cpython-36m-x86_64-linux-gnu.so)
frame #4: _PyCFunction_FastCallDict + 0x154 (0x5616c2db6304 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #5: + 0x199b0c (0x5616c2e3db0c in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #6: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #7: PyEval_EvalCodeEx + 0x329 (0x5616c2e38a49 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #8: + 0x195864 (0x5616c2e39864 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #9: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #10: THPFunction_apply(_object, _object) + 0x9ff (0x7f15ad15390f in /home/mts/anaconda3/envs/CenterTrack/lib/python3.6/site-packages/torch/lib/libtorch_python.so)
frame #11: _PyCFunction_FastCallDict + 0x91 (0x5616c2db6241 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #12: + 0x199b0c (0x5616c2e3db0c in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #13: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #14: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #15: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #16: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #17: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #18: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #19: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #20: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #21: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #22: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #23: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #24: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #25: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #26: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #27: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #28: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #29: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #30: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #31: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #32: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #33: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #34: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #35: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #36: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #37: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #38: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #39: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #40: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #41: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #42: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #43: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #44: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #45: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #46: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #47: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #48: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #49: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #50: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #51: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #52: + 0x16b4d1 (0x5616c2e0f4d1 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #53: _PyObject_FastCallDict + 0x8b (0x5616c2db64eb in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #54: + 0x199c5e (0x5616c2e3dc5e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #55: _PyEval_EvalFrameDefault + 0x30a (0x5616c2e6081a in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #56: _PyFunction_FastCallDict + 0x11b (0x5616c2e3836b in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #57: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #58: _PyObject_Call_Prepend + 0x63 (0x5616c2dbb143 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #59: PyObject_Call + 0x3e (0x5616c2db610e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #60: _PyEval_EvalFrameDefault + 0x1aaf (0x5616c2e61fbf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #61: + 0x192f26 (0x5616c2e36f26 in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #62: _PyFunction_FastCallDict + 0x1be (0x5616c2e3840e in /home/mts/anaconda3/envs/CenterTrack/bin/python)
frame #63: _PyObject_FastCallDict + 0x26f (0x5616c2db66cf in /home/mts/anaconda3/envs/CenterTrack/bin/python)
Process finished with exit code 1
The text was updated successfully, but these errors were encountered: