Bug: Pod UnexpectedAdmissionError, nvidia-gpu.sock connection refused

[gzchen008]

Pod status :UnexpectedAdmissionError
Message: Pod Allocate failed due to pc error: code = Unavailable desc = error reading from server: EOF, which is unexpected
resource:
Limits:
volcano.sh/vgpu-cores: 50
volcano.sh/vgpu-memory: 3k
volcano.sh/vgpu-number: 1

kubelet log:
Err: connection error: desc = "transport: Error while dialing dial unix /var/lib/kubelet/device-plugins/nvidia-gpu.sock: connect:
connection refused.