Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Model not getting trained #64

Open
IAM-P-LP opened this issue Aug 25, 2023 · 1 comment
Open

Model not getting trained #64

IAM-P-LP opened this issue Aug 25, 2023 · 1 comment

Comments

@IAM-P-LP
Copy link

Hi,
Thanks for this wonderful repo.
While training the model with this command 'python3 train.py --phi 0 --weights /home/priyalakshmip/pose_est_efficientpose/EfficientPose/COCO/efficientdet-d0.h5 linemod /home/priyalakshmip/pose_est_efficientpose/Linemod_preprocessed/ --object-id 4'
I am receiving nan in loss and the map is not also improving.I saw the issue #30.
I have installed cudatoolkit=10.0 and I am using the pretrained weight of efficientdet as well.Can you please suggest why the model is not learning and the steps to solve it?
image

N.B : Saw this warning
image
Is that the reason why the model isnt learning?

@DavidJimenezS
Copy link

No sure if you were able to solve the problem. But in short is due to GPU compatibility with cuda toolkit look here:

#69 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants