Loss isn't converging #874
Unanswered
zhaowenZhou
asked this question in
Q&A
Replies: 1 comment
-
Iim encountering a similar issue where the loss stops decreasing, specifically reaching around ln(0.5). My dataset consists of two classes。 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I am currently training CLIP model on my own dataset.
For image part, all images come from different set of sequential images and for text part, the title is scene, weather, light, for example: 'urban, sunny, backlight'.
The loss isnt converging
As for now i think the problem is that some of the images within a batch are from the same sequence, images will be alike and are likely to have same label. But model will still try to contrast it, make it hard to learn any useful information.
Any advice or idea will be greatly appreciated
Beta Was this translation helpful? Give feedback.
All reactions