What is the result of sample running code? #412
-
Hi, there! I am new to this codebase. I have found several sample running code on cc12m or laion-400m, like this one
But I cannot find much description about what performance this code may achieve, like the zero-shot classification accuracy on ImageNet. Only a very short description in the released pretrained weights here, which shows a zero-shot acc of 36.45 of ResNet50. I wonder is that achieved by the sample running code? Or how I can reproduce performace of that level? Similarly, what is the running code to achieve the released checkpoints' accuracy like |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Hello! If you look for "slurm script" here you'll be able to find the command corresponding to the model: https://huggingface.co/laion/CLIP-ViT-L-14-laion2B-s32B-b82K. Sample accuracy curves for conceptual captions are here https://github.com/mlfoundations/open_clip/blob/main/docs/clip_conceptual_captions.md |
Beta Was this translation helpful? Give feedback.
Hello!
If you look for "slurm script" here you'll be able to find the command corresponding to the model: https://huggingface.co/laion/CLIP-ViT-L-14-laion2B-s32B-b82K.
Sample accuracy curves for conceptual captions are here https://github.com/mlfoundations/open_clip/blob/main/docs/clip_conceptual_captions.md