Script for comparison of CoCa zero-shot to open_clip implementation

ghstack-source-id: ab00a880c06992df61427d3fadaf38050bda0995 Pull Request resolved: #507
facebookresearch · Nov 1, 2023 · 2a9f799 · 2a9f799
1 parent f459552
commit 2a9f799
Show file tree

Hide file tree

Showing 10 changed files with 1,466 additions and 4 deletions.
diff --git a/...coca/benchmark_imagenet1k_laion2b_s13b_b90k_coca_ViT-L-14_en_zeroshot_classification.json b/...coca/benchmark_imagenet1k_laion2b_s13b_b90k_coca_ViT-L-14_en_zeroshot_classification.json
@@ -0,0 +1 @@
+{"dataset": "wds/imagenet1k", "model": "coca_ViT-L-14", "pretrained": "laion2b_s13b_b90k", "task": "zeroshot_classification", "metrics": {"acc1": 0.7564, "acc5": 0.94286, "mean_per_class_recall": 0.75652}, "language": "en"}
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1 @@
		{"dataset": "wds/imagenet1k", "model": "coca_ViT-L-14", "pretrained": "laion2b_s13b_b90k", "task": "zeroshot_classification", "metrics": {"acc1": 0.7564, "acc5": 0.94286, "mean_per_class_recall": 0.75652}, "language": "en"}