MetaCLIP
Collection
MetaCLIP & MetaCLIP2 OpenCLIP and timm models. All models are dual timm + OpenCLIP (or just timm for specific vit encoders). • 24 items • Updated • 3
How to use timm/vit_base_patch16_clip_quickgelu_224.metaclip_400m with timm:
import timm
model = timm.create_model("hf_hub:timm/vit_base_patch16_clip_quickgelu_224.metaclip_400m", pretrained=True)How to use timm/vit_base_patch16_clip_quickgelu_224.metaclip_400m with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("image-classification", model="timm/vit_base_patch16_clip_quickgelu_224.metaclip_400m")
pipe("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/hub/parrots.png") # Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("timm/vit_base_patch16_clip_quickgelu_224.metaclip_400m", dtype="auto")