MetaCLIP
en construction
Définition
XXXXXXXXX
Français
MetaCLIP
Anglais
MetaCLIP
The first recipe for training CLIP models from scratch on worldwide web-scale image-text pairs spanning 300+ languages. The work addresses the challenge of scaling CLIP beyond English-only data while avoiding the "curse of multilinguality" - where multilingual models perform worse on English tasks than their English-only counterparts. The paper demonstrates that with proper data curation, metadata construction, and training framework design, English and non-English data can actually benefit each other mutually. MetaCLIP 2, trained on worldwide web-scale image-text pairs, improves zero-shot classification and multilingual benchmarks without system-level confounding factors.
Source
Contributeurs: wiki
