Commit History
-
Update README.md (#1)
- Update README.md (7a01ca3a1b6b3dbb786d13f011ed193f3664b107) Co-authored-by: Loïck BOURDOIS <lbourdois@users.noreply.huggingface.co>f0b525a
-
upload flax model
0587c78 -
allow flax
029f732
-
Create README.md
ff85d1d -
Update README.md
040db0b -
Update README.md
9bac374 -
Create README.md
23420fd -
Create README.md
<br /> <p align="center"> <h1 align="center">M-BERT Distil 40</h1> <p align="center"> <a href="https://huggingface.co/M-CLIP/M-BERT-Distil-40">Huggingface Model</a> · <a href="https://huggingface.co/distilbert-base-multilingual-cased">Huggingface Base Model</a> </p> </p> <!-- ABOUT THE PROJECT --> ## About A [distilbert-base-multilingual](https://huggingface.co/distilbert-base-multilingual-cased) tuned to match the embedding space for 40 languages, to the embedding space of the CLIP text encoder which accompanies the Res50x4 vision encoder. <br> A full list of the 100 languages used during pre-training can be found [here](https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages), and a list of the 40 languages used during fine-tuning can be found in [SupportedLanguages.md](Fine-Tune-Languages.md). Training data pairs was generated by sampling 40k sentences for each language from the combined descriptions of [GCC](h…52b5a62
-
Main Commit
Fredrik4a6404f -
initial commit
b4ad684
