Language support problem

#10
by SepehrAA - opened

hello,

In the Model Details --> Model Description --> Language(s) (NLP), you can find "Persian" as a supported language.
But when I input Persian text into the "Hosted Inference API" It does not output anything. loading the example model into google colab didn't work either; it returns several tokens.

Is there anything I'm missing? any clue would be helpful.

Thank you very much

SepehrAA changed discussion status to closed
SepehrAA changed discussion status to open
•
This comment has been hidden

cc @ybelkada if you have any thoughts!

Hi @SepehrAA
Thanks for the issue
Please have a look at this GitHub issue: https://github.com/google-research/t5x/issues/1131 it turns out the released checkpoints do not include the multi-lingual capabilities stated in the paper. We have recently changed the model card to reflect the changes and state the supported languages of this model

Screenshot 2023-10-09 at 18.25.55.png

As soon as Google releases multilingual checkpoints we'll make sure it is going to be supported from day 0 on HF transformers.

Sign up or log in to comment