slone/myv_ru_2022
Viewer • Updated • 411k • 224 • 3
How to use slone/LaBSE-en-ru-myv-v2 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("feature-extraction", model="slone/LaBSE-en-ru-myv-v2") # Load model directly
from transformers import AutoTokenizer, AutoModelForPreTraining
tokenizer = AutoTokenizer.from_pretrained("slone/LaBSE-en-ru-myv-v2")
model = AutoModelForPreTraining.from_pretrained("slone/LaBSE-en-ru-myv-v2", device_map="auto")This is a version of LaBSE-en-ru-myv-v1, fine-tuned for about 150K steps on the myv_ru_2022 dataset, in this notebook.
It demonstrates slighly better results than the v1 model, both on bitext mining and on the MLM task.