Gabriel Okasa

okasag

1 9

okasag

AI & ML interests

text similarity & text classification

Recent Activity

liked a model 1 day ago

swiss-ai/Apertus-v1.5-8B

liked a model 11 months ago

swiss-ai/Apertus-70B-Instruct-2509

liked a model 11 months ago

swiss-ai/Apertus-70B-2509

View all activity

Organizations

liked a model 1 day ago

swiss-ai/Apertus-v1.5-8B

Image-Text-to-Text • 9B • Updated 7 days ago • 2.91k • • 53

liked 4 models 11 months ago

upvoted a collection 11 months ago

Apertus v1

Collection

Democratizing Open and Compliant LLMs for Global Language Environments: 8B and 70B open-data open-weights models, multilingual in >1000 languages • 4 items • Updated 7 days ago • 361

reacted to tomaarsen's post with ❤️❤️ over 1 year ago

Post

6958

An assembly of 18 European companies, labs, and universities have banded together to launch 🇪🇺 EuroBERT! It's a state-of-the-art multilingual encoder for 15 European languages, designed to be finetuned for retrieval, classification, etc.

🇪🇺 15 Languages: English, French, German, Spanish, Chinese, Italian, Russian, Polish, Portuguese, Japanese, Vietnamese, Dutch, Arabic, Turkish, Hindi
3️⃣ 3 model sizes: 210M, 610M, and 2.1B parameters - very very useful sizes in my opinion
➡️ Sequence length of 8192 tokens! Nice to see these higher sequence lengths for encoders becoming more common.
⚙️ Architecture based on Llama, but with bi-directional (non-causal) attention to turn it into an encoder. Flash Attention 2 is supported.
🔥 A new Pareto frontier (stronger *and* smaller) for multilingual encoder models
📊 Evaluated against mDeBERTa, mGTE, XLM-RoBERTa for Retrieval, Classification, and Regression (after finetuning for each task separately): EuroBERT punches way above its weight.
📝 Detailed paper with all details, incl. data: FineWeb for English and CulturaX for multilingual data, The Stack v2 and Proof-Pile-2 for code.

Check out the release blogpost here: https://huggingface.co/blog/EuroBERT/release
* EuroBERT/EuroBERT-210m
* EuroBERT/EuroBERT-610m
* EuroBERT/EuroBERT-2.1B

The next step is for researchers to build upon the 3 EuroBERT base models and publish strong retrieval, zero-shot classification, etc. models for all to use. I'm very much looking forward to it!

1 reply

liked 3 models over 1 year ago

EuroBERT/EuroBERT-2.1B

Fill-Mask • 2B • Updated Oct 18, 2025 • 8.12k • 67

Alibaba-NLP/gte-modernbert-base

Alibaba-NLP/gte-reranker-modernbert-base

Text Ranking • 0.1B • Updated Jul 4, 2025 • 2.43M • 97

liked a Space over 1 year ago

ModernBert

🚀

Similarity

reacted to FremyCompany's post with 👍 over 1 year ago

Post

1257

🔀 Very cool demo of word-level alignment of paraphrased or cross-lingual sentences, from the new Fairly Multilingual ModernBERT embedding model:

Parallia/Fairly-Multilingual-ModernBERT-Token-Alignment