Instructions to use anocha-mcomp/lora_model with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use anocha-mcomp/lora_model with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("anocha-mcomp/lora_model", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
Download linkedin_post_draft.md from anocha-mcomp/lora_model: direct link, hf CLI and curl.
- Browser
- Download file 1.69 kB
-
https://huggingface.co/anocha-mcomp/lora_model/resolve/main/linkedin_post_draft.md
- Command line
-
hf download hf://anocha-mcomp/lora_model/linkedin_post_draft.md
-
curl -L -o linkedin_post_draft.md https://huggingface.co/anocha-mcomp/lora_model/resolve/main/linkedin_post_draft.md
Linkedin post draft
The Best Embedding Models for Southeast Asian Use (and Open Too!)
Excited to share something we've been building for a while β open embedding models, purpose-built for Southeast Asia.
Three models, two checkpoints:
- SEA-LION-E5-Embedding-600M β fine-tuned on multilingual-E5, 512 token context
- SEA-LION-ModernBERT-300M β ModernBERT + Gemma 3 tokenizer, 8k context
- SEA-LION-ModernBERT-600M β ModernBERT + Gemma 3 tokenizer, 8k context
Trained on 1β2T tokens from the region. We chose ModernBERT as the base for its strong multilingual architecture, and paired it with the Gemma 3 tokenizer β which handles SEA scripts and languages significantly better than most tokenizers out there. Less token fragmentation, better semantic coverage across Thai, Bahasa, Tagalog, Vietnamese and the rest.
On performance: all three sit at the top of SEA-BED β the benchmark specifically designed for Southeast Asian language understanding β comparable to or beating multilingual-E5-large, BGE-M3, Qwen, and text-embedding-ada-002 depending on the language. The 600M ModernBERT in particular punches hard across the board.
Why care? Embeddings are how AI searches and retrieves β foundational to RAG, search, any agentic system. Most models treat SEA languages as a byproduct. Get that wrong and you get a memory system with blind spots, whole chunks of information that just don't surface when they should. [data point]. We built these so SEA is the default, not the afterthought β while keeping strong English and Chinese performance too (both very much SEA languages π).
Models: [HuggingFace link] Blog: [link]
[Acknowledgements]