Instructions to use Snowflake/snowflake-arctic-embed-m-v1.5 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use Snowflake/snowflake-arctic-embed-m-v1.5 with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("Snowflake/snowflake-arctic-embed-m-v1.5") sentences = [ "That is a happy person", "That is a happy dog", "That is a very happy person", "Today is a sunny day" ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [4, 4] - Transformers.js
How to use Snowflake/snowflake-arctic-embed-m-v1.5 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('feature-extraction', 'Snowflake/snowflake-arctic-embed-m-v1.5'); - Inference
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Snowflake/snowflake-arctic-embed-m-v1.5 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf Snowflake/snowflake-arctic-embed-m-v1.5:BF16 --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf Snowflake/snowflake-arctic-embed-m-v1.5:BF16 --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible embeddings server: ./build/bin/llama serve -hf Snowflake/snowflake-arctic-embed-m-v1.5:BF16 --embeddings
- Llama new
- LM Studio
- Jan
- Ollama
How to use Snowflake/snowflake-arctic-embed-m-v1.5 with Ollama:
ollama run hf.co/Snowflake/snowflake-arctic-embed-m-v1.5:BF16
- Unsloth Desktop
- Docker Model Runner
How to use Snowflake/snowflake-arctic-embed-m-v1.5 with Docker Model Runner:
docker model run hf.co/Snowflake/snowflake-arctic-embed-m-v1.5:BF16
- Lemonade
How to use Snowflake/snowflake-arctic-embed-m-v1.5 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Snowflake/snowflake-arctic-embed-m-v1.5:BF16
Run and chat with the model
lemonade run user.snowflake-arctic-embed-m-v1.5-BF16
List all available models
lemonade list
- Atomic Chat
Languages?
Can someone share the supported languages for this model?
The model was trained specifically for English language retrieval.
@lukemerrick Are there any plans to bring out a multilingual version? That would be very valuable! If you have recommendations for multilingual alternatives, those are welcome too.
What language(a) are you trying to support, @BramVanroy ? I don't think my team maintains any kind of public roadmap I can share, but we always appreciate user input!
@lukemerrick I'd be really happy to get some more powerful models for Dutch out there. I've been training a lot of generative models, but for retrieving/embedding we could really use new, high quality models such as Snowflake has provided for English!
By the way, the Netherlands Forensic Institute has released some datasets translated to Dutch in case anyone is looking for training data: https://huggingface.co/NetherlandsForensicInstitute
@BramVanroy @Mazyod Come check out our new multilingual models! https://huggingface.co/Snowflake/snowflake-arctic-embed-l-v2.0
This is really cool, we have downloaded it already to benchmark it against other Arabic embedding models. Thanks!!