Instructions to use Rnfudge/snap-embedder-v1-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Rnfudge/snap-embedder-v1-GGUF with sentence-transformers:

from sentence_transformers import SentenceTransformer

model = SentenceTransformer("Rnfudge/snap-embedder-v1-GGUF")

sentences = [
    "What is the significance of the IPv6 multicast address ff02::1?",
    "Felt board for classroom activities",
    "In the provided network output, the frequent appearance of `ff020000000000000000000000000001` across various interfaces like `lo`, `eth0`, and `eth1` indicates that these interfaces are correctly configured for basic IPv6 operations. Every active IPv6 interface on a segment must listen for messages sent to `ff02::1` to participate in essential link-local protocols, making its presence a standard and expected entry.",
    "Not all customizations are supported across all snapd image types or models. For example, certain customizations might be unsupported for UC20+ or classic models, leading to errors. Additionally, if a gadget snap itself defines `defaults` in its `meta/gadget.yaml`, these can be overridden or complemented by the `Customizations` provided during the `SetupSeed` call, affecting system services like SSH."
]
embeddings = model.encode(sentences)

similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [4, 4]

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use Rnfudge/snap-embedder-v1-GGUF with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible embeddings server:
llama serve -hf Rnfudge/snap-embedder-v1-GGUF:Q4_K_M --embeddings

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible embeddings server:
llama serve -hf Rnfudge/snap-embedder-v1-GGUF:Q4_K_M --embeddings

Build from source code

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible embeddings server:
./build/bin/llama serve -hf Rnfudge/snap-embedder-v1-GGUF:Q4_K_M --embeddings

Llama new
LM Studio
Jan
Ollama
How to use Rnfudge/snap-embedder-v1-GGUF with Ollama:
```
ollama run hf.co/Rnfudge/snap-embedder-v1-GGUF:Q4_K_M
```
Unsloth Desktop
Docker Model Runner
How to use Rnfudge/snap-embedder-v1-GGUF with Docker Model Runner:
```
docker model run hf.co/Rnfudge/snap-embedder-v1-GGUF:Q4_K_M
```

Lemonade

How to use Rnfudge/snap-embedder-v1-GGUF with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull Rnfudge/snap-embedder-v1-GGUF:Q4_K_M

Run and chat with the model

lemonade run user.snap-embedder-v1-GGUF-Q4_K_M

List all available models

lemonade list

Atomic Chat

New discussion

Resources

View closed (0)

Welcome to the community

The community tab is the place to discuss and collaborate with the HF community!