Instructions to use SciTools/embedding with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SciTools/embedding with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf SciTools/embedding:F16 --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf SciTools/embedding:F16 --embeddings
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible embeddings server: ./llama-server -hf SciTools/embedding:F16 --embeddings
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible embeddings server: ./build/bin/llama-server -hf SciTools/embedding:F16 --embeddings
- LM Studio
- Jan
- Ollama
How to use SciTools/embedding with Ollama:
ollama run hf.co/SciTools/embedding:F16
- Unsloth Desktop
- Docker Model Runner
How to use SciTools/embedding with Docker Model Runner:
docker model run hf.co/SciTools/embedding:F16
- Lemonade
How to use SciTools/embedding with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SciTools/embedding:F16
Run and chat with the model
lemonade run user.embedding-F16
List all available models
lemonade list
- Atomic Chat
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
|
|
|
| 1 |
+
A small English embedding model by BAAI (Beijing Academy of Artificial Intelligence).
|
| 2 |
+
|
| 3 |
+
This repository hosts the ONNX version of the model used by Understand to generate embeddings for semantic search, allowing users to search their codebase by meaning rather than exact keyword matches.
|
| 4 |
+
|
| 5 |
---
|
| 6 |
license: mit
|
| 7 |
---
|