Instructions to use tensorblock/komt_DPOv3-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use tensorblock/komt_DPOv3-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf tensorblock/komt_DPOv3-GGUF:Q2_K # Run inference directly in the terminal: llama cli -hf tensorblock/komt_DPOv3-GGUF:Q2_K
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf tensorblock/komt_DPOv3-GGUF:Q2_K # Run inference directly in the terminal: llama cli -hf tensorblock/komt_DPOv3-GGUF:Q2_K
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf tensorblock/komt_DPOv3-GGUF:Q2_K # Run inference directly in the terminal: ./build/bin/llama cli -hf tensorblock/komt_DPOv3-GGUF:Q2_K
Use Docker
docker model run hf.co/tensorblock/komt_DPOv3-GGUF:Q2_K
- Llama new
- LM Studio
- Jan
- Ollama
How to use tensorblock/komt_DPOv3-GGUF with Ollama:
ollama run hf.co/tensorblock/komt_DPOv3-GGUF:Q2_K
- Unsloth Desktop
- Docker Model Runner
How to use tensorblock/komt_DPOv3-GGUF with Docker Model Runner:
docker model run hf.co/tensorblock/komt_DPOv3-GGUF:Q2_K
- Lemonade
How to use tensorblock/komt_DPOv3-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull tensorblock/komt_DPOv3-GGUF:Q2_K
Run and chat with the model
lemonade run user.komt_DPOv3-GGUF-Q2_K
List all available models
lemonade list
- Atomic Chat
Remove .gguf files (keep Q2_K.gguf)
Browse files- komt_DPOv3-Q3_K_L.gguf +0 -3
- komt_DPOv3-Q3_K_M.gguf +0 -3
- komt_DPOv3-Q3_K_S.gguf +0 -3
- komt_DPOv3-Q4_0.gguf +0 -3
- komt_DPOv3-Q4_K_M.gguf +0 -3
- komt_DPOv3-Q4_K_S.gguf +0 -3
- komt_DPOv3-Q5_0.gguf +0 -3
- komt_DPOv3-Q5_K_M.gguf +0 -3
- komt_DPOv3-Q5_K_S.gguf +0 -3
- komt_DPOv3-Q6_K.gguf +0 -3
- komt_DPOv3-Q8_0.gguf +0 -3
komt_DPOv3-Q3_K_L.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:f73f2c605194c0e70ee65f60000ff4bc7e97ffcb2ec5ae37ad3b53627000a430
|
| 3 |
-
size 5733066784
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q3_K_M.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:8f04d8d0cd624773b004febd268a247ef4bf6efc703a4fedf3fbf5934f3f4f16
|
| 3 |
-
size 5277984800
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q3_K_S.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:9aa3df19c715b4d7b01fbf278e85535fa058dd21aef84519c45024325ac200ac
|
| 3 |
-
size 4746881056
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q4_0.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:052f0d295baa7a9854b63a673c58885a0ae3f59fb1d4f3d2ba85341cce3809b2
|
| 3 |
-
size 6163404832
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q4_K_M.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:c66c79c99b0674c7efad94d6b71aaaccf8c1b06e7f4274c8409195e1de0f2f44
|
| 3 |
-
size 6552688672
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q4_K_S.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:5d310f434ee66069fcb6603e922125b8f879da03ec7c7b559b4ea5db10e041d6
|
| 3 |
-
size 6209542176
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q5_0.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:81839633875fdba576db6acf2db7ccdd0c29a8d694232ffb3499fcce7f670dfc
|
| 3 |
-
size 7496603680
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q5_K_M.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:7723284da4e61e1b994660da5ec9c523d8cf612089a6784178cd8ccc698b9997
|
| 3 |
-
size 7697143840
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q5_K_S.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:14ec852d985662e837cadb0c50c39046f762ecc587a8b89c867a426344b4189d
|
| 3 |
-
size 7496603680
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q6_K.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:00b678588ff04a29a87cb2522069f513d4425c3669a47850ed7d7028a85d6b8e
|
| 3 |
-
size 8913127456
|
|
|
|
|
|
|
|
|
|
|
|
komt_DPOv3-Q8_0.gguf
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:f6a98a21a151ef76b0438ef9dc0d1256eac3d75dddd2cd4056391410014da952
|
| 3 |
-
size 11543816224
|
|
|
|
|
|
|
|
|
|
|
|