truthcoder commited on
Commit
edeedc5
·
verified ·
1 Parent(s): 1778d84

PC section: per-size GGUF repos

Browse files
Files changed (1) hide show
  1. README.md +8 -4
README.md CHANGED
@@ -47,15 +47,19 @@ tags:
47
 
48
  ## Use it on a PC (Ollama / LM Studio / llama.cpp)
49
 
50
- GGUF files (Q4_K_M and Q8_0 for every size) are on the [Hugging Face page](https://huggingface.co/truthcoder/TC-Mini/tree/main/gguf).
 
 
 
 
51
 
52
  ```bash
53
  # Ollama
54
- ollama run hf.co/truthcoder/TC-Mini:Q4_K_M # picks the 4B
55
  # llama.cpp
56
- llama-cli -hf truthcoder/TC-Mini:Q4_K_M
57
  ```
58
- LM Studio: search **truthcoder/TC-Mini**.
59
 
60
  ## Verify a release yourself (any machine with OpenSSH ≥ 8.2)
61
 
 
47
 
48
  ## Use it on a PC (Ollama / LM Studio / llama.cpp)
49
 
50
+ | Size | GGUF repo | Q4_K_M | Best for |
51
+ |---|---|---|---|
52
+ | 4B | [truthcoder/TC-Mini-4B-GGUF](https://huggingface.co/truthcoder/TC-Mini-4B-GGUF) | 2.5 GB | desktops / laptops with a GPU or Apple Silicon |
53
+ | 1.7B | [truthcoder/TC-Mini-1.7B-GGUF](https://huggingface.co/truthcoder/TC-Mini-1.7B-GGUF) | 1.1 GB | small laptops, mini-PCs |
54
+ | 0.6B | [truthcoder/TC-Mini-0.6B-GGUF](https://huggingface.co/truthcoder/TC-Mini-0.6B-GGUF) | 0.4 GB | any computer |
55
 
56
  ```bash
57
  # Ollama
58
+ ollama run hf.co/truthcoder/TC-Mini-4B-GGUF:Q4_K_M
59
  # llama.cpp
60
+ llama-cli -hf truthcoder/TC-Mini-4B-GGUF:Q4_K_M
61
  ```
62
+ LM Studio: search **TC-Mini**. Q8_0 (near-lossless) and F16 files are in each repo too. Add `/no_think` to a message to skip the thinking step.
63
 
64
  ## Verify a release yourself (any machine with OpenSSH ≥ 8.2)
65