Text Generation
MLC-LLM
GGUF
webgpu
webllm
on-device
offline
private
abliterated
uncensored
qwen3
ollama
mobile
Instructions to use truthcoder/TC-Mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLC-LLM
How to use truthcoder/TC-Mini with MLC-LLM:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
PC section: per-size GGUF repos
Browse files
README.md
CHANGED
|
@@ -47,15 +47,19 @@ tags:
|
|
| 47 |
|
| 48 |
## Use it on a PC (Ollama / LM Studio / llama.cpp)
|
| 49 |
|
| 50 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
|
| 52 |
```bash
|
| 53 |
# Ollama
|
| 54 |
-
ollama run hf.co/truthcoder/TC-Mini:Q4_K_M
|
| 55 |
# llama.cpp
|
| 56 |
-
llama-cli -hf truthcoder/TC-Mini:Q4_K_M
|
| 57 |
```
|
| 58 |
-
LM Studio: search **
|
| 59 |
|
| 60 |
## Verify a release yourself (any machine with OpenSSH ≥ 8.2)
|
| 61 |
|
|
|
|
| 47 |
|
| 48 |
## Use it on a PC (Ollama / LM Studio / llama.cpp)
|
| 49 |
|
| 50 |
+
| Size | GGUF repo | Q4_K_M | Best for |
|
| 51 |
+
|---|---|---|---|
|
| 52 |
+
| 4B | [truthcoder/TC-Mini-4B-GGUF](https://huggingface.co/truthcoder/TC-Mini-4B-GGUF) | 2.5 GB | desktops / laptops with a GPU or Apple Silicon |
|
| 53 |
+
| 1.7B | [truthcoder/TC-Mini-1.7B-GGUF](https://huggingface.co/truthcoder/TC-Mini-1.7B-GGUF) | 1.1 GB | small laptops, mini-PCs |
|
| 54 |
+
| 0.6B | [truthcoder/TC-Mini-0.6B-GGUF](https://huggingface.co/truthcoder/TC-Mini-0.6B-GGUF) | 0.4 GB | any computer |
|
| 55 |
|
| 56 |
```bash
|
| 57 |
# Ollama
|
| 58 |
+
ollama run hf.co/truthcoder/TC-Mini-4B-GGUF:Q4_K_M
|
| 59 |
# llama.cpp
|
| 60 |
+
llama-cli -hf truthcoder/TC-Mini-4B-GGUF:Q4_K_M
|
| 61 |
```
|
| 62 |
+
LM Studio: search **TC-Mini**. Q8_0 (near-lossless) and F16 files are in each repo too. Add `/no_think` to a message to skip the thinking step.
|
| 63 |
|
| 64 |
## Verify a release yourself (any machine with OpenSSH ≥ 8.2)
|
| 65 |
|