harpertoken commited on
Commit
f3c3a47
·
verified ·
1 Parent(s): a230302

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -13,11 +13,11 @@ tags:
13
 
14
  # tiny
15
 
16
- A four-bit quantised conversion of [`mlx-community/SmolLM-135M-Instruct-4bit`](https://huggingface.co/mlx-community/SmolLM-135M-Instruct-4bit), produced with `mlx-lm` 0.30.4 and intended for Apple Silicon. The architecture is a Llama variant — thirty layers, 576 hidden dimensions, nine attention heads, three key-value heads, 49152-token vocabulary — with group-size 64 four-bit weights, occupying about 76 MB.
17
 
18
  The `model.safetensors.index.json` alongside the weights is not a sharded checkpoint here; it maps all 694 tensors onto the single `model.safetensors` file that sits beside it.
19
 
20
- Because the weights are quantised, `transformers` cannot load this checkpoint — it needs `mlx-lm`, which applies the group quantisation at load time. The instruction tuning lives upstream in SmolLM; this repository adds a format, nothing else. Given the size, expect it to be fast and largely incoherent on factual questions.
21
 
22
  ## Usage
23
 
 
13
 
14
  # tiny
15
 
16
+ A four-bit quantised conversion of [`mlx-community/SmolLM-135M-Instruct-4bit`](https://huggingface.co/mlx-community/SmolLM-135M-Instruct-4bit), produced with `mlx-lm` 0.30.4 and intended for Apple Silicon. The architecture is a Llama variant (thirty layers, 576 hidden dimensions, nine attention heads, three key-value heads, 49152-token vocabulary) with group-size 64 four-bit weights, occupying about 76 MB.
17
 
18
  The `model.safetensors.index.json` alongside the weights is not a sharded checkpoint here; it maps all 694 tensors onto the single `model.safetensors` file that sits beside it.
19
 
20
+ Because the weights are quantised, `transformers` cannot load this checkpoint; it needs `mlx-lm`, which applies the group quantisation at load time. The instruction tuning lives upstream in SmolLM; this repository adds a format, nothing else. Given the size, expect it to be fast and largely incoherent on factual questions.
21
 
22
  ## Usage
23