yanghaojin commited on
Commit
1cf5164
·
verified ·
1 Parent(s): 562088b

Model card: install and run the signed gbx_lm binary

Browse files

The Python package is no longer published; the card now documents the notarised Apple Silicon binary, its macOS and chip requirements, and the memory this build actually takes.

Files changed (1) hide show
  1. README.md +49 -6
README.md CHANGED
@@ -4,7 +4,6 @@ language:
4
  - zh
5
  license: mit
6
  base_model: pipenetwork/GLM-5.3-Flash-MLX-4bit
7
- library_name: gbx-lm
8
  pipeline_tag: image-text-to-text
9
  tags:
10
  - mlx
@@ -27,12 +26,56 @@ of it.
27
  | `mtp/` | 3.90 GiB | draft head, off by default |
28
 
29
  Total 169.27 GiB. Of that, 165.37 GiB is the source build, whose bytes moved into
 
 
 
 
30
  containers rather than being copied, and 3.90 GiB is the draft head, which no
31
  published build of this model carries.
32
 
33
- ```python
34
- from gbx_lm.utils import load
35
- model, tokenizer = load("GreenBitAI/GLM-5.3-Flash-4bit-paged")
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
  ```
37
 
38
  Where the weights fit they are filled from `experts.bin` and the model runs the
@@ -53,8 +96,8 @@ from `zai-org/GLM-5.3-Flash`, so speculative decoding works from this repository
53
  alone. It is off unless asked for:
54
 
55
  ```bash
56
- GBX_GLM53_MTP=on python -m gbx_lm.generate --model GreenBitAI/GLM-5.3-Flash-4bit-paged --max-tokens 256 --prompt "..."
57
- GBX_GLM53_MTP=on python -m gbx_lm.fastapi_server --model GreenBitAI/GLM-5.3-Flash-4bit-paged
58
  ```
59
 
60
  **It grows with the context.** Measured 2026-09-18 on a 512 GB Mac Studio
 
4
  - zh
5
  license: mit
6
  base_model: pipenetwork/GLM-5.3-Flash-MLX-4bit
 
7
  pipeline_tag: image-text-to-text
8
  tags:
9
  - mlx
 
26
  | `mtp/` | 3.90 GiB | draft head, off by default |
27
 
28
  Total 169.27 GiB. Of that, 165.37 GiB is the source build, whose bytes moved into
29
+
30
+ These containers are not a format `mlx-lm` reads. The model runs on
31
+ **`gbx_lm`**, a single signed binary for Apple Silicon; there is nothing to
32
+ `pip install`.
33
  containers rather than being copied, and 3.90 GiB is the draft head, which no
34
  published build of this model carries.
35
 
36
+ ## Requirements
37
+
38
+ | | |
39
+ | --- | --- |
40
+ | macOS | **15.0 or later** |
41
+ | chip | **Apple Silicon** (arm64). There is no Intel build. |
42
+ | Python | none -- the binary carries what it needs |
43
+
44
+ Memory is not a fixed figure for a paged build, and that is the point of one: it
45
+ fills what fits and streams the rest from disk. On a 512 GB Mac Studio with room
46
+ to spare this model settles at about **172 GB** resident. A smaller machine holds
47
+ less and reads more from disk -- slower, but it runs.
48
+
49
+ ## Install
50
+
51
+ ```bash
52
+ curl -fL -o gbx_lm-darwin-arm64.tar.gz 'https://github.com/GreenBitAI/gbx-lm/releases/latest/download/gbx_lm-darwin-arm64.tar.gz' \
53
+ && tar -xzf gbx_lm-darwin-arm64.tar.gz gbx_lm \
54
+ && mkdir -p "$HOME/.local/bin" \
55
+ && mv gbx_lm "$HOME/.local/bin/gbx_lm" \
56
+ && chmod +x "$HOME/.local/bin/gbx_lm"
57
+
58
+ gbx_lm -h
59
+ ```
60
+
61
+ `command not found` means `$HOME/.local/bin` is not on your `PATH`: add it, or
62
+ call the binary by its full path. The build is signed with a Developer ID and
63
+ notarised, so macOS runs it without the usual detour for a downloaded binary.
64
+
65
+ ## Run
66
+
67
+ ```bash
68
+ gbx_lm --model GreenBitAI/GLM-5.3-Flash-4bit-paged --port 8111
69
+ ```
70
+
71
+ That serves an OpenAI-compatible API on port 8111. The weights download on first
72
+ use into `~/.libra/cache/models`; set `HF_HOME` to put them elsewhere, and
73
+ `HF_TOKEN` if you meet the Hub's rate limits for anonymous downloads.
74
+
75
+ ```bash
76
+ curl http://127.0.0.1:8111/v1/chat/completions \
77
+ -H 'Content-Type: application/json' \
78
+ -d '{"model":"GreenBitAI/GLM-5.3-Flash-4bit-paged","messages":[{"role":"user","content":"Hello"}]}'
79
  ```
80
 
81
  Where the weights fit they are filled from `experts.bin` and the model runs the
 
96
  alone. It is off unless asked for:
97
 
98
  ```bash
99
+ GBX_GLM53_MTP=on gbx_lm --model GreenBitAI/GLM-5.3-Flash-4bit-paged --port 8111
100
+ GBX_GLM53_MTP=on gbx_lm --model GreenBitAI/GLM-5.3-Flash-4bit-paged --port 8111
101
  ```
102
 
103
  **It grows with the context.** Measured 2026-09-18 on a 512 GB Mac Studio