GInfer model catalog and README
Browse files- README.md +38 -0
- catalog.json +0 -0
README.md
ADDED
|
@@ -0,0 +1,38 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
library_name: ginfer
|
| 4 |
+
tags:
|
| 5 |
+
- ginfer
|
| 6 |
+
- catalog
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# GInfer model catalog
|
| 10 |
+
|
| 11 |
+
`catalog.json` is the list of GInfer model packages that GChat offers for download. GChat reads this one file from
|
| 12 |
+
this repository; you do not need to open it yourself.
|
| 13 |
+
|
| 14 |
+
## What it contains
|
| 15 |
+
|
| 16 |
+
Each model entry lists its packages. For every package the catalog gives:
|
| 17 |
+
|
| 18 |
+
- the package name and the model identity;
|
| 19 |
+
- the download URL, the exact size in bytes and the SHA-256 of the file, which GChat checks after downloading;
|
| 20 |
+
- the tensor-parallel size (1 for one GPU, 2 for two GPUs);
|
| 21 |
+
- where it runs: the NVIDIA GPU architectures and the least memory per GPU it was tested with, or the processor
|
| 22 |
+
types (AVX2, AVX-512, AMX) for a package that runs on the CPU;
|
| 23 |
+
- what the model supports (for example tools and vision);
|
| 24 |
+
- the tested launch settings, which GChat offers when you load the model.
|
| 25 |
+
|
| 26 |
+
## Format
|
| 27 |
+
|
| 28 |
+
The file is JSON. `manifest_version` and `schema_version` are both `1`; `updated_at` is when the file was generated;
|
| 29 |
+
`models` is the list of model entries, each with a `releases` list. GChat accepts only schema version 1.
|
| 30 |
+
|
| 31 |
+
## Downloads
|
| 32 |
+
|
| 33 |
+
Every URL points to one file in one of the SectileLabs model repositories and is pinned to that repository's commit
|
| 34 |
+
(`.../resolve/<commit>/<file>`), so a download is always the exact file listed here, even if the repository gets new
|
| 35 |
+
commits later. The size and SHA-256 in this catalog equal the file's Hugging Face metadata.
|
| 36 |
+
|
| 37 |
+
The packages run only on GInfer and GChat. They are not safetensors or GGUF files. The licenses of the models are in
|
| 38 |
+
each model repository.
|
catalog.json
ADDED
|
The diff for this file is too large to render.
See raw diff
|
|
|