ginfer
catalog
SectileRon commited on
Commit
1b246ae
·
verified ·
1 Parent(s): f397af6

GInfer model catalog and README

Browse files
Files changed (2) hide show
  1. README.md +38 -0
  2. catalog.json +0 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: ginfer
4
+ tags:
5
+ - ginfer
6
+ - catalog
7
+ ---
8
+
9
+ # GInfer model catalog
10
+
11
+ `catalog.json` is the list of GInfer model packages that GChat offers for download. GChat reads this one file from
12
+ this repository; you do not need to open it yourself.
13
+
14
+ ## What it contains
15
+
16
+ Each model entry lists its packages. For every package the catalog gives:
17
+
18
+ - the package name and the model identity;
19
+ - the download URL, the exact size in bytes and the SHA-256 of the file, which GChat checks after downloading;
20
+ - the tensor-parallel size (1 for one GPU, 2 for two GPUs);
21
+ - where it runs: the NVIDIA GPU architectures and the least memory per GPU it was tested with, or the processor
22
+ types (AVX2, AVX-512, AMX) for a package that runs on the CPU;
23
+ - what the model supports (for example tools and vision);
24
+ - the tested launch settings, which GChat offers when you load the model.
25
+
26
+ ## Format
27
+
28
+ The file is JSON. `manifest_version` and `schema_version` are both `1`; `updated_at` is when the file was generated;
29
+ `models` is the list of model entries, each with a `releases` list. GChat accepts only schema version 1.
30
+
31
+ ## Downloads
32
+
33
+ Every URL points to one file in one of the SectileLabs model repositories and is pinned to that repository's commit
34
+ (`.../resolve/<commit>/<file>`), so a download is always the exact file listed here, even if the repository gets new
35
+ commits later. The size and SHA-256 in this catalog equal the file's Hugging Face metadata.
36
+
37
+ The packages run only on GInfer and GChat. They are not safetensors or GGUF files. The licenses of the models are in
38
+ each model repository.
catalog.json ADDED
The diff for this file is too large to render. See raw diff