rodrigo-nogueira commited on
Commit
fabaee6
·
verified ·
1 Parent(s): c306e37

Unify S5-nano model cards with an introductory format paragraph

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -8,6 +8,8 @@ library_name: transformers
8
 
9
  # S5-nano
10
 
 
 
11
  S5-nano is a 4B-parameter model from Maritaca AI, derived from
12
  [Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B). It has two modes:
13
 
@@ -28,6 +30,11 @@ The context window supports up to 262,144 tokens, and the weights include an MTP
28
  FP8 is recommended for GPUs with native FP8 support (Ada, Hopper, and Blackwell).
29
  The GGUF repository provides BF16, Q8_0, and Q4_K_M variants.
30
 
 
 
 
 
 
31
  <!-- s5-nano-evaluation-results:start -->
32
  ## Evaluation results
33
 
@@ -962,6 +969,9 @@ Optional flags:
962
  For the FP8 version, replace the model name with `maritaca-ai/S5-nano-FP8`
963
  and keep the same flags.
964
 
 
 
 
965
  ### Requests with curl
966
 
967
  Think mode:
 
8
 
9
  # S5-nano
10
 
11
+ This repository contains the **BF16 version of S5-nano** (8.7 GB), with the original, unquantized weights for vLLM and SGLang. The [FP8 version](https://huggingface.co/maritaca-ai/S5-nano-FP8) reduces the weight size to 5.7 GB and is recommended for GPUs with native FP8 support. The [GGUF versions](https://huggingface.co/maritaca-ai/S5-nano-GGUF) are for llama.cpp and compatible applications, with BF16 (8.7 GB), Q8_0 (4.6 GB), and Q4_K_M (2.8 GB) options.
12
+
13
  S5-nano is a 4B-parameter model from Maritaca AI, derived from
14
  [Qwen3.5-4B](https://huggingface.co/Qwen/Qwen3.5-4B). It has two modes:
15
 
 
30
  FP8 is recommended for GPUs with native FP8 support (Ada, Hopper, and Blackwell).
31
  The GGUF repository provides BF16, Q8_0, and Q4_K_M variants.
32
 
33
+ The FP8 version uses E4M3 weights for linear layers, with one scale per 128×128
34
+ block, and dynamically quantizes activations during inference. Embeddings, the
35
+ vision encoder, and some small projections remain in BF16. The MTP layer is
36
+ included.
37
+
38
  <!-- s5-nano-evaluation-results:start -->
39
  ## Evaluation results
40
 
 
969
  For the FP8 version, replace the model name with `maritaca-ai/S5-nano-FP8`
970
  and keep the same flags.
971
 
972
+ When serving FP8, also use `maritaca-ai/S5-nano-FP8` in the request's
973
+ `model` field (or `MODEL` in the Python examples).
974
+
975
  ### Requests with curl
976
 
977
  Think mode: