ykyao commited on
Commit
81dc213
·
verified ·
1 Parent(s): 006866a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -8
README.md CHANGED
@@ -41,14 +41,6 @@ with torch.inference_mode():
41
  print(tokenizer.decode(output[0], skip_special_tokens=True))
42
  ```
43
 
44
- Keep the weights in FP32 as shown: the implementation uses BF16 residuals and
45
- BF16 autocast internally, matching the training model's mixed-precision policy.
46
- The release retains the original FP32 master weights without lossy conversion.
47
- The tested path uses a single CUDA device.
48
- Multi-device dispatch and quantization have not been validated.
49
- Total prompt plus generation length must not exceed 4096.
50
- For batches, the tokenizer uses left padding; pass its `attention_mask` to the model.
51
-
52
  ## Architecture
53
 
54
  | Property | Value |
 
41
  print(tokenizer.decode(output[0], skip_special_tokens=True))
42
  ```
43
 
 
 
 
 
 
 
 
 
44
  ## Architecture
45
 
46
  | Property | Value |