Update model card for public weights release
Browse files
README.md
CHANGED
|
@@ -20,8 +20,6 @@ Sol Pro is a **138,037,594-parameter** language model from Sol Labs. It combines
|
|
| 20 |
|
| 21 |
The released checkpoint scores **29.37 on the normalized Intelligence Index** and **24.01 on the raw accuracy Index**.
|
| 22 |
|
| 23 |
-
The final weights are saved in the private checkpoint bucket. Their upload to this repository is pending because the organization has reached its private storage limit. The loading example below becomes available once the weights upload completes.
|
| 24 |
-
|
| 25 |
## Model
|
| 26 |
|
| 27 |
| Setting | Value |
|
|
@@ -43,11 +41,10 @@ Four middle blocks run twice. Causal grouped-query attention uses learned Q/K RM
|
|
| 43 |
|
| 44 |
## Load and generate
|
| 45 |
|
| 46 |
-
Install the dependencies
|
| 47 |
|
| 48 |
```bash
|
| 49 |
pip install torch safetensors tokenizers huggingface_hub
|
| 50 |
-
hf auth login
|
| 51 |
```
|
| 52 |
|
| 53 |
```python
|
|
@@ -102,7 +99,6 @@ Sol Pro supports text-completion and small-model research. Multiple-choice score
|
|
| 102 |
| File | Contents |
|
| 103 |
|---|---|
|
| 104 |
| `model.safetensors` | Released inference weights |
|
| 105 |
-
| `checkpoint.pt` | Complete final checkpoint, including optimizer state; upload pending |
|
| 106 |
| `modeling_sol_pro.py` | Architecture, loader, and text generator |
|
| 107 |
| `config.json` | Architecture configuration |
|
| 108 |
| `tokenizer.json` | Original tokenizer |
|
|
|
|
| 20 |
|
| 21 |
The released checkpoint scores **29.37 on the normalized Intelligence Index** and **24.01 on the raw accuracy Index**.
|
| 22 |
|
|
|
|
|
|
|
| 23 |
## Model
|
| 24 |
|
| 25 |
| Setting | Value |
|
|
|
|
| 41 |
|
| 42 |
## Load and generate
|
| 43 |
|
| 44 |
+
Install the dependencies:
|
| 45 |
|
| 46 |
```bash
|
| 47 |
pip install torch safetensors tokenizers huggingface_hub
|
|
|
|
| 48 |
```
|
| 49 |
|
| 50 |
```python
|
|
|
|
| 99 |
| File | Contents |
|
| 100 |
|---|---|
|
| 101 |
| `model.safetensors` | Released inference weights |
|
|
|
|
| 102 |
| `modeling_sol_pro.py` | Architecture, loader, and text generator |
|
| 103 |
| `config.json` | Architecture configuration |
|
| 104 |
| `tokenizer.json` | Original tokenizer |
|