docs(card): regenerated from the current table and course
Browse files
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
library_name: rukh
|
| 4 |
-
base_model: chorcat/rukh-medium
|
| 5 |
tags:
|
| 6 |
- chess
|
| 7 |
- rukh
|
|
@@ -11,7 +11,7 @@ tags:
|
|
| 11 |
|
| 12 |
# chorcat/rukh-lora-e4
|
| 13 |
|
| 14 |
-
A LoRA adapter for [`chorcat/rukh-medium
|
| 15 |
nothing: it is 393,216 numbers (1.6 MB) that
|
| 16 |
correct that model's weights, and without them there is no model to correct.
|
| 17 |
|
|
@@ -40,13 +40,13 @@ weights and two readings agree to the last decimal:
|
|
| 40 |
|
| 41 |
| | P(`e2e4`) | first-move entropy |
|
| 42 |
|---|---:|---:|
|
| 43 |
-
| `chorcat/rukh-medium
|
| 44 |
| with this adapter | 99.85 % | 0.0209 bits |
|
| 45 |
|
| 46 |
And what the style cost, on the same suite every other stage of the project is measured with --
|
| 47 |
same validation positions, same puzzles, same seed:
|
| 48 |
|
| 49 |
-
| | `chorcat/rukh-medium
|
| 50 |
|---|---:|---:|
|
| 51 |
| Legality without the mask, argmax | 99.8 % | 99.8 % |
|
| 52 |
| Top-1 next move | 54.4 % | 54.7 % |
|
|
@@ -79,12 +79,20 @@ ordinary `MoveDecoder`: same module names, same state dict, exportable to ONNX l
|
|
| 79 |
order they run, with the `alpha/r` scaling already applied. `web/adapter.json` carries the shapes,
|
| 80 |
because a buffer of floats says nothing about itself.
|
| 81 |
|
| 82 |
-
It is meant for the ONNX export of `chorcat/rukh-medium
|
| 83 |
graph** (`lora_a` and `lora_b`) rather than baked into the weights. Fed an adapter of zeros that
|
| 84 |
file is the base model exactly; fed this one it is this style. So the demo changes style by
|
| 85 |
downloading 1.6 MB instead of a second copy of the model, which is
|
| 86 |
the only reason a low-rank correction is worth keeping low-rank once it leaves the training loop.
|
| 87 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 88 |
## Licence
|
| 89 |
|
| 90 |
apache-2.0, the same as the base model.
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
library_name: rukh
|
| 4 |
+
base_model: chorcat/rukh-medium
|
| 5 |
tags:
|
| 6 |
- chess
|
| 7 |
- rukh
|
|
|
|
| 11 |
|
| 12 |
# chorcat/rukh-lora-e4
|
| 13 |
|
| 14 |
+
A LoRA adapter for [`chorcat/rukh-medium`](https://huggingface.co/chorcat/rukh-medium). On its own it does
|
| 15 |
nothing: it is 393,216 numbers (1.6 MB) that
|
| 16 |
correct that model's weights, and without them there is no model to correct.
|
| 17 |
|
|
|
|
| 40 |
|
| 41 |
| | P(`e2e4`) | first-move entropy |
|
| 42 |
|---|---:|---:|
|
| 43 |
+
| `chorcat/rukh-medium` | 59.64 % | 1.7695 bits |
|
| 44 |
| with this adapter | 99.85 % | 0.0209 bits |
|
| 45 |
|
| 46 |
And what the style cost, on the same suite every other stage of the project is measured with --
|
| 47 |
same validation positions, same puzzles, same seed:
|
| 48 |
|
| 49 |
+
| | `chorcat/rukh-medium` | with this adapter |
|
| 50 |
|---|---:|---:|
|
| 51 |
| Legality without the mask, argmax | 99.8 % | 99.8 % |
|
| 52 |
| Top-1 next move | 54.4 % | 54.7 % |
|
|
|
|
| 79 |
order they run, with the `alpha/r` scaling already applied. `web/adapter.json` carries the shapes,
|
| 80 |
because a buffer of floats says nothing about itself.
|
| 81 |
|
| 82 |
+
It is meant for the ONNX export of `chorcat/rukh-medium` that takes its LoRA factors as **inputs of the
|
| 83 |
graph** (`lora_a` and `lora_b`) rather than baked into the weights. Fed an adapter of zeros that
|
| 84 |
file is the base model exactly; fed this one it is this style. So the demo changes style by
|
| 85 |
downloading 1.6 MB instead of a second copy of the model, which is
|
| 86 |
the only reason a low-rank correction is worth keeping low-rank once it leaves the training loop.
|
| 87 |
|
| 88 |
+
## In the course
|
| 89 |
+
|
| 90 |
+
- Built in [M4 · Fine-tuning: los labs](https://lab.rukh.borjaglez.com/curso/m4/03-labs-de-afinado/), the lesson that runs every command behind this repository.
|
| 91 |
+
- Measured in the [single results table](https://lab.rukh.borjaglez.com/proyecto/) as the stage `lora-e4`: every stage of the course, the same suite, the same day.
|
| 92 |
+
- Bring it to the paths the configs read: `uv run rukh pull lora-e4`.
|
| 93 |
+
|
| 94 |
+
|
| 95 |
+
|
| 96 |
## Licence
|
| 97 |
|
| 98 |
apache-2.0, the same as the base model.
|