Card: link the GitHub code
Browse files
README.md
CHANGED
|
@@ -30,6 +30,9 @@ Two models in this repo:
|
|
| 30 |
Modal; the first visit after a quiet spell takes ~30 s to start). The "Base vs Chat" tab sends the same prompt to both
|
| 31 |
models.
|
| 32 |
|
|
|
|
|
|
|
|
|
|
| 33 |
| Model | HellaSwag (acc_norm) |
|
| 34 |
|---|---|
|
| 35 |
| OpenAI GPT-2 124M | 29.55% |
|
|
|
|
| 30 |
Modal; the first visit after a quiet spell takes ~30 s to start). The "Base vs Chat" tab sends the same prompt to both
|
| 31 |
models.
|
| 32 |
|
| 33 |
+
**Code:** [github.com/adarsh070502/firstlight](https://github.com/adarsh070502/firstlight) (pretraining, SFT, evals,
|
| 34 |
+
release and demo).
|
| 35 |
+
|
| 36 |
| Model | HellaSwag (acc_norm) |
|
| 37 |
|---|---|
|
| 38 |
| OpenAI GPT-2 124M | 29.55% |
|