Update dataset release paths
Browse files
README.md
CHANGED
|
@@ -31,10 +31,12 @@ Companion repos: [`risenyard/egms-qa-dataset`](https://huggingface.co/datasets/r
|
|
| 31 |
| `normalization.json` | mean / std / residual-std used to normalize the input series |
|
| 32 |
| `args.json` | training configuration that produced the checkpoint |
|
| 33 |
|
| 34 |
-
The precomputed **token cache** and the **
|
| 35 |
[`risenyard/egms-qa-dataset`](https://huggingface.co/datasets/risenyard/egms-qa-dataset)
|
| 36 |
-
(`
|
| 37 |
-
|
|
|
|
|
|
|
| 38 |
|
| 39 |
## Use
|
| 40 |
|
|
@@ -43,6 +45,10 @@ the `egms_encoder` model code from the GitHub repo and re-extract tokens:
|
|
| 43 |
|
| 44 |
```bash
|
| 45 |
hf download risenyard/egms-qa-encoder --local-dir data/encoder/checkpoint
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
python -m egms_encoder.extract_tokens \
|
| 48 |
--checkpoint data/encoder/checkpoint/encoder.pt \
|
|
|
|
| 31 |
| `normalization.json` | mean / std / residual-std used to normalize the input series |
|
| 32 |
| `args.json` | training configuration that produced the checkpoint |
|
| 33 |
|
| 34 |
+
The precomputed **token cache** and the **processed source tiles** live in the dataset repo
|
| 35 |
[`risenyard/egms-qa-dataset`](https://huggingface.co/datasets/risenyard/egms-qa-dataset)
|
| 36 |
+
(`artifacts/representations/`, `artifacts/source_tiles/`). The dataset release
|
| 37 |
+
installer links those publication paths to `data/encoder/tokens/` and
|
| 38 |
+
`data/tiles/`; the split manifest is in the code repo under
|
| 39 |
+
`data/encoder/manifest/`.
|
| 40 |
|
| 41 |
## Use
|
| 42 |
|
|
|
|
| 45 |
|
| 46 |
```bash
|
| 47 |
hf download risenyard/egms-qa-encoder --local-dir data/encoder/checkpoint
|
| 48 |
+
hf download risenyard/egms-qa-dataset \
|
| 49 |
+
--repo-type dataset --local-dir release/egms-qa-dataset
|
| 50 |
+
python -m egms_qa.release install \
|
| 51 |
+
--release-dir release/egms-qa-dataset --target-root .
|
| 52 |
|
| 53 |
python -m egms_encoder.extract_tokens \
|
| 54 |
--checkpoint data/encoder/checkpoint/encoder.pt \
|