Upload folder using huggingface_hub
Browse files- README.md +18 -2
- class_prior.npz +3 -0
- logistic.npz +3 -0
- regularized-s1.safetensors +3 -0
- regularized-s2.safetensors +3 -0
- sensitivity-s0.safetensors +3 -0
- sensitivity-s1.safetensors +3 -0
- sensitivity-s2.safetensors +3 -0
- shuffled_labels-s0.safetensors +3 -0
- shuffled_labels-s1.safetensors +3 -0
- shuffled_labels-s2.safetensors +3 -0
- unregularized-s0.safetensors +3 -0
- unregularized-s1.safetensors +3 -0
- unregularized-s2.safetensors +3 -0
README.md
CHANGED
|
@@ -9,9 +9,23 @@ Experimental checkpoints. Input definitions, preprocessing and usage limitations
|
|
| 9 |
|
| 10 |
| Experiment | Method | Seed | Split | Accuracy | Seconds | Device |
|
| 11 |
|---|---|---:|---|---:|---:|---|
|
|
|
|
|
|
|
| 12 |
| pilot_regularized_s0 | regularized | 0 | validation | 0.966574 | 6.083 | cuda |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
-
The
|
| 15 |
|
| 16 |
- **analysis_kind**: "exploratory"
|
| 17 |
- **prior_results_known**: true
|
|
@@ -45,4 +59,6 @@ The registered primary comparison is pending; no confirmatory conclusion is avai
|
|
| 45 |
- [src-prior-haiku: eureka-digits-haiku prior supplied-fixture execution](https://github.com/BurnyCoder/eureka-digits-haiku)
|
| 46 |
- [src-prior-luna: eureka-digits-luna prior supplied-fixture execution](https://github.com/BurnyCoder/eureka-digits-luna)
|
| 47 |
- [src-haiku-disclosure: Haiku historical cutoff and subsequent publication disclosure](https://github.com/BurnyCoder/eureka-digits-haiku/blob/main/reports/post-run-publication.md)
|
| 48 |
-
- [src-luna-disclosure: Luna post-publication provenance audit disclosure](https://github.com/BurnyCoder/eureka-digits-luna/blob/main/reports/post-run-publication.md)
|
|
|
|
|
|
|
|
|
| 9 |
|
| 10 |
| Experiment | Method | Seed | Split | Accuracy | Seconds | Device |
|
| 11 |
|---|---|---:|---|---:|---:|---|
|
| 12 |
+
| class_prior_s0 | class_prior | 0 | test | 0.102778 | 0.027 | cpu |
|
| 13 |
+
| logistic_s0 | logistic | 0 | test | 0.955556 | 0.109 | cpu |
|
| 14 |
| pilot_regularized_s0 | regularized | 0 | validation | 0.966574 | 6.083 | cuda |
|
| 15 |
+
| regularized_s0 | regularized | 0 | test | 0.963889 | 0.373 | cuda |
|
| 16 |
+
| regularized_s1 | regularized | 1 | test | 0.969444 | 5.740 | cuda |
|
| 17 |
+
| regularized_s2 | regularized | 2 | test | 0.969444 | 2.151 | cuda |
|
| 18 |
+
| sensitivity_s0 | sensitivity | 0 | test | 0.963889 | 2.098 | cuda |
|
| 19 |
+
| sensitivity_s1 | sensitivity | 1 | test | 0.969444 | 2.105 | cuda |
|
| 20 |
+
| sensitivity_s2 | sensitivity | 2 | test | 0.969444 | 2.121 | cuda |
|
| 21 |
+
| shuffled_labels_s0 | shuffled_labels | 0 | test | 0.061111 | 2.190 | cuda |
|
| 22 |
+
| shuffled_labels_s1 | shuffled_labels | 1 | test | 0.116667 | 2.194 | cuda |
|
| 23 |
+
| shuffled_labels_s2 | shuffled_labels | 2 | test | 0.108333 | 2.103 | cuda |
|
| 24 |
+
| unregularized_s0 | unregularized | 0 | test | 0.963889 | 2.032 | cuda |
|
| 25 |
+
| unregularized_s1 | unregularized | 1 | test | 0.969444 | 2.142 | cuda |
|
| 26 |
+
| unregularized_s2 | unregularized | 2 | test | 0.969444 | 2.203 | cuda |
|
| 27 |
|
| 28 |
+
The mean paired accuracy difference is 0.000000, with conditional 95% bootstrap interval [0.000000, 0.000000]. The registered decision is **inconclusive**. The sample standard deviation across seed effects is 0.000000. The interval uses 10000 paired resamples of test examples and conditions on the trained models.
|
| 29 |
|
| 30 |
- **analysis_kind**: "exploratory"
|
| 31 |
- **prior_results_known**: true
|
|
|
|
| 59 |
- [src-prior-haiku: eureka-digits-haiku prior supplied-fixture execution](https://github.com/BurnyCoder/eureka-digits-haiku)
|
| 60 |
- [src-prior-luna: eureka-digits-luna prior supplied-fixture execution](https://github.com/BurnyCoder/eureka-digits-luna)
|
| 61 |
- [src-haiku-disclosure: Haiku historical cutoff and subsequent publication disclosure](https://github.com/BurnyCoder/eureka-digits-haiku/blob/main/reports/post-run-publication.md)
|
| 62 |
+
- [src-luna-disclosure: Luna post-publication provenance audit disclosure](https://github.com/BurnyCoder/eureka-digits-luna/blob/main/reports/post-run-publication.md)
|
| 63 |
+
- [src-pandoc: Pandoc User Guide: PDF creation, Markdown extensions and resource paths](https://pandoc.org/MANUAL.html)
|
| 64 |
+
- [src-node-vm: Node.js vm API](https://nodejs.org/api/vm.html)
|
class_prior.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:69a03e6a16427f3f361001066d0aef20c645f1109ce51a744e8319065edda79a
|
| 3 |
+
size 686
|
logistic.npz
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5f6f6257d4ecbc4b66f80fdc6c90bdf032a2f35a008cd2ba395db6af5d5b6c27
|
| 3 |
+
size 3438
|
regularized-s1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6d6004f99a91584a2ffbedc1747cf80919909f5010133568624a035d8fe6ac95
|
| 3 |
+
size 38728
|
regularized-s2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:973a19ffaad8399256d974e76d6eb0ebd42f9f6a926c6fa089799968ef458537
|
| 3 |
+
size 38728
|
sensitivity-s0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d12e34e4c990874be8603a5d0ac6cb06f5648db4245afaed83ab7182cb94e220
|
| 3 |
+
size 38728
|
sensitivity-s1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:3c5ae5b269a45bd5c74baf47384f13a469d5475e88be331db1510202ff14d930
|
| 3 |
+
size 38728
|
sensitivity-s2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:86900e93b81224dd2bcf1413be63694a0488d16bfe7d25b1bd3e631c36bd90d3
|
| 3 |
+
size 38728
|
shuffled_labels-s0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:66f8ea92d43937a7e09f420751597b3c60c560aa35ecc27aea45b21a287223dc
|
| 3 |
+
size 38728
|
shuffled_labels-s1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:960a5428d49a66052acb46f8238b37f059ef37d868b7fcc082631feab864dee7
|
| 3 |
+
size 38728
|
shuffled_labels-s2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:cea6d947279edfed5d90d9a1df01c0c034f06341a0435366d4b63924d4f04b66
|
| 3 |
+
size 38728
|
unregularized-s0.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6e09e36eb29b0f2e691039f76708d6306dc3483e82726d6ac9f5cdf971d009f2
|
| 3 |
+
size 38728
|
unregularized-s1.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:865d50b44158576353bbeb744304210c29ed5642e3b9b6f4235b9e2f48395b77
|
| 3 |
+
size 38728
|
unregularized-s2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:227cf9c01e4e3da3838bb3be23cea540ca1e2d4b69ebebbabc637e5ed7f3e7fe
|
| 3 |
+
size 38728
|