Sigmandndnns commited on
Commit
9f7e7c9
·
verified ·
1 Parent(s): 59bc1d5

Org card in the corx-labs.com style; five technical reports

Browse files
.gitattributes CHANGED
@@ -34,3 +34,14 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  banner.png filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  banner.png filter=lfs diff=lfs merge=lfs -text
37
+ banner-site.png filter=lfs diff=lfs merge=lfs -text
38
+ papers/corx1.5-technical-report.pdf filter=lfs diff=lfs merge=lfs -text
39
+ papers/corx1.5-technical-report.png filter=lfs diff=lfs merge=lfs -text
40
+ papers/corx3.8-27b-model-report.pdf filter=lfs diff=lfs merge=lfs -text
41
+ papers/corx3.8-27b-model-report.png filter=lfs diff=lfs merge=lfs -text
42
+ papers/helix-technical-report.pdf filter=lfs diff=lfs merge=lfs -text
43
+ papers/helix-technical-report.png filter=lfs diff=lfs merge=lfs -text
44
+ papers/naturev1-hurricane-physics-report.pdf filter=lfs diff=lfs merge=lfs -text
45
+ papers/naturev1-hurricane-physics-report.png filter=lfs diff=lfs merge=lfs -text
46
+ papers/tristream-svs-technical-report.pdf filter=lfs diff=lfs merge=lfs -text
47
+ papers/tristream-svs-technical-report.png filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -5,61 +5,76 @@ colorFrom: green
5
  colorTo: yellow
6
  sdk: static
7
  pinned: false
8
- short_description: AI models built from the ground up, in Jamaica.
9
  ---
10
 
11
- <img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/banner.png" alt="Corx Labs: AI models built from the ground up, in Jamaica" width="100%">
12
-
13
- **Corx Labs** is an independent AI lab in Westmoreland, Jamaica. We design, train and verify our own models end to
14
- end: architecture, tokenizer, training pipeline and evaluation, most of it on a single GPU.
15
-
16
- ## 🗂️ Collections
17
-
18
- | | Collection | Inside |
19
- |:-:|---|---|
20
- | 💬 | [**Text Models**](https://huggingface.co/collections/CorxLabs/text-models-6ad400811d7073d767ebe7f1) | CorX language models, from 160M to 27B parameters, Jamaican Patois and English |
21
- | 🎤 | [**SVS Models**](https://huggingface.co/collections/CorxLabs/svs-models-6ad40082a6e143550bd7aaa6) | Singing-voice synthesis built on how a voice is physically made |
22
- | 🌀 | [**Weather Models**](https://huggingface.co/collections/CorxLabs/weather-models-6ad40082a150e48c970f176a) | Global weather and hurricane forecasting, scored on seasons it never trained on |
23
-
24
- ## 💬 Text
25
-
26
- - [**CorX3.8-27B**](https://huggingface.co/Sigmandndnns/CorX3.8-27B): a 27B conversational model that speaks
27
- Jamaican Patois by default and switches to English when you do. Fully merged; load it and go.
28
- - [**CorX1.5-160M**](https://huggingface.co/Sigmandndnns/CorX1.5-160M): a ~158M-parameter language model whose
29
- architecture, tokenizer, pretraining and fine-tuning were all written and trained from scratch on one GPU.
30
- ([v2 run](https://huggingface.co/Sigmandndnns/CorX1.5-160M-v2))
31
-
32
- ## 🎤 Singing voice
33
-
34
- - [**TriStream-SVS-300M**](https://huggingface.co/Sigmandndnns/TriStream-SVS-300M): models a singing voice the
35
- way the body makes it, as three streams: the **glottal source** (pitch), the **vocal-tract filter** (who is
36
- singing, and which vowel) and **turbulent noise** (breath and fricatives).
37
-
38
- ## 🌀 Weather and hurricanes
39
-
40
- - [**NatureV1**](https://huggingface.co/Sigmandndnns/NatureV1-500): an 89M-parameter model of the atmosphere on
41
- [iHELIX](https://pypi.org/project/ihelix/), an attention engine that works on the sphere rather than a flat grid.
42
- It forecasts global weather to five days and, for tropical cyclones, track, intensity, rapid intensification and
43
- landfall, each with an uncertainty.
44
- - Its hurricane physics, with **no neural network**, beats straight-line extrapolation and CLIPER at every lead
45
- from 6 to 120 hours on 4,447 forecasts of 407 storms in seasons it was never fitted on (2018, 2020-2022):
46
-
47
- | Track error (km) | 24 h | 48 h | 72 h | 120 h |
48
- |---|:-:|:-:|:-:|:-:|
49
- | Extrapolation | 179 | 442 | 751 | 1,417 |
50
- | CLIPER | 163 | 378 | 589 | 914 |
51
- | **NatureV1 physics** | **127** | **301** | **515** | **884** |
52
-
53
- Global AI models such as GraphCast and Pangu-Weather are still far better beyond 12 hours. Distilling them into
54
- NatureV1 is the next step, and every number on the model card says what it was measured on.
55
-
56
- ```bash
57
- pip install naturev1 ihelix
58
- ```
59
-
60
- ## 🔗 Links
61
-
62
- [Website](https://www.corx-labs.com/) · [Developers](https://www.corx-labs.com/developers/) ·
63
- [naturev1 on PyPI](https://pypi.org/project/naturev1/) · [ihelix on PyPI](https://pypi.org/project/ihelix/)
64
-
65
- <p align="center"><sub>Built in Jamaica 🇯🇲</sub></p>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  colorTo: yellow
6
  sdk: static
7
  pinned: false
8
+ short_description: Jamaica's independent AI research lab.
9
  ---
10
 
11
+ <img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/banner-site.png" alt="CorX Labs. Architecting the future, from the ground up." width="100%">
12
+
13
+ **CorX Labs is Jamaica's independent AI research lab.** We build Jamaican AI from the ground up: five open models so
14
+ far, from CorX3.8, a 27-billion-parameter Jamaican Patois assistant, to NatureV1, a weather and hurricane model. Most
15
+ were trained from random weights on a single GPU, and where one is a fine-tune, we say so.
16
+
17
+ | Models built | Released with weights | Technical reports | Licence |
18
+ |:-:|:-:|:-:|:-:|
19
+ | **5** | **4** | **5** | **Apache-2.0** |
20
+
21
+ <img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/rule.png" width="100%" height="4" alt="">
22
+
23
+ ### Models
24
+
25
+ | Model | What it is | Size | Built from | Report |
26
+ |---|---|:-:|---|:-:|
27
+ | [**CorX3.8-27B**](https://huggingface.co/CorxLabs/CorX3.8-27B) | Jamaican Patois conversational assistant. Patois by default, English on request. | 27B | Fine-tune of Qwen3.8-27B, fully merged | [03](https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/corx3.8-27b-model-report.pdf) |
28
+ | [**CorX1.5**](https://huggingface.co/CorxLabs/CorX1.5-160M) | Decoder-only language model with learned role embeddings | 157.8M | From scratch, tokenizer included | [01](https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/corx1.5-technical-report.pdf) |
29
+ | [**TriStream-SVS**](https://huggingface.co/CorxLabs/TriStream-SVS-300M) | Singing-voice synthesis: pitch, timbre and breath in three separate streams | 321.8M | From scratch | [02](https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/tristream-svs-technical-report.pdf) |
30
+ | [**NatureV1**](https://huggingface.co/CorxLabs/NatureV1-500) | Probabilistic weather and hurricane model, attention in kilometres on the sphere | 89.45M | From scratch, on the iHELIX engine | [05](https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/naturev1-hurricane-physics-report.pdf) |
31
+ | [**HELIX**](https://pypi.org/project/helix-lm/) | Linear-scaling sequence architecture that keeps exact long-range recall | configurable | From scratch; no trained checkpoints | [04](https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/helix-technical-report.pdf) |
32
+
33
+ Browse by collection: [Text](https://huggingface.co/collections/CorxLabs/text-models-6ad400811d7073d767ebe7f1) ·
34
+ [Singing voice](https://huggingface.co/collections/CorxLabs/svs-models-6ad40082a6e143550bd7aaa6) ·
35
+ [Weather](https://huggingface.co/collections/CorxLabs/weather-models-6ad40082a150e48c970f176a)
36
+
37
+ ### Papers
38
+
39
+ <table>
40
+ <tr>
41
+ <td align="center" width="20%"><a href="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/corx1.5-technical-report.pdf"><img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/corx1.5-technical-report.png" alt="CorX1.5 technical report"></a></td>
42
+ <td align="center" width="20%"><a href="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/tristream-svs-technical-report.pdf"><img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/tristream-svs-technical-report.png" alt="TriStream-SVS technical report"></a></td>
43
+ <td align="center" width="20%"><a href="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/corx3.8-27b-model-report.pdf"><img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/corx3.8-27b-model-report.png" alt="CorX3.8-27B model report"></a></td>
44
+ <td align="center" width="20%"><a href="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/helix-technical-report.pdf"><img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/helix-technical-report.png" alt="HELIX technical report"></a></td>
45
+ <td align="center" width="20%"><a href="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/naturev1-hurricane-physics-report.pdf"><img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/papers/naturev1-hurricane-physics-report.png" alt="NatureV1 hurricane physics report"></a></td>
46
+ </tr>
47
+ </table>
48
+
49
+ 1. **CorX1.5: a 158M-parameter language model trained from random weights on one GPU.** The architecture, the
50
+ three-stage training, and the memory arithmetic that fits three billion tokens through one card.
51
+ 2. **TriStream-SVS: building the source-filter model of the voice into a singing synthesiser.** Three streams that
52
+ cannot share information until a late fusion trunk, with zero-shot cloning and a 32-step flow-matching decoder.
53
+ 3. **CorX3.8-27B: giving an open 27B model a Jamaican voice.** What a rank-64 LoRA on 19 million tokens changed, and
54
+ what it did not.
55
+ 4. **HELIX: separating memory capacity from bandwidth in a linear-scaling sequence model.** N<sup>1.00</sup> attention
56
+ pairs, and recall that ties full attention while the same model without its index falls to chance.
57
+ 5. **Hurricane tracks without a neural network.** A physics consensus that beats extrapolation and CLIPER at every lead
58
+ on 4,447 forecasts from four seasons it never saw.
59
+
60
+ ### Measured, not promised
61
+
62
+ | Hurricane track error (km), 2018 and 2020-2022, all basins | 24 h | 48 h | 72 h | 120 h |
63
+ |---|:-:|:-:|:-:|:-:|
64
+ | Straight-line extrapolation (strongest per lead) | 179 | 442 | 751 | 1,417 |
65
+ | CLIPER | 163 | 378 | 589 | 914 |
66
+ | **NatureV1 hurricane physics, no neural network** | **127** | **301** | **515** | **884** |
67
+
68
+ Global AI models such as GraphCast and Pangu-Weather remain far better beyond 12 hours, and the report says so. The
69
+ same rule runs through every model here: results are measured on data the model never trained on, "trained from
70
+ scratch", "fine-tuned" and "not trained yet" are kept apart, and nothing is claimed that has not been measured.
71
+ TriStream-SVS, for example, has no listening tests yet, so it reports no quality scores.
72
+
73
+ <img src="https://huggingface.co/spaces/CorxLabs/README/resolve/main/rule.png" width="100%" height="4" alt="">
74
+
75
+ [corx-labs.com](https://www.corx-labs.com/) · [Chat with CorX3.8](https://www.corx-labs.com/chat/) ·
76
+ [Documentation](https://www.corx-labs.com/documentation/) · [Blog](https://www.corx-labs.com/blog/) ·
77
+ [Benchmarks](https://www.corx-labs.com/benchmarks/) · PyPI: [naturev1](https://pypi.org/project/naturev1/),
78
+ [ihelix](https://pypi.org/project/ihelix/), [helix-lm](https://pypi.org/project/helix-lm/)
79
+
80
+ <sub>CorX Labs · Westmoreland, Jamaica · Architecting the future, from the ground up.</sub>
banner.png → banner-site.png RENAMED
File without changes
papers/corx1.5-technical-report.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e30019df008f176e868908f13480df623e6eec614937a708cbdb2d3fc730c0e3
3
+ size 358600
papers/corx1.5-technical-report.png ADDED

Git LFS Details

  • SHA256: 642ead802cac5dfeaac0742f02bc18c5af1c6e45f727475af60ac5cd545cd310
  • Pointer size: 131 Bytes
  • Size of remote file: 270 kB
papers/corx3.8-27b-model-report.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4b05323ce91f11b0c74c0d68dfd38e0151c47064b5535902aecd1a0d5793190
3
+ size 325507
papers/corx3.8-27b-model-report.png ADDED

Git LFS Details

  • SHA256: 54dc66614cfa94e53bf81dfe9374fe7992ad85e7d0b07dac15d654a93c8f3c03
  • Pointer size: 131 Bytes
  • Size of remote file: 248 kB
papers/helix-technical-report.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31a72da7d7ffc2659e4b7fd9d029c4ca19417fb43cefda7a6c79c208f57a8fee
3
+ size 376184
papers/helix-technical-report.png ADDED

Git LFS Details

  • SHA256: 1901856a3decf77afac2e0ce91aa9107d8ac70b5c6f8357be3ab358f6a0150b0
  • Pointer size: 131 Bytes
  • Size of remote file: 323 kB
papers/naturev1-hurricane-physics-report.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cee46308d9b24233852c17cd66c76e4a6622eff264e2916187fa1cf54f6e858e
3
+ size 463506
papers/naturev1-hurricane-physics-report.png ADDED

Git LFS Details

  • SHA256: 612c13ae9fe19ba5b1c0ebbdb3cb8b430fb958f1696dbe8d15e77b7c4be16481
  • Pointer size: 131 Bytes
  • Size of remote file: 356 kB
papers/tristream-svs-technical-report.pdf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:28a902265692c3ef5339704da4babf234ac0c3bc6a4652a9a38a036e067e7427
3
+ size 374585
papers/tristream-svs-technical-report.png ADDED

Git LFS Details

  • SHA256: 535fb122822bfba15944229feaa348732c2fd9d10ebbf0908df9e34223cb9379
  • Pointer size: 131 Bytes
  • Size of remote file: 295 kB
rule.png ADDED