Update README.md
Browse files
README.md
CHANGED
|
@@ -12,64 +12,42 @@ emoji: 馃實
|
|
| 12 |
|
| 13 |
# Universal Computing Research
|
| 14 |
|
| 15 |
-
|
| 16 |
|
| 17 |
-
We
|
| 18 |
|
| 19 |
-
|
| 20 |
|
| 21 |
-
|
| 22 |
|
| 23 |
-
|
| 24 |
|
| 25 |
-
|
| 26 |
|
| 27 |
-
-
|
| 28 |
-
- Parameter-efficient architectures
|
| 29 |
-
- Random projection layers
|
| 30 |
-
- Custom tokenization pipelines
|
| 31 |
-
- Arithmetic and algorithmic reasoning
|
| 32 |
|
| 33 |
-
|
| 34 |
|
| 35 |
-
###
|
| 36 |
|
| 37 |
-
|
| 38 |
|
| 39 |
-
|
| 40 |
-
- RoPE positional embeddings
|
| 41 |
-
- RMSNorm
|
| 42 |
-
- Gated SiLU feed-forward layers
|
| 43 |
-
- Custom 4,096-token byte-level BPE tokenizer
|
| 44 |
-
- Approximately 5B training tokens
|
| 45 |
|
| 46 |
-
[View Atom3.4m](https://huggingface.co/UniversalComputingResearch/Atom3.4m)
|
| 47 |
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
A 2.74M parameter causal language model with an arithmetic-aware tokenizer and digit-structure features.
|
| 51 |
-
|
| 52 |
-
- Custom byte-level BPE tokenizer
|
| 53 |
-
- Atomic digit and operator handling
|
| 54 |
-
- Least-significant-digit-first numeric representation
|
| 55 |
-
- Place and role embeddings for integer arithmetic
|
| 56 |
-
- Strong ArithMark-2.0 performance for its size
|
| 57 |
-
|
| 58 |
-
[View Atom2.7m](https://huggingface.co/UniversalComputingResearch/Atom2.7m)
|
| 59 |
|
| 60 |
## Research
|
| 61 |
|
| 62 |
### Parametrized Random Projection
|
| 63 |
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
The core idea is to separate fixed feature mixing from learnable adaptation: a non-trainable random projection performs the mixing, while small learnable element-wise parameters modulate the input and output.
|
| 67 |
-
|
| 68 |
-
This reduces trainable parameter count from quadratic to linear scale while preserving much of the utility of dense projections.
|
| 69 |
|
| 70 |
[Read the paper](https://arxiv.org/abs/2512.13480)
|
| 71 |
|
| 72 |
-
|
| 73 |
|
| 74 |
-
|
| 75 |
|
|
|
|
|
|
| 12 |
|
| 13 |
# Universal Computing Research
|
| 14 |
|
| 15 |
+
Universal Computing Research is an independent research organization focused on compact language models, efficient architectures, tokenization, and training methods that improve capability under limited compute and parameter budgets.
|
| 16 |
|
| 17 |
+
We release models, code, and experiments for open and reproducible research.
|
| 18 |
|
| 19 |
+
---
|
| 20 |
|
| 21 |
+
## Model families
|
| 22 |
|
| 23 |
+
### Limen
|
| 24 |
|
| 25 |
+
Limen is our family of small general-purpose language models.
|
| 26 |
|
| 27 |
+
The first release, **Limen0.2B**, is a 222.5M-parameter base model trained from scratch on 50B tokens. It uses a BoundlessBPE tokenizer that can learn tokens spanning whitespace, along with grouped-query attention and an experimental XSA projection.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
+
[View the Limen model](https://huggingface.co/UniversalComputingResearch/Limen0.2B)
|
| 30 |
|
| 31 |
+
### Atom
|
| 32 |
|
| 33 |
+
Atom is our family of extremely small experimental language models.
|
| 34 |
|
| 35 |
+
These models are used to study compact transformer architectures, custom tokenizers, arithmetic representations, and training curricula at parameter counts below four million.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 36 |
|
| 37 |
+
[View Atom3.4m](https://huggingface.co/UniversalComputingResearch/Atom3.4m) 路 [View Atom2.7m](https://huggingface.co/UniversalComputingResearch/Atom2.7m)
|
| 38 |
|
| 39 |
+
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 40 |
|
| 41 |
## Research
|
| 42 |
|
| 43 |
### Parametrized Random Projection
|
| 44 |
|
| 45 |
+
Parametrized Random Projection replaces dense learned projections with fixed random feature mixing and small learned input and output parameters. The goal is to reduce trainable parameter growth from quadratic to linear while retaining useful projection capacity.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 46 |
|
| 47 |
[Read the paper](https://arxiv.org/abs/2512.13480)
|
| 48 |
|
| 49 |
+
---
|
| 50 |
|
| 51 |
+
## Open source
|
| 52 |
|
| 53 |
+
Our models, code, and research artifacts are released for reproducible and practical research.
|