ucr-max commited on
Commit
fd28731
verified
1 Parent(s): d74dcde

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -39
README.md CHANGED
@@ -12,64 +12,42 @@ emoji: 馃實
12
 
13
  # Universal Computing Research
14
 
15
- **Universal Computing Research** is an independent AI research organization focused on efficient, compact, and architecture-driven deep learning.
16
 
17
- We build small language models, parameter-efficient neural layers, custom tokenizers, and research artifacts that test how far useful intelligence can be pushed under strict compute, memory, and parameter budgets.
18
 
19
- ## Research direction
20
 
21
- Our work is centered on a simple question:
22
 
23
- > How much capability can be recovered through better architecture, tokenization, data curricula, and parameterization, without relying only on scale?
24
 
25
- Current focus areas:
26
 
27
- - Small language models
28
- - Parameter-efficient architectures
29
- - Random projection layers
30
- - Custom tokenization pipelines
31
- - Arithmetic and algorithmic reasoning
32
 
33
- ## Released models
34
 
35
- ### Atom3.4m
36
 
37
- A 3.41M parameter decoder-only language model trained from scratch for studying compact architectures, curricula, and small-model benchmarking.
38
 
39
- - Grouped-query attention
40
- - RoPE positional embeddings
41
- - RMSNorm
42
- - Gated SiLU feed-forward layers
43
- - Custom 4,096-token byte-level BPE tokenizer
44
- - Approximately 5B training tokens
45
 
46
- [View Atom3.4m](https://huggingface.co/UniversalComputingResearch/Atom3.4m)
47
 
48
- ### Atom2.7m
49
-
50
- A 2.74M parameter causal language model with an arithmetic-aware tokenizer and digit-structure features.
51
-
52
- - Custom byte-level BPE tokenizer
53
- - Atomic digit and operator handling
54
- - Least-significant-digit-first numeric representation
55
- - Place and role embeddings for integer arithmetic
56
- - Strong ArithMark-2.0 performance for its size
57
-
58
- [View Atom2.7m](https://huggingface.co/UniversalComputingResearch/Atom2.7m)
59
 
60
  ## Research
61
 
62
  ### Parametrized Random Projection
63
 
64
- We study **Parametrized Random Projection** layers as lightweight replacements for dense linear layers.
65
-
66
- The core idea is to separate fixed feature mixing from learnable adaptation: a non-trainable random projection performs the mixing, while small learnable element-wise parameters modulate the input and output.
67
-
68
- This reduces trainable parameter count from quadratic to linear scale while preserving much of the utility of dense projections.
69
 
70
  [Read the paper](https://arxiv.org/abs/2512.13480)
71
 
72
- ## Open source
73
 
74
- Our models and research artifacts are released to support reproducible, open, and practical AI research.
75
 
 
 
12
 
13
  # Universal Computing Research
14
 
15
+ Universal Computing Research is an independent research organization focused on compact language models, efficient architectures, tokenization, and training methods that improve capability under limited compute and parameter budgets.
16
 
17
+ We release models, code, and experiments for open and reproducible research.
18
 
19
+ ---
20
 
21
+ ## Model families
22
 
23
+ ### Limen
24
 
25
+ Limen is our family of small general-purpose language models.
26
 
27
+ The first release, **Limen0.2B**, is a 222.5M-parameter base model trained from scratch on 50B tokens. It uses a BoundlessBPE tokenizer that can learn tokens spanning whitespace, along with grouped-query attention and an experimental XSA projection.
 
 
 
 
28
 
29
+ [View the Limen model](https://huggingface.co/UniversalComputingResearch/Limen0.2B)
30
 
31
+ ### Atom
32
 
33
+ Atom is our family of extremely small experimental language models.
34
 
35
+ These models are used to study compact transformer architectures, custom tokenizers, arithmetic representations, and training curricula at parameter counts below four million.
 
 
 
 
 
36
 
37
+ [View Atom3.4m](https://huggingface.co/UniversalComputingResearch/Atom3.4m) 路 [View Atom2.7m](https://huggingface.co/UniversalComputingResearch/Atom2.7m)
38
 
39
+ ---
 
 
 
 
 
 
 
 
 
 
40
 
41
  ## Research
42
 
43
  ### Parametrized Random Projection
44
 
45
+ Parametrized Random Projection replaces dense learned projections with fixed random feature mixing and small learned input and output parameters. The goal is to reduce trainable parameter growth from quadratic to linear while retaining useful projection capacity.
 
 
 
 
46
 
47
  [Read the paper](https://arxiv.org/abs/2512.13480)
48
 
49
+ ---
50
 
51
+ ## Open source
52
 
53
+ Our models, code, and research artifacts are released for reproducible and practical research.