appvoid commited on
Commit
654458c
·
verified ·
1 Parent(s): dc8712a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -31
README.md CHANGED
@@ -9,34 +9,4 @@ pinned: true
9
  thumbnail: >-
10
  https://cdn-uploads.huggingface.co/production/uploads/62a813dedbb9e28866a91b27/RKXubA9_IH4dUIn77Owxf.png
11
  license: apache-2.0
12
- ---
13
-
14
- # D●t Labs
15
-
16
- **Researching intelligence from the byte up.**
17
-
18
- Dot Labs is an independent AI research organization focused on **multimodal, byte-level intelligence**.
19
-
20
- We explore what happens when models operate closer to raw information, reducing reliance on modality-specific tokenization and hand-designed representations. Our research investigates architectures and training methods capable of learning directly from low-level sequences across text and other modalities.
21
-
22
- ## Research
23
-
24
- Our work currently centers around:
25
-
26
- * **Byte-level modeling:** Learning directly from bytes rather than conventional text tokenization.
27
- * **Multimodal intelligence:** Developing representations and architectures that can generalize across different forms of information.
28
- * **Small language models:** Studying how much capability can emerge from compact, compute-efficient systems.
29
- * **Efficient architectures:** Exploring recurrence, parameter sharing, adaptive computation, and alternatives to simply scaling model size.
30
- * **Representation learning:** Investigating how models can discover useful structure with fewer assumptions about how their inputs should be encoded.
31
-
32
- ## Where we're headed
33
-
34
- We believe increasingly general models may emerge not only from making systems larger, but from making their foundations **simpler and more universal**.
35
-
36
- Our long-term direction is toward models that can consume heterogeneous information through a shared low-level interface, learn useful internal representations on their own, and allocate computation intelligently.
37
-
38
- Instead of building a different foundation for every modality, we're interested in a more fundamental question:
39
-
40
- > **How little structure can we impose while still allowing intelligence to emerge?**
41
-
42
- We're starting with bytes.
 
9
  thumbnail: >-
10
  https://cdn-uploads.huggingface.co/production/uploads/62a813dedbb9e28866a91b27/RKXubA9_IH4dUIn77Owxf.png
11
  license: apache-2.0
12
+ ---