Rohit-2002 commited on
Commit
b4c73ed
·
verified ·
1 Parent(s): 35a324f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -10
README.md CHANGED
@@ -1,7 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  # Nexora-1
2
 
3
- Nexora-1 is a GPT-style generative language model built from scratch
4
- using PyTorch.
5
 
6
  ## Model Architecture
7
 
@@ -14,22 +26,25 @@ using PyTorch.
14
  - Tokenization: Character-level
15
  - Vocabulary Size: 2,100
16
 
17
- ## Training
18
 
19
  - Dataset: English Wikipedia
20
  - Articles: 4,742
21
  - Training tokens: 62,947,221
22
  - Validation tokens: 6,994,136
23
 
24
- ## Training Objective
25
 
26
- Nexora-1 is trained for autoregressive next-character prediction.
27
 
28
- ## Generation
29
 
30
- The model generates text using autoregressive sampling
31
- with temperature control.
32
 
33
- ## Framework
 
 
 
 
34
 
35
- PyTorch
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ tags:
6
+ - generative-ai
7
+ - text-generation
8
+ - transformer
9
+ - pytorch
10
+ - gpt
11
+ library_name: pytorch
12
+ ---
13
+
14
  # Nexora-1
15
 
16
+ Nexora-1 is a GPT-style generative language model built from scratch using PyTorch.
 
17
 
18
  ## Model Architecture
19
 
 
26
  - Tokenization: Character-level
27
  - Vocabulary Size: 2,100
28
 
29
+ ## Training Dataset
30
 
31
  - Dataset: English Wikipedia
32
  - Articles: 4,742
33
  - Training tokens: 62,947,221
34
  - Validation tokens: 6,994,136
35
 
36
+ ## Training
37
 
38
+ Nexora-1 was trained using autoregressive next-character prediction.
39
 
40
+ ## Framework
41
 
42
+ PyTorch
 
43
 
44
+ ## Model Usage
45
+
46
+ The model can be loaded and used for text generation with the appropriate Nexora-1 model architecture and tokenizer configuration.
47
+
48
+ ## Limitations
49
 
50
+ Nexora-1 is a small, character-level language model trained on Wikipedia text. It is primarily designed for experimentation and learning and is not an instruction-tuned conversational model.