miceworks commited on
Commit
46daa34
·
verified ·
1 Parent(s): 19e8cee

docs: publish official Mark AI model card and benchmarks

Browse files
Files changed (1) hide show
  1. README.md +92 -1
README.md CHANGED
@@ -1,3 +1,94 @@
1
  ---
2
- license: agpl-3.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ language:
3
+ - en
4
+ - pt
5
+ license: apache-2.0
6
+ tags:
7
+ - mark-ai
8
+ - edge-kernel
9
+ - synthetic-microbenchmarks
10
+ - experimental
11
+ - non-conversational
12
+ - gguf
13
+ pipeline_tag: text-generation
14
  ---
15
+
16
+ # Mark Engineer 300M (302M) - Experimental Edge & Synthetic Testbed
17
+ ==============================================================================
18
+ Model Name: Mark Engineer 300M (302M Parameters)
19
+ Architecture: Multi-Head Latent Attention (MLA) + DeepSeekMoE (16 Routed + 1 Shared Expert)
20
+ Parameter Count: 302,019,848 Physical | ~110M Active per Token
21
+ Status: Experimental Edge Checkpoint / Synthetic Micro-Testbed
22
+ Target Hardware: Edge Devices, Embedded Linux, Low-Power Micro-Nodes (< 500 MB VRAM)
23
+
24
+ Strict Constraint: Zero emojis across all documentation and logs.
25
+
26
+ ---
27
+
28
+ ## Technical Disclaimer & Operational Limitations
29
+
30
+ ### Non-Conversational Architecture
31
+ Mark Engineer 300M does NOT possess conversational fluency or natural dialogue capabilities. It was not trained as an assistant and cannot maintain coherent multi-turn chit-chat or explain concepts in prose.
32
+
33
+ ### High Hallucination Probability in Free-Form Generation
34
+ Due to its ultralight parameter budget (302M physical parameters), open-ended generation, reasoning prompts, or conversational queries will produce disjointed output, repetitive loops, or severe factual hallucinations.
35
+
36
+ ### Purpose and Valid Use Cases
37
+ This checkpoint serves exclusively as:
38
+ 1. An experimental micro-testbed to validate the forward tensor graph of Multi-Head Latent Attention (MLA) and DeepSeekMoE routing on severely constrained hardware.
39
+ 2. A synthetic syntax validator for micro-kernel snippets and rigid template completion.
40
+ 3. Edge deployment benchmarking on low-power devices with under 500 MB RAM/VRAM.
41
+
42
+ If your task requires conversational tech lead dialogue, system architecture reasoning, multi-file code synthesis, or zero-hallucination analysis, use **Mark Engineer 1.5B** or **MarkVL-2.2B**.
43
+
44
+ ---
45
+
46
+ ## 1. Technical Specifications
47
+
48
+ | Property | Value |
49
+ | :--- | :--- |
50
+ | **Physical Parameter Count** | 302,019,848 (302M) |
51
+ | **Active FLOPs per Token** | ~110,000,000 (Top-2 Routed + 1 Shared Expert) |
52
+ | **Hidden Dimension ($d$)** | 1,024 |
53
+ | **Transformer Depth** | 12 Layers |
54
+ | **Attention Architecture** | Multi-Head Latent Attention (MLA, $c_{KV} = 256$) |
55
+ | **MoE Topology** | 16 Routed Experts + 1 Universal Shared Expert |
56
+ | **Quantization Format** | IQ4_NL (4-bit non-linear lookup) / Universal GGUF |
57
+ | **On-Disk Checkpoint Size** | 162.99 MB (GGUF: 225.21 MB) |
58
+ | **Runtime VRAM Footprint** | ~350 MB on NVIDIA GeForce RTX 2060 Super |
59
+ | **Context Length** | 4,096 Tokens |
60
+
61
+ ---
62
+
63
+ ## 2. Benchmark Results on Synthetic Test Suites
64
+
65
+ Mark Engineer 300M passes narrow, deterministic synthetic unit tests while failing free-form conversational evaluations:
66
+
67
+ - **Rigid C Macro & Ringbuffer Syntax Check:** PASS (10/10 template matches)
68
+ - **Assembly Register Allocation Synthetic Scan:** PASS (8/8 deterministic register constraints)
69
+ - **Natural Language Dialogue & Explanations:** FAIL (Severe lack of syntactic cohesion)
70
+ - **Multi-File Architectural Reasoning:** FAIL (High hallucination rate)
71
+
72
+ ---
73
+
74
+ ## 3. Plug-and-Play Quickstart (For Edge & Synthetic Testing)
75
+
76
+ ### 3.1 Ollama
77
+ ```bash
78
+ cd models/mark-engineer-302m
79
+ ollama create mark-engineer-302m -f Modelfile
80
+ ollama run mark-engineer-302m "/* C Ringbuffer */"
81
+ ```
82
+
83
+ ### 3.2 LM Studio
84
+ 1. Download `mark_engineer_302m_iq4_nl.gguf` from the official release:
85
+ ```bash
86
+ curl -L -O https://github.com/thu12dta3/Mark-AI/releases/download/v1.0.0-302m/mark_engineer_302m_iq4_nl.gguf
87
+ ```
88
+ 2. Move to `~/.lmstudio/models/Mark-AI/mark-engineer-302m/mark_engineer_302m.gguf`.
89
+ 3. Load the model. Allocate ~350 MB VRAM.
90
+
91
+ ### 3.3 Python CLI Downloader
92
+ ```bash
93
+ python scripts/download_model.py --model 302m
94
+ ```