FoundationML commited on
Commit
ece4eac
·
verified ·
1 Parent(s): 400cb2b

Upload folder using huggingface_hub

Browse files
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ 77AA7400-3BA2-4856-ACEA-940766CB7BDC.PNG filter=lfs diff=lfs merge=lfs -text
37
+ C13CE61B-75EE-4901-84CF-B10FED205645.PNG filter=lfs diff=lfs merge=lfs -text
38
+ foundationfolio.JPG filter=lfs diff=lfs merge=lfs -text
39
+ folio.png filter=lfs diff=lfs merge=lfs -text
40
+ foliodesign.png filter=lfs diff=lfs merge=lfs -text
41
+ Folio1.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ video.MP4 filter=lfs diff=lfs merge=lfs -text
77AA7400-3BA2-4856-ACEA-940766CB7BDC.PNG ADDED

Git LFS Details

  • SHA256: 6e86489f7ff7ce05cdc9ef6d2b5a966f4994d05756cf0ba9aa12747f41e72238
  • Pointer size: 131 Bytes
  • Size of remote file: 859 kB
C13CE61B-75EE-4901-84CF-B10FED205645.PNG ADDED

Git LFS Details

  • SHA256: 8937957602d893e6fcc537b2373591746cacb926ea241accbde5f659dc4cf0d0
  • Pointer size: 131 Bytes
  • Size of remote file: 919 kB
Folio1.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6b237431719760cc2f27610d140c4abfc15ccf83756b39ef317213b1e19c545e
3
+ size 986048768
README.md ADDED
@@ -0,0 +1,145 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - Coding
4
+ - Developmental
5
+ - Multimodal
6
+ - GGUF
7
+ - Q_4_KM
8
+ - Foundation
9
+ license: apache-2.0
10
+ language:
11
+ - en
12
+ base_model:
13
+ - Qwen/Qwen2.5-Coder-1.5B
14
+ pipeline_tag: image-text-to-text
15
+ ---
16
+
17
+
18
+ ![Folio-1](folio.png)
19
+
20
+
21
+ ![Status](https://img.shields.io/badge/status-multimodal-blue) ![Params](https://img.shields.io/badge/parameters-1.5b-blue) ![Status](https://img.shields.io/badge/company-Foundation-black)
22
+
23
+
24
+ # Introducing the first coding model (1.5B), in joint development between *Foundation* and *AeroAI*
25
+ **Trained on Foundation's *Forge* on MLX**
26
+
27
+ **Available in Q4_K_M GGUF**
28
+
29
+
30
+ <video controls autoplay muted loop playsinline width="720">
31
+ <source src="https://huggingface.co/AeroAIAviation/Folio-1/resolve/main/video.MP4" type="video/mp4">
32
+ </video>
33
+
34
+
35
+
36
+ ## Intended Use
37
+
38
+ - Coding and developmental work.
39
+
40
+
41
+ ## Limitations and Safety
42
+
43
+ > **Not for commercial and/or operational use.** Foundation's ***Folio-1*** is experimental and may produce incorrect, outdated, or fabricated answers.
44
+
45
+ - Do **not** use it for commerical or cyber work.
46
+ - Small models may hallucinate, particularly on numeric and regulatory detail.
47
+
48
+
49
+
50
+ ## Built in development between Foundation and AeroAI.
51
+ ![foundation](foundationfolio.JPG)
52
+
53
+
54
+ ## Quick Start - Ollama
55
+
56
+ ```
57
+ ollama run hf.co/AeroAIAviation/Folio-1:Q4_K_M
58
+ ```
59
+
60
+ ### Python (Transformers)
61
+
62
+
63
+ ```bash
64
+ pip install -U transformers torch accelerate
65
+ ```
66
+
67
+ ```python
68
+ from transformers import AutoModelForCausalLM, AutoTokenizer
69
+
70
+ model_id = "AeroAI/Folio-1"
71
+ tok = AutoTokenizer.from_pretrained(model_id)
72
+ model = AutoModelForCausalLM.from_pretrained(model_id, device_map="auto")
73
+
74
+ messages = [{"role": "user", "content": "Code me a single file website. You decide the context and domain."}]
75
+ inputs = tok.apply_chat_template(messages, add_generation_prompt=True, return_tensors="pt").to(model.device)
76
+ out = model.generate(inputs, max_new_tokens=256, temperature=0.7, do_sample=True)
77
+ print(tok.decode(out[0][inputs.shape[-1]:], skip_special_tokens=True))
78
+ ```
79
+
80
+ ### Apple Silicon (MLX)
81
+
82
+ ```bash
83
+ pip install -U mlx-lm
84
+ mlx_lm.generate --model AeroAI/Folio-1 --prompt "Explain Terminal shell commands and what they are." --max-tokens 256
85
+ ```
86
+
87
+ ## Model Details
88
+
89
+ ![Foundation](foliodesign.png)
90
+
91
+ | Field | Value |
92
+ |---|---|
93
+ | Developer | Foundation + AeroAI |
94
+ | Family | Folio |
95
+ | Parameters | 1.5B |
96
+ | Type | Causal language model (chat) |
97
+ | Domain | Coding and developmental |
98
+ | Input / Output | Text and image/ Text |
99
+ | Context length | 32,000 |
100
+ | Training data | AeroAI x Foundation Proprietary + Distillation |
101
+ | Fine-tuning method | LoRa + FFT |
102
+ | License | Apache 2.0 |
103
+
104
+
105
+ ## Benchmarks and performance (coding)
106
+ | Benchmark | Score (%) |
107
+ |---|---:|
108
+ | HumanEval | 43.9 |
109
+ | HumanEval+ | 36.6 |
110
+ | MBPP | 69.2 |
111
+ | MBPP+ | 58.6 |
112
+ | MBPP (3-shot) | 59.2 |
113
+ | BigCodeBench-Complete (Full) | 34.6 |
114
+ | BigCodeBench-Complete (Hard) | 9.5 |
115
+
116
+
117
+
118
+ ## Training
119
+ Folio-1 was trained on Foundation's ***FORGE***
120
+ The model was trained in four stages:
121
+ 1. Base model testing.
122
+ 2. Model training.
123
+ 3. Model testing.
124
+ 4. Post training/fine tuning and alignment.
125
+
126
+ Training materials included AeroAI X Foundation's proprietary datasets, along with distilled datasets using Perplexity, OpenAI's ChatGPT, Oscilla, and Anthropic's Claude.
127
+
128
+
129
+
130
+
131
+
132
+
133
+ ## Citation
134
+
135
+ ```bibtex
136
+ @misc{aeroai_Folio-1,
137
+ title = {Folio-1: An Experimental Coding and Developmental work model},
138
+ author = {{AeroAI}},
139
+ year = {2026}
140
+ }
141
+ ```
142
+
143
+ ## Contact/Support
144
+ Website: https://huggingface.co/AeroAIAviation/Folio-1 https://foundationai-iota.vercel.app/models
145
+ Email: aeroaiaviation@icloud.com or aeroaisupport@icloud.com
folio.png ADDED

Git LFS Details

  • SHA256: 97d1a55681b65bb91ae8c9bd0ac629603687639ef4c38342e9ba53e142fa0ce9
  • Pointer size: 131 Bytes
  • Size of remote file: 109 kB
foliodesign.png ADDED

Git LFS Details

  • SHA256: 6e86489f7ff7ce05cdc9ef6d2b5a966f4994d05756cf0ba9aa12747f41e72238
  • Pointer size: 131 Bytes
  • Size of remote file: 859 kB
foundationfolio.JPG ADDED

Git LFS Details

  • SHA256: 16d18a6618881ad07a00f708f43676aed8fc0a1f305a25c9fe9afb2f211698dd
  • Pointer size: 131 Bytes
  • Size of remote file: 104 kB
video.MP4 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51cd0aa84350a5be3420479a2298ca6f235611089260766b2ac1df81c7a28bfa
3
+ size 325166