GoodDavid commited on
Commit
c26709e
Β·
verified Β·
1 Parent(s): 48b07c8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +131 -95
README.md CHANGED
@@ -4,164 +4,200 @@ language:
4
  - sk
5
  - en
6
  - de
 
7
  license: apache-2.0
 
8
  base_model: EuroLLM-9B
 
9
  quantization: Q8_0
 
 
 
 
 
10
  tags:
11
  - gguf
12
  - llama.cpp
13
  - offline
 
14
  - local-ai
15
  - multilingual
16
- - cli-runtime
17
  - ai-runtime
18
- pipeline_tag: text-generation
19
- library_name: llama.cpp
 
 
 
 
20
  ---
21
 
22
- # Offline AI 2.2 – EuroLLM-9B-Q8_0 (GGUF)
23
 
24
- Offline AI 2.2 is a fully local AI runtime environment built around digital sovereignty, privacy, and system autonomy.
25
 
26
- No cloud.
27
- No telemetry.
28
- No tracking.
29
- No external dependencies.
30
-
31
- Everything runs locally via **llama.cpp**.
32
-
33
- ---
34
 
35
- ## πŸ–₯️ CLI Preview
 
 
 
36
 
37
- Below is the Offline AI runtime interface:
38
 
39
- ![Offline AI CLI Help Menu](cli_help_menu.png)
40
 
41
- Offline AI is no longer just a model launcher.
42
 
43
- It is a **local AI runtime environment** designed to manage and operate language models fully offline with a structured command interface.
44
 
45
- Core capabilities include:
 
 
46
 
47
- - CLI runtime environment
48
- - Model lifecycle management
49
- - Profile-based workspace system
50
- - Snapshot conversation archiving
51
- - Runtime diagnostics and monitoring
52
- - Administrative control layer
53
 
54
- The architecture is designed as a foundation for **multi-model local AI systems**.
55
 
56
  ---
57
 
58
- ## 🧠 RUNTIME ARCHITECTURE
59
 
60
- Offline AI uses a layered architecture:
61
 
62
- User (CLI)
63
- ↓
64
- Python Runtime
65
- ↓
66
- C++ Inference Engine (llama.cpp)
67
- ↓
68
- GGUF Language Model
69
 
 
 
 
 
 
 
 
 
 
 
 
 
70
 
71
- The Python runtime acts as the **control layer**, responsible for:
72
 
73
- - command handling
74
- - model orchestration
75
- - workspace profiles
76
- - snapshots and notes
77
- - system diagnostics
78
- - administrative operations
79
 
80
- The inference backend is a lightweight C++ wrapper around **llama.cpp** with real-time token streaming.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
81
 
82
  ---
83
 
84
- ## πŸ”§ TECHNICAL INFORMATION
85
 
86
- Base model: EuroLLM-9B
87
- Quantization: Q8_0 (GGUF)
88
- Format: llama.cpp compatible
89
- Inference engine: llama.cpp
90
- Offline AI Version: 2.2
91
- Recommended RAM: 16 GB
92
- Platforms: macOS, Windows, Linux
 
 
93
 
94
- This repository distributes a **quantized GGUF Q8_0 variant** of the EuroLLM-9B model optimized for efficient local inference.
95
 
96
- The original model weights are **not modified and not fine-tuned** as part of this project.
97
 
98
  ---
99
 
100
- ## πŸš€ WHAT'S NEW IN 2.2
101
 
102
- - Structured CLI runtime environment
103
- - Model lifecycle management system
104
- - Model alias system
105
- - Workspace profiles and isolation
106
- - Snapshot conversation archiving
107
- - Runtime diagnostics and monitoring
108
- - Administrative control mode
109
- - Improved modular runtime architecture
110
 
111
- Offline AI 2.2 evolves the project from a simple model launcher into a **local AI runtime platform** prepared for managing multiple specialized AI models.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
112
 
113
  ---
114
 
115
- ## πŸ” PROJECT PHILOSOPHY
116
 
117
- Offline AI demonstrates that modern AI systems can operate fully offline.
118
 
119
- The project explores the idea that:
120
 
121
- - AI does not require cloud infrastructure
122
- - Open models can run independently on personal hardware
123
- - AI tools can respect user privacy
124
- - Local-first computing is a viable architecture
125
 
126
- Offline AI promotes:
127
 
128
- - Digital sovereignty
129
- - Transparent system design
130
- - Offline experimentation
131
- - User-controlled AI environments
132
 
133
- ---
 
 
134
 
135
- ## πŸ“„ MODEL ORIGIN & LICENSE
136
 
137
- Model: EuroLLM-9B
138
- Original authors: EuroLLM Project consortium
139
- Funded by: European Union research initiatives
140
- Base model license: Apache License 2.0
141
 
142
- Quantized distribution: GGUF Q8_0
143
- Runtime engine: llama.cpp (MIT License)
144
- Offline AI runtime interface: Β© David KΓ‘ninskΓ½
145
 
146
- All components are used in compliance with their respective licenses.
147
 
148
  ---
149
 
150
- ## ⚠️ DISCLAIMER
151
 
152
- This project is an educational and experimental implementation.
153
 
154
- It is not a commercial AI service and does not replace professional advice.
155
- Outputs are not intended for legal, medical, financial, or critical decision-making use.
156
 
157
- Use beyond personal, research, or educational purposes is at your own responsibility.
158
 
159
  ---
160
 
161
- ## 🌍 PROJECT
 
 
 
 
 
 
 
 
 
 
162
 
163
- Website: https://OfflineAI.online
164
- Domains: .cz / .sk / .de
165
 
166
- Offline AI Runtime
167
- Author: David KΓ‘ninskΓ½
 
4
  - sk
5
  - en
6
  - de
7
+
8
  license: apache-2.0
9
+
10
  base_model: EuroLLM-9B
11
+
12
  quantization: Q8_0
13
+
14
+ pipeline_tag: text-generation
15
+
16
+ library_name: llama.cpp
17
+
18
  tags:
19
  - gguf
20
  - llama.cpp
21
  - offline
22
+ - offline-first
23
  - local-ai
24
  - multilingual
 
25
  - ai-runtime
26
+ - webui
27
+ - cli
28
+ - voice
29
+ - speech-to-text
30
+ - text-to-speech
31
+ - privacy
32
  ---
33
 
34
+ # Offline AI Runtime 3.0 – EuroLLM-9B-Q8_0 (GGUF)
35
 
36
+ Offline AI Runtime 3.0 is a fully local AI runtime environment focused on digital sovereignty, privacy, and user-controlled AI.
37
 
38
+ Everything runs entirely on your own computer.
 
 
 
 
 
 
 
39
 
40
+ **No cloud.**
41
+ **No telemetry.**
42
+ **No tracking.**
43
+ **No subscriptions.**
44
 
45
+ Powered by **llama.cpp**.
46
 
47
+ ---
48
 
49
+ # πŸ–₯️ Runtime Interfaces
50
 
51
+ Offline AI provides multiple ways to interact with local AI:
52
 
53
+ - Terminal (CLI)
54
+ - Modern Web UI
55
+ - Voice interaction (Speech-to-Text + Text-to-Speech)
56
 
57
+ All interfaces use the same local runtime and the same locally running language models.
 
 
 
 
 
58
 
59
+ ![Terminal or Web UI](Terminal_WebUI.png)
60
 
61
  ---
62
 
63
+ # ✨ What's New in 3.0
64
 
65
+ Offline AI has evolved from a simple model launcher into a complete local AI runtime platform.
66
 
67
+ New features include:
 
 
 
 
 
 
68
 
69
+ - Modern Web UI
70
+ - Structured CLI runtime
71
+ - Voice conversations (STT + TTS)
72
+ - Runtime model switching
73
+ - Model lifecycle management
74
+ - Model alias system
75
+ - Workspace profiles
76
+ - Conversation snapshots
77
+ - Notes system
78
+ - Runtime diagnostics
79
+ - Administrative control mode
80
+ - Improved modular architecture
81
 
82
+ Designed for running multiple local AI models inside a unified offline environment.
83
 
84
+ ---
 
 
 
 
 
85
 
86
+ # 🧠 Runtime Architecture
87
+
88
+ ```text
89
+ CLI / Web UI / Voice
90
+ β”‚
91
+ β–Ό
92
+ Offline AI Runtime
93
+ β”‚
94
+ β”œβ”€β”€ Profiles
95
+ β”œβ”€β”€ Notes
96
+ β”œβ”€β”€ Snapshots
97
+ β”œβ”€β”€ Diagnostics
98
+ β”œβ”€β”€ Voice
99
+ β”œβ”€β”€ Model Manager
100
+ └── Runtime Commands
101
+ β”‚
102
+ β–Ό
103
+ llama.cpp
104
+ β”‚
105
+ β–Ό
106
+ GGUF Models
107
+ ```
108
+
109
+ The Python runtime acts as the orchestration layer while **llama.cpp** provides efficient local inference with real-time token streaming.
110
 
111
  ---
112
 
113
+ # πŸ”§ Technical Information
114
 
115
+ | Component | Value |
116
+ |-----------|-------|
117
+ | Base model | EuroLLM-9B |
118
+ | Quantization | Q8_0 |
119
+ | Format | GGUF |
120
+ | Runtime | Offline AI Runtime 3.0 |
121
+ | Inference Engine | llama.cpp |
122
+ | Recommended RAM | 16 GB |
123
+ | Platforms | macOS β€’ Windows β€’ Linux |
124
 
125
+ This repository distributes an **unmodified quantized GGUF version** of EuroLLM-9B.
126
 
127
+ The original model has **not been fine-tuned or modified** as part of this project.
128
 
129
  ---
130
 
131
+ # πŸ” Project Philosophy
132
 
133
+ Offline AI explores a different direction for modern AI.
 
 
 
 
 
 
 
134
 
135
+ The project demonstrates that:
136
+
137
+ - AI can work without cloud services.
138
+ - AI belongs to its owner.
139
+ - Privacy should be the default.
140
+ - Users should control their own models.
141
+ - Local-first AI is a viable architecture.
142
+
143
+ Offline AI promotes:
144
+
145
+ - Digital sovereignty
146
+ - Local-first computing
147
+ - Transparent system design
148
+ - Open AI ecosystems
149
+ - Privacy by default
150
 
151
  ---
152
 
153
+ # πŸ“„ Model Origin & License
154
 
155
+ **Base Model**
156
 
157
+ EuroLLM-9B
158
 
159
+ **Authors**
 
 
 
160
 
161
+ EuroLLM Consortium
162
 
163
+ **Base Model License**
 
 
 
164
 
165
+ Apache License 2.0
166
+
167
+ **Runtime Engine**
168
 
169
+ llama.cpp (MIT License)
170
 
171
+ **Offline AI Runtime**
 
 
 
172
 
173
+ Β© David KΓ‘ninskΓ½
 
 
174
 
175
+ All components are distributed in accordance with their respective licenses.
176
 
177
  ---
178
 
179
+ # ⚠️ Disclaimer
180
 
181
+ Offline AI is an educational and experimental runtime environment.
182
 
183
+ Generated responses may contain inaccuracies and should not be used as the sole basis for legal, medical, financial, or other high-risk decisions.
 
184
 
185
+ Users are responsible for how the software and generated content are used.
186
 
187
  ---
188
 
189
+ # 🌍 Project
190
+
191
+ **Website**
192
+
193
+ https://OfflineAI.online
194
+
195
+ Additional domains:
196
+
197
+ - OfflineAI.cz
198
+ - OfflineAI.sk
199
+ - OfflineAI.de
200
 
201
+ **Author**
 
202
 
203
+ David KΓ‘ninskΓ½