Instructions to use openamer-max/openamer-max-pro with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use openamer-max/openamer-max-pro with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf openamer-max/openamer-max-pro # Run inference directly in the terminal: llama cli -hf openamer-max/openamer-max-pro
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf openamer-max/openamer-max-pro # Run inference directly in the terminal: llama cli -hf openamer-max/openamer-max-pro
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf openamer-max/openamer-max-pro # Run inference directly in the terminal: ./build/bin/llama cli -hf openamer-max/openamer-max-pro
Use Docker
docker model run hf.co/openamer-max/openamer-max-pro
- Llama new
- LM Studio
- Jan
- Ollama
How to use openamer-max/openamer-max-pro with Ollama:
ollama run hf.co/openamer-max/openamer-max-pro
- Unsloth Desktop
- Docker Model Runner
How to use openamer-max/openamer-max-pro with Docker Model Runner:
docker model run hf.co/openamer-max/openamer-max-pro
- Lemonade
How to use openamer-max/openamer-max-pro with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull openamer-max/openamer-max-pro
Run and chat with the model
lemonade run user.openamer-max-pro-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
docs: Geraetepass, Website und API verlinkt
Browse files
README.md
CHANGED
|
@@ -20,6 +20,31 @@ library_name: llama.cpp
|
|
| 20 |
|
| 21 |
# OpenAmer-Pro — 24B, vierte Stufe nach der Desktop-Stufe in der Größentreppe
|
| 22 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
**Die fünfte Stufe der OpenAmer-Familie.** 24 B Parameter, Q4_K_M, 13,4 GB.
|
| 24 |
Läuft auf einem Rechner mit 16 GB freiem Speicher plus RAM — lokal, ohne Konto,
|
| 25 |
ohne Cloud.
|
|
|
|
| 20 |
|
| 21 |
# OpenAmer-Pro — 24B, vierte Stufe nach der Desktop-Stufe in der Größentreppe
|
| 22 |
|
| 23 |
+
---
|
| 24 |
+
|
| 25 |
+
**Passt dieses Modell auf dein Geraet?** Der Geraetepass listet fuer jedes Modell
|
| 26 |
+
Dateigroesse, RAM-Bedarf, Pruefstand-Ergebnis und Antwortzeit - und ob der Wert
|
| 27 |
+
gemessen oder nur gerechnet ist:
|
| 28 |
+
[openamer-max.github.io/geraetepass](https://openamer-max.github.io/geraetepass/)
|
| 29 |
+
|
| 30 |
+
| Modell | Parameter | Groesse | RAM | Pruefstand |
|
| 31 |
+
|---|---|---|---|---|
|
| 32 |
+
| Watch | 0,6B | 639 MB | ~1,5 GB | 45/45 |
|
| 33 |
+
| Phone | 3,1B | 2,5 GB | ~3,5 GB | 43/45 |
|
| 34 |
+
| Tab | 7,6B | 4,4 GB | ~6 GB | 42/45 |
|
| 35 |
+
| Desktop | 14,7B | 8,4 GB | ~10 GB | 44/45 |
|
| 36 |
+
| Pro | 24B | 13 GB | ~16 GB | 43/45 |
|
| 37 |
+
| Ultra | 32B | 19 GB | ~22 GB | 41/45 |
|
| 38 |
+
| VL-8B | 8,2B | 4,7 GB | ~6 GB (8 GB VRAM gemessen) | multimodal |
|
| 39 |
+
|
| 40 |
+
**Links:** [Website](https://openamer-max.github.io) ·
|
| 41 |
+
[Uebersetzungs-API, 138 Sprachen, kostenlos](https://openamer-max-openamer-translate.hf.space/health) ·
|
| 42 |
+
[Quellcode](https://github.com/openamer-max/openamer)
|
| 43 |
+
|
| 44 |
+
Nutzung unter Apache-2.0.
|
| 45 |
+
|
| 46 |
+
---
|
| 47 |
+
|
| 48 |
**Die fünfte Stufe der OpenAmer-Familie.** 24 B Parameter, Q4_K_M, 13,4 GB.
|
| 49 |
Läuft auf einem Rechner mit 16 GB freiem Speicher plus RAM — lokal, ohne Konto,
|
| 50 |
ohne Cloud.
|