Instructions to use KillerBoss/functiongemma-plantgame-de with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use KillerBoss/functiongemma-plantgame-de with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use KillerBoss/functiongemma-plantgame-de with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf KillerBoss/functiongemma-plantgame-de:F16 # Run inference directly in the terminal: llama cli -hf KillerBoss/functiongemma-plantgame-de:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf KillerBoss/functiongemma-plantgame-de:F16 # Run inference directly in the terminal: llama cli -hf KillerBoss/functiongemma-plantgame-de:F16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf KillerBoss/functiongemma-plantgame-de:F16 # Run inference directly in the terminal: ./build/bin/llama cli -hf KillerBoss/functiongemma-plantgame-de:F16
Use Docker
docker model run hf.co/KillerBoss/functiongemma-plantgame-de:F16
- Llama new
- LM Studio
- Jan
- Ollama
How to use KillerBoss/functiongemma-plantgame-de with Ollama:
ollama run hf.co/KillerBoss/functiongemma-plantgame-de:F16
- Unsloth Desktop
- Docker Model Runner
How to use KillerBoss/functiongemma-plantgame-de with Docker Model Runner:
docker model run hf.co/KillerBoss/functiongemma-plantgame-de:F16
- Lemonade
How to use KillerBoss/functiongemma-plantgame-de with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull KillerBoss/functiongemma-plantgame-de:F16
Run and chat with the model
lemonade run user.functiongemma-plantgame-de-F16
List all available models
lemonade list
- Atomic Chat
log: export v8 final
Browse files- logs/export_v8.log +57 -0
logs/export_v8.log
CHANGED
|
@@ -2102,3 +2102,60 @@ Traceback (most recent call last):
|
|
| 2102 |
File "/usr/local/lib/python3.12/dist-packages/ai_edge_litert/aot/core/apply_plugin.py", line 146, in __call__
|
| 2103 |
import sys as _ap_sys
|
| 2104 |
ValueError: apply_plugin failed to apply plugin. See /tmp/tmpdh4tkol8.error for details.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 2102 |
File "/usr/local/lib/python3.12/dist-packages/ai_edge_litert/aot/core/apply_plugin.py", line 146, in __call__
|
| 2103 |
import sys as _ap_sys
|
| 2104 |
ValueError: apply_plugin failed to apply plugin. See /tmp/tmpdh4tkol8.error for details.
|
| 2105 |
+
>>> Log nach HF (compile-sm8750-nowns)
|
| 2106 |
+
|
| 2107 |
+
================================================================
|
| 2108 |
+
STEP: 5/6 Verifikation (t+18.4 min)
|
| 2109 |
+
================================================================
|
| 2110 |
+
+ litert-lm-peek --litertlm_file /kaggle/working/export_npu/model.litertlm 2>&1 | head -45
|
| 2111 |
+
LiteRT-LM Version: 1.6.0
|
| 2112 |
+
|
| 2113 |
+
+------------------------------------------------+
|
| 2114 |
+
| System Metadata |
|
| 2115 |
+
+------------------------------------------------+
|
| 2116 |
+
Key: Authors, Value (String): ODML
|
| 2117 |
+
Key: uuid, Value (String): fc9780d9-6422-4907-bde5-a05b8a93f742
|
| 2118 |
+
Key: creation_timestamp, Value (String): 2026-09-09T12:16:02.213697+00:00
|
| 2119 |
+
|
| 2120 |
+
+------------------------------------------------+
|
| 2121 |
+
| Sections (6) |
|
| 2122 |
+
+------------------------------------------------+
|
| 2123 |
+
|
| 2124 |
+
Section 0:
|
| 2125 |
+
Items:
|
| 2126 |
+
<None>
|
| 2127 |
+
Begin Offset: 16384
|
| 2128 |
+
End Offset: 30541
|
| 2129 |
+
Data Type: LlmMetadataProto
|
| 2130 |
+
<<<<<<<< start of LlmMetadata
|
| 2131 |
+
start_token {
|
| 2132 |
+
token_str: "<bos>"
|
| 2133 |
+
}
|
| 2134 |
+
stop_tokens {
|
| 2135 |
+
token_str: ")<end_of_turn>\n"
|
| 2136 |
+
}
|
| 2137 |
+
stop_tokens {
|
| 2138 |
+
token_ids {
|
| 2139 |
+
ids: 1
|
| 2140 |
+
}
|
| 2141 |
+
}
|
| 2142 |
+
stop_tokens {
|
| 2143 |
+
token_str: ".<end_of_turn>\n"
|
| 2144 |
+
}
|
| 2145 |
+
stop_tokens {
|
| 2146 |
+
token_str: "\'<end_of_turn>\n"
|
| 2147 |
+
}
|
| 2148 |
+
stop_tokens {
|
| 2149 |
+
token_str: "?<end_of_turn>\n"
|
| 2150 |
+
}
|
| 2151 |
+
stop_tokens {
|
| 2152 |
+
token_str: "}<end_of_turn>\n"
|
| 2153 |
+
}
|
| 2154 |
+
stop_tokens {
|
| 2155 |
+
token_ids {
|
| 2156 |
+
|
| 2157 |
+
|
| 2158 |
+
================================================================
|
| 2159 |
+
STEP: 6/6 Upload (t+18.4 min)
|
| 2160 |
+
================================================================
|
| 2161 |
+
Kein NPU-Artefakt - siehe COMPILER-OUTPUT im Log.
|