Dabococo/OWAI_042
Viewer • Updated • 6 • 2
How to use Dabococo/OWAI-Gemma_01 with llama.cpp:
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Dabococo/OWAI-Gemma_01:F16 # Run inference directly in the terminal: llama cli -hf Dabococo/OWAI-Gemma_01:F16
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Dabococo/OWAI-Gemma_01:F16 # Run inference directly in the terminal: llama cli -hf Dabococo/OWAI-Gemma_01:F16
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Dabococo/OWAI-Gemma_01:F16 # Run inference directly in the terminal: ./llama-cli -hf Dabococo/OWAI-Gemma_01:F16
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Dabococo/OWAI-Gemma_01:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Dabococo/OWAI-Gemma_01:F16
docker model run hf.co/Dabococo/OWAI-Gemma_01:F16
How to use Dabococo/OWAI-Gemma_01 with Ollama:
ollama run hf.co/Dabococo/OWAI-Gemma_01:F16
How to use Dabococo/OWAI-Gemma_01 with Docker Model Runner:
docker model run hf.co/Dabococo/OWAI-Gemma_01:F16
How to use Dabococo/OWAI-Gemma_01 with Lemonade:
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Dabococo/OWAI-Gemma_01:F16
lemonade run user.OWAI-Gemma_01-F16
lemonade list
winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf Dabococo/OWAI-Gemma_01:F16# Run inference directly in the terminal:
llama cli -hf Dabococo/OWAI-Gemma_01:F16# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf Dabococo/OWAI-Gemma_01:F16# Run inference directly in the terminal:
./llama-cli -hf Dabococo/OWAI-Gemma_01:F16git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf Dabococo/OWAI-Gemma_01:F16# Run inference directly in the terminal:
./build/bin/llama-cli -hf Dabococo/OWAI-Gemma_01:F16docker model run hf.co/Dabococo/OWAI-Gemma_01:F16Attendez une meilleure version du modèle.
Wait for a better version of the model.
Discord : https://discord.gg/22MYyPDcE6 Website : openwar.fr
FR: Ceci est un modèle d'expérimentation basé sur Gemma 2. Le modèle final aura pour but d'aider les gens sur Minecraft et plus spécifiquement sur le serveur Minecraft OpenWar (openwar.fr).
EN: This is an experimental model based on llama3. The final template will aim to help people on Minecraft and more specifically on the Minecraft OpenWar server (openwar.fr).
4-bit
16-bit
Install (macOS, Linux)
# Start a local OpenAI-compatible server with a web UI: llama serve -hf Dabococo/OWAI-Gemma_01:F16# Run inference directly in the terminal: llama cli -hf Dabococo/OWAI-Gemma_01:F16