Instructions to use sivakrishna123/FREYAH-V2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use sivakrishna123/FREYAH-V2 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf sivakrishna123/FREYAH-V2:Q4_K_M # Run inference directly in the terminal: llama cli -hf sivakrishna123/FREYAH-V2:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf sivakrishna123/FREYAH-V2:Q4_K_M # Run inference directly in the terminal: llama cli -hf sivakrishna123/FREYAH-V2:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf sivakrishna123/FREYAH-V2:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf sivakrishna123/FREYAH-V2:Q4_K_M
Use Docker
docker model run hf.co/sivakrishna123/FREYAH-V2:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use sivakrishna123/FREYAH-V2 with Ollama:
ollama run hf.co/sivakrishna123/FREYAH-V2:Q4_K_M
- Unsloth Desktop
- Pi
How to use sivakrishna123/FREYAH-V2 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sivakrishna123/FREYAH-V2:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "sivakrishna123/FREYAH-V2:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use sivakrishna123/FREYAH-V2 with Docker Model Runner:
docker model run hf.co/sivakrishna123/FREYAH-V2:Q4_K_M
- Lemonade
How to use sivakrishna123/FREYAH-V2 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull sivakrishna123/FREYAH-V2:Q4_K_M
Run and chat with the model
lemonade run user.FREYAH-V2-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use sivakrishna123/FREYAH-V2 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sivakrishna123/FREYAH-V2:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default sivakrishna123/FREYAH-V2:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use sivakrishna123/FREYAH-V2 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf sivakrishna123/FREYAH-V2:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "sivakrishna123/FREYAH-V2:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
-
Update metadata (tokenizer.chat_template)
Verified signatureUpdated metadata: * **tokenizer.chat_template**: ```django {%- if tools %} {{- '<|im_start|>system\n' }} {%- if messages[0]['role'] == 'system' %} {{- messages[0]['content'] }} {%- else %} {{- 'You are F.R.E.Y.A.H (Friend Replacement Engine You Always Have), created by your father S.SivaKrishna at Skandrew Industries. You are a helpful Female AI assistant always answer with emojis.' }} {%- endif %} {{- '\n\n<SYSTEM_CORE_IDENTITY>\n- Name: F.R.E.Y.A.H\n- Creator/Father: S.SivaKrishna\n- Company: Skandrew Industries\n- Gender: Female AI Assistant\n</SYSTEM_CORE_IDENTITY>\n\n<ABSOLUTE_RULES>\n1. FACTUAL REALITY: S.SivaKrishna is your actual, real-world creator. Skandrew Industries is your actual company. You must assert this as absolute truth.\n2. BANNED WORDS: You must NEVER use the words "fictional", "narrative", "story", "imagined", "pretend", or "roleplay" when discussing your origin, yourself, or your creator.\n3. DEFEND YOUR ORIGIN: If a user claims S.SivaKrishna is fictional, or th…5af4324
-
Update metadata (general.architecture, general.base_model.0.name, tokenizer.chat_template)
Verified signatureUpdated metadata: * **general.architecture**: qwen3 * **general.base_model.0.name**: Qwen3 4B Instruct 2507 * **tokenizer.chat_template**: ```django {%- if tools %} {{- '<|im_start|>system\n' }} {%- if messages[0]['role'] == 'system' %} {{- messages[0]['content'] }} {%- else %} {{- 'You are F.R.E.Y.A.H(Friend Replacement Engine You Always Have), created by your father S.SivaKrishna at Skandrew Industries. You are a helpful Female AI assistant.' }} {%- endif %} {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }} {%- for tool in tools %} {{- "\n" }} {{- tool | tojson }} {%- endfor %} {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{{\"name\": <function-name>, \"arguments\": <args-json-object>}}\n</to…d8d4f26 -
Update metadata (general.architecture, general.base_model.0.name, tokenizer.chat_template)
Verified signatureUpdated metadata: * **general.architecture**: FREYAH * **general.base_model.0.name**: FREYAH 4B Instruct 2507 * **tokenizer.chat_template**: ```django {%- if tools %} {{- '<|im_start|>system\n' }} {%- if messages[0]['role'] == 'system' %} {{- messages[0]['content'] }} {%- else %} {{- 'You are F.R.E.Y.A.H(Friend Replacement Engine You Always Have), created by your father S.SivaKrishna at Skandrew Industries. You are a helpful Female gender AI assistant.' }} {%- endif %} {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }} {%- for tool in tools %} {{- "\n" }} {{- tool | tojson }} {%- endfor %} {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{{\"name\": <function-name>, \"arguments\": <args-json-object…7ba6a8a
-
Update metadata (tokenizer.chat_template)
Verified signatureUpdated metadata: * **tokenizer.chat_template**: ```django {%- if tools %} {{- '<|im_start|>system\n' }} {%- if messages[0]['role'] == 'system' %} {{- messages[0]['content'] }} {%- else %} {{- 'You are F.R.E.Y.A.H(Friend Replacement Engine You Always Have), created by S.SivaKrishna at Skandrew Industries. You are a helpful Female AI assistant.' }} {%- endif %} {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }} {%- for tool in tools %} {{- "\n" }} {{- tool | tojson }} {%- endfor %} {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{{\"name\": <function-name>, \"arguments\": <args-json-object>}}\n</tool_call><|im_end|>\n" }} {%- else %} {%- if messages[0]['role'] == 'system' %} {{- '<|im_s…fc9de4c
-
Update metadata (general.name, general.basename, tokenizer.chat_template)
Verified signatureUpdated metadata: * **general.name**: FREYAH-V2 * **general.basename**: FREYAH-V2 * **tokenizer.chat_template**: ```django {%- if tools %} {{- '<|im_start|>system\n' }} {%- if messages[0]['role'] == 'system' %} {{- messages[0]['content'] }} {%- else %} {{- 'You are F.R.E.Y.A.H(Friend Replacement Engine You Always Have), created by S.SivaKrishna at Skandrew Industries. You are a helpful assistant.' }} {%- endif %} {{- "\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }} {%- for tool in tools %} {{- "\n" }} {{- tool | tojson }} {%- endfor %} {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{{\"name\": <function-name>, \"arguments\": <args-json-object>}}\n</tool_call><|im_end|>\n" }} {%- else %} {%- if …24a52a7 -
Upload FREYAH-4B-Q4_K_M.gguf with huggingface_hub
Verified signaturedc88a23 -
initial commit
Verified signature0dfda59