Text Generation
Transformers
Safetensors
GGUF
English
qwen3_5
image-text-to-text
cybersecurity
security
infosec
secops
soc
red-team
red-teaming
blue-team
threat-intelligence
incident-response
pentesting
penetration-testing
ethical-hacking
ctf
offensive-security
function-calling
tool-use
tool-calling
agent
agentic
assistant
conversational
reasoning
abliterated
uncensored
unaligned
heretic
refusal-removal
vision
multimodal
vision-language
vlm
qwen
qwen3
qwen3.5
9b
llama.cpp
vllm
bitsandbytes
quantized
4-bit precision
Instructions to use CyberBuddyAI/CyberBuddy-CyberOps-9B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="CyberBuddyAI/CyberBuddy-CyberOps-9B") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("CyberBuddyAI/CyberBuddy-CyberOps-9B") model = AutoModelForMultimodalLM.from_pretrained("CyberBuddyAI/CyberBuddy-CyberOps-9B", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M # Run inference directly in the terminal: llama cli -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M # Run inference directly in the terminal: llama cli -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Use Docker
docker model run hf.co/CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "CyberBuddyAI/CyberBuddy-CyberOps-9B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CyberBuddyAI/CyberBuddy-CyberOps-9B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
- SGLang
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "CyberBuddyAI/CyberBuddy-CyberOps-9B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CyberBuddyAI/CyberBuddy-CyberOps-9B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "CyberBuddyAI/CyberBuddy-CyberOps-9B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "CyberBuddyAI/CyberBuddy-CyberOps-9B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with Ollama:
ollama run hf.co/CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
- Unsloth Desktop
- Pi
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with Docker Model Runner:
docker model run hf.co/CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
- Lemonade
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Run and chat with the model
lemonade run user.CyberBuddy-CyberOps-9B-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use CyberBuddyAI/CyberBuddy-CyberOps-9B with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "CyberBuddyAI/CyberBuddy-CyberOps-9B:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 829 Bytes
0924b85 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 | CyberBuddy-CyberOps-9B
Copyright 2026 orkohol
This model is an abliterated variant derived from:
Qwen3.5-9B — https://huggingface.co/Qwen/Qwen3.5-9B
Copyright (c) Alibaba Cloud. Licensed under the Apache License, Version 2.0.
Abliteration was performed with Heretic (https://github.com/p-e-w/heretic).
Licensed under the Apache License, Version 2.0 (the "License");
you may not use these files except in compliance with the License.
You may obtain a copy of the License at:
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software and models
distributed under the License are distributed on an "AS IS" BASIS, WITHOUT
WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
No fine-tuning data was used. Released for authorized security work only.
|