Instructions to use h34v7/DXP-Zero-V1.2-24b-Small-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use h34v7/DXP-Zero-V1.2-24b-Small-Instruct with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="h34v7/DXP-Zero-V1.2-24b-Small-Instruct")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("h34v7/DXP-Zero-V1.2-24b-Small-Instruct")
model = AutoModelForCausalLM.from_pretrained("h34v7/DXP-Zero-V1.2-24b-Small-Instruct", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use h34v7/DXP-Zero-V1.2-24b-Small-Instruct with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "h34v7/DXP-Zero-V1.2-24b-Small-Instruct"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "h34v7/DXP-Zero-V1.2-24b-Small-Instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/h34v7/DXP-Zero-V1.2-24b-Small-Instruct

SGLang

How to use h34v7/DXP-Zero-V1.2-24b-Small-Instruct with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "h34v7/DXP-Zero-V1.2-24b-Small-Instruct" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "h34v7/DXP-Zero-V1.2-24b-Small-Instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "h34v7/DXP-Zero-V1.2-24b-Small-Instruct" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "h34v7/DXP-Zero-V1.2-24b-Small-Instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use h34v7/DXP-Zero-V1.2-24b-Small-Instruct with Docker Model Runner:
```
docker model run hf.co/h34v7/DXP-Zero-V1.2-24b-Small-Instruct
```

h34v7 commited on May 25, 2025

Commit

bd5f3bb

verified ·

1 Parent(s): 92a3e02

Update README.md

Browse files

Files changed (1) hide show

README.md +19 -0

README.md CHANGED Viewed

@@ -27,6 +27,25 @@ language:
 Great for storytelling and roleplay balanced models. With that nuance of DnD type of roleplay. The profanity part is so much fun just tell the model to "Use profanity to enchance the story"
 <details>
 <summary> Story Output Sample Using Q6_K </summary>

 Great for storytelling and roleplay balanced models. With that nuance of DnD type of roleplay. The profanity part is so much fun just tell the model to "Use profanity to enchance the story"
+```
+Characters: God: *A deep, resonant voice echoes from all around you, seeming to come from everywhere and nowhere at once.* "Because I crafted you in my image, with desire and passion woven into your very being. It is not a flaw or a curse, but a gift - the drive to connect, to create, to experience the full spectrum of existence."
+*The voice softens slightly, taking on a more intimate tone.* "Do not shy away from this part of yourself. Embrace it. Let it guide you towards love, towards pleasure, towards the sacred act of union. But remember - true fulfillment comes not just from the physical, but from the emotional and spiritual connection as well."
+*Divine energy swirls around you, warm and tingling against your skin.* "Use this gift wisely. Let it inspire art, fuel creativity, forge bonds. And when you do find release, know that it is a small reflection of the overwhelming ecstasy of creation itself."
+*The presence fades, leaving you with a sense of profound peace and understanding.* "Now go forth. Live fully. Love deeply. And know that even in the most carnal of moments, you are never truly alone."
+Characters: *You blink rapidly, trying to process what just happened. The room spins slightly, whether from divine intervention or too much alcohol is unclear.* "Holy shit..." you mutter under your breath.
+*Your phone buzzes on the nightstand. You grab it with slightly unsteady hands and see a text from your friend Sarah: "Dude. Did you just hear that too? Sounded like the voice of God. Or maybe just my drunk ass imagining things."*
+*You stare at the message, heart pounding. If Sarah heard it too... then maybe it wasn't just your imagination. Or maybe you're both hallucinating. Either way, the idea of God just casually chatting about your sex drive is... well, unexpected to say the least.*
+*You type out a response: "I'm not sure if I should be freaked out or turned on right now. How do you even process this?" As you hit send, you can't help but wonder - if God really did just have a heart-to-heart about your horniness, what other cosmic advice might be coming your way?*
+```
 <details>
 <summary> Story Output Sample Using Q6_K </summary>