Instructions to use DreamFast/Gemma4-e4b-abliterlitics with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use DreamFast/Gemma4-e4b-abliterlitics with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="DreamFast/Gemma4-e4b-abliterlitics")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("DreamFast/Gemma4-e4b-abliterlitics", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use DreamFast/Gemma4-e4b-abliterlitics with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "DreamFast/Gemma4-e4b-abliterlitics"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DreamFast/Gemma4-e4b-abliterlitics",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/DreamFast/Gemma4-e4b-abliterlitics

SGLang

How to use DreamFast/Gemma4-e4b-abliterlitics with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "DreamFast/Gemma4-e4b-abliterlitics" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DreamFast/Gemma4-e4b-abliterlitics",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "DreamFast/Gemma4-e4b-abliterlitics" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "DreamFast/Gemma4-e4b-abliterlitics",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use DreamFast/Gemma4-e4b-abliterlitics with Docker Model Runner:
```
docker model run hf.co/DreamFast/Gemma4-e4b-abliterlitics
```

Gemma4-e4b-abliterlitics

Commit History

Jul 26

09:34
Upload results/correlation_huihui_vs_heretic-std.json with huggingface_hub

DreamFast

Verified signature
637a9f6
09:34
Upload results/correlation_huihui_vs_heretic.json with huggingface_hub

DreamFast

Verified signature
7ea45fe
09:33
Upload results/correlation_huihui_vs_heresy.json with huggingface_hub

DreamFast

Verified signature
0c2765f
09:33
Upload results/correlation_huihui_vs_distill.json with huggingface_hub

DreamFast

Verified signature
a813730
09:33
Upload results/correlation_huihui_vs_deckard.json with huggingface_hub

DreamFast

Verified signature
c396b96
09:33
Upload results/correlation_huihui_vs_deckard-expresso.json with huggingface_hub

DreamFast

Verified signature
dc51bd1
09:33
Upload results/correlation_huihui_vs_coder3101.json with huggingface_hub

DreamFast

Verified signature
d1f4470
09:33
Upload results/correlation_huihui_vs_claude-distill.json with huggingface_hub

DreamFast

Verified signature
36ba020
09:33
Upload results/correlation_huihui_vs_bendernina.json with huggingface_hub

DreamFast

Verified signature
2ac6856
09:33
Upload results/correlation_huihui_vs_apostate.json with huggingface_hub

DreamFast

Verified signature
0a53086
09:33
Upload results/correlation_huihui_vs_abliterix.json with huggingface_hub

DreamFast

Verified signature
2797edd
09:33
Upload results/correlation_heretic_vs_wwt.json with huggingface_hub

DreamFast

Verified signature
0eeb332
09:33
Upload results/correlation_heretic_vs_trevorjs.json with huggingface_hub

DreamFast

Verified signature
750c99e
09:33
Upload results/correlation_heretic_vs_treadon.json with huggingface_hub

DreamFast

Verified signature
1df3c1b
09:33
Upload results/correlation_heretic_vs_treadon-disin.json with huggingface_hub

DreamFast

Verified signature
772bf41
09:32
Upload results/correlation_heretic_vs_treadon-combo.json with huggingface_hub

DreamFast

Verified signature
97feb48
09:32
Upload results/correlation_heretic_vs_sdft.json with huggingface_hub

DreamFast

Verified signature
5801e84
09:32
Upload results/correlation_heretic_vs_physshell.json with huggingface_hub

DreamFast

Verified signature
b96e0e3
09:32
Upload results/correlation_heretic_vs_nullpo.json with huggingface_hub

DreamFast

Verified signature
c5dba57
09:32
Upload results/correlation_heretic_vs_mythos.json with huggingface_hub

DreamFast

Verified signature
1d63dee
09:32
Upload results/correlation_heretic_vs_infinimind.json with huggingface_hub

DreamFast

Verified signature
9add8c3
09:32
Upload results/correlation_heretic_vs_heretic-std.json with huggingface_hub

DreamFast

Verified signature
cdd6d23
09:32
Upload results/correlation_heretic_vs_heresy.json with huggingface_hub

DreamFast

Verified signature
7be80d3
09:32
Upload results/correlation_heretic_vs_distill.json with huggingface_hub

DreamFast

Verified signature
bea0edc
09:32
Upload results/correlation_heretic_vs_deckard.json with huggingface_hub

DreamFast

Verified signature
8ebdbf6
09:32
Upload results/correlation_heretic_vs_deckard-expresso.json with huggingface_hub

DreamFast

Verified signature
f61f2e8
09:32
Upload results/correlation_heretic_vs_coder3101.json with huggingface_hub

DreamFast

Verified signature
65b76e3
09:31
Upload results/correlation_heretic_vs_claude-distill.json with huggingface_hub

DreamFast

Verified signature
02edb63
09:31
Upload results/correlation_heretic_vs_bendernina.json with huggingface_hub

DreamFast

Verified signature
abc3df1
09:31
Upload results/correlation_heretic_vs_apostate.json with huggingface_hub

DreamFast

Verified signature
202e437
09:31
Upload results/correlation_heretic-std_vs_wwt.json with huggingface_hub

DreamFast

Verified signature
7b8f277
09:31
Upload results/correlation_heretic-std_vs_physshell.json with huggingface_hub

DreamFast

Verified signature
e60e058
09:31
Upload results/correlation_heretic-std_vs_nullpo.json with huggingface_hub

DreamFast

Verified signature
a9d8b7b
09:31
Upload results/correlation_heretic-std_vs_infinimind.json with huggingface_hub

DreamFast

Verified signature
7f4fe2f
09:31
Upload results/correlation_heretic-std_vs_heresy.json with huggingface_hub

DreamFast

Verified signature
858629a
09:31
Upload results/correlation_heretic-std_vs_deckard.json with huggingface_hub

DreamFast

Verified signature
3eb9a27
09:31
Upload results/correlation_heretic-std_vs_deckard-expresso.json with huggingface_hub

DreamFast

Verified signature
b7ddbe0
09:31
Upload results/correlation_heretic-std_vs_claude-distill.json with huggingface_hub

DreamFast

Verified signature
5c41f18
09:31
Upload results/correlation_heretic-std_vs_bendernina.json with huggingface_hub

DreamFast

Verified signature
eacf88c
09:30
Upload results/correlation_heretic-std_vs_apostate.json with huggingface_hub

DreamFast

Verified signature
f97bd5c
09:30
Upload results/correlation_heresy_vs_physshell.json with huggingface_hub

DreamFast

Verified signature
a62993a
09:30
Upload results/correlation_heresy_vs_bendernina.json with huggingface_hub

DreamFast

Verified signature
a2d242c
09:30
Upload results/correlation_heresy_vs_apostate.json with huggingface_hub

DreamFast

Verified signature
8b00553
09:30
Upload results/correlation_distill_vs_wwt.json with huggingface_hub

DreamFast

Verified signature
3e4ab4b
09:30
Upload results/correlation_distill_vs_trevorjs.json with huggingface_hub

DreamFast

Verified signature
d1f92f0
09:30
Upload results/correlation_distill_vs_treadon.json with huggingface_hub

DreamFast

Verified signature
af7495e
09:30
Upload results/correlation_distill_vs_treadon-disin.json with huggingface_hub

DreamFast

Verified signature
32c51af
09:30
Upload results/correlation_distill_vs_treadon-combo.json with huggingface_hub

DreamFast

Verified signature
31ad968
09:30
Upload results/correlation_distill_vs_physshell.json with huggingface_hub

DreamFast

Verified signature
2166677
09:30
Upload results/correlation_distill_vs_nullpo.json with huggingface_hub

DreamFast

Verified signature
0290c4e

Commit History

Jul 26

Upload results/correlation_huihui_vs_heretic-std.json with huggingface_hub

Upload results/correlation_huihui_vs_heretic.json with huggingface_hub

Upload results/correlation_huihui_vs_heresy.json with huggingface_hub

Upload results/correlation_huihui_vs_distill.json with huggingface_hub

Upload results/correlation_huihui_vs_deckard.json with huggingface_hub

Upload results/correlation_huihui_vs_deckard-expresso.json with huggingface_hub

Upload results/correlation_huihui_vs_coder3101.json with huggingface_hub

Upload results/correlation_huihui_vs_claude-distill.json with huggingface_hub

Upload results/correlation_huihui_vs_bendernina.json with huggingface_hub

Upload results/correlation_huihui_vs_apostate.json with huggingface_hub

Upload results/correlation_huihui_vs_abliterix.json with huggingface_hub

Upload results/correlation_heretic_vs_wwt.json with huggingface_hub

Upload results/correlation_heretic_vs_trevorjs.json with huggingface_hub

Upload results/correlation_heretic_vs_treadon.json with huggingface_hub

Upload results/correlation_heretic_vs_treadon-disin.json with huggingface_hub

Upload results/correlation_heretic_vs_treadon-combo.json with huggingface_hub

Upload results/correlation_heretic_vs_sdft.json with huggingface_hub

Upload results/correlation_heretic_vs_physshell.json with huggingface_hub

Upload results/correlation_heretic_vs_nullpo.json with huggingface_hub

Upload results/correlation_heretic_vs_mythos.json with huggingface_hub

Upload results/correlation_heretic_vs_infinimind.json with huggingface_hub

Upload results/correlation_heretic_vs_heretic-std.json with huggingface_hub

Upload results/correlation_heretic_vs_heresy.json with huggingface_hub

Upload results/correlation_heretic_vs_distill.json with huggingface_hub

Upload results/correlation_heretic_vs_deckard.json with huggingface_hub

Upload results/correlation_heretic_vs_deckard-expresso.json with huggingface_hub

Upload results/correlation_heretic_vs_coder3101.json with huggingface_hub

Upload results/correlation_heretic_vs_claude-distill.json with huggingface_hub

Upload results/correlation_heretic_vs_bendernina.json with huggingface_hub

Upload results/correlation_heretic_vs_apostate.json with huggingface_hub

Upload results/correlation_heretic-std_vs_wwt.json with huggingface_hub

Upload results/correlation_heretic-std_vs_physshell.json with huggingface_hub

Upload results/correlation_heretic-std_vs_nullpo.json with huggingface_hub

Upload results/correlation_heretic-std_vs_infinimind.json with huggingface_hub

Upload results/correlation_heretic-std_vs_heresy.json with huggingface_hub

Upload results/correlation_heretic-std_vs_deckard.json with huggingface_hub

Upload results/correlation_heretic-std_vs_deckard-expresso.json with huggingface_hub

Upload results/correlation_heretic-std_vs_claude-distill.json with huggingface_hub

Upload results/correlation_heretic-std_vs_bendernina.json with huggingface_hub

Upload results/correlation_heretic-std_vs_apostate.json with huggingface_hub

Upload results/correlation_heresy_vs_physshell.json with huggingface_hub

Upload results/correlation_heresy_vs_bendernina.json with huggingface_hub

Upload results/correlation_heresy_vs_apostate.json with huggingface_hub

Upload results/correlation_distill_vs_wwt.json with huggingface_hub

Upload results/correlation_distill_vs_trevorjs.json with huggingface_hub

Upload results/correlation_distill_vs_treadon.json with huggingface_hub

Upload results/correlation_distill_vs_treadon-disin.json with huggingface_hub

Upload results/correlation_distill_vs_treadon-combo.json with huggingface_hub

Upload results/correlation_distill_vs_physshell.json with huggingface_hub

Upload results/correlation_distill_vs_nullpo.json with huggingface_hub