41.1 GB
34 files
Updated about 1 month ago
Name
Size
MTP
.gitattributes1.57 kB
xet
Llama-3.2-3B-Instruct-abliterated.Q2_K.gguf1.36 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q3_K_L.gguf1.82 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q3_K_M.gguf1.69 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q3_K_S.gguf1.54 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q4_0.gguf1.92 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q4_1.gguf2.09 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q4_K_M.gguf2.02 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q4_K_S.gguf1.93 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q5_0.gguf2.27 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q5_1.gguf2.45 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q5_K_M.gguf2.32 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q5_K_S.gguf2.27 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q6_K.gguf2.64 GB
xet
Llama-3.2-3B-Instruct-abliterated.Q8_0.gguf3.42 GB
xet
README.md963 Bytes
xet
added_tokens.json35 Bytes
xet
config.json1.13 kB
xet
gemma-4-12B-it-qat-UD-Q4_K_XL.gguf6.72 GB
xet
mmproj-BF16.gguf175 MB
xet
mmproj-F16.gguf175 MB
xet
mmproj-F32.gguf210 MB
xet
model.safetensors1.38 GB
xet
model.safetensors.index.json50.5 kB
xet
mtp-gemma-4-12B-it.gguf254 MB
xet
special_tokens_map.json662 Bytes
xet
tokenizer.json33.4 MB
xet
tokenizer.model4.69 MB
xet
tokenizer_config.json1.16 MB
xet
README.md

erichartford/gemma-3-1b-it-abliterated-mlx-8Bit

The Model erichartford/gemma-3-1b-it-abliterated-mlx-8Bit was converted to MLX format from mlabonne/gemma-3-1b-it-abliterated using mlx-lm version 0.22.1.

Use with mlx

pip install mlx-lm
from mlx_lm import load, generate

model, tokenizer = load("erichartford/gemma-3-1b-it-abliterated-mlx-8Bit")

prompt="hello"

if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
    messages = [{"role": "user", "content": prompt}]
    prompt = tokenizer.apply_chat_template(
        messages, tokenize=False, add_generation_prompt=True
    )

response = generate(model, tokenizer, prompt=prompt, verbose=True)
Total size
41.1 GB
Files
34
Last updated
Oct 10
Pre-warmed CDN
US EU US EU

Contributors