matatonic

matatonic's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mradermacher/model_requests about 1 year ago

https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507 imatrix

9

#1186 opened about 1 year ago by

matatonic

New activity in matatonic/Qwen2.5-Coder-0.5B-8.0bpw-h8-exl2 over 1 year ago

Improve language tag

#1 opened over 1 year ago by

lbourdois

New activity in matatonic/Qwen2.5-Coder-14B-6.5bpw-h8-exl2 over 1 year ago

Improve language tag

#1 opened over 1 year ago by

lbourdois

New activity in matatonic/QwQ-32B-4.25bpw-exl2 over 1 year ago

Improve language tag

#1 opened over 1 year ago by

lbourdois

New activity in matatonic/QwQ-32B-6.5bpw-h8-exl2 over 1 year ago

Improve language tag

#1 opened over 1 year ago by

lbourdois

New activity in matatonic/Qwen2.5-72B-Instruct-abliterated-v2-6.5bpw-h8-exl2 over 1 year ago

Improve language tag

#2 opened over 1 year ago by

lbourdois

New activity in matatonic/Qwen2.5-72B-Instruct-abliterated-v2-4.5bpw-exl2 over 1 year ago

Improve language tag

#1 opened over 1 year ago by

lbourdois

New activity in YiXin-AILab/YiXin-Distill-Qwen-72B over 1 year ago

Can you quantify exl2 4.5bpw of this model?

5

#1 opened over 1 year ago by

xldistance

New activity in matatonic/r1-1776-distill-llama-70b-abliterated-6.5bpw-h8-exl2 over 1 year ago

Can you train this model for 4.5bpw quantization?

2

#1 opened over 1 year ago by

xldistance

New activity in matatonic/Qwen2.5-72B-Instruct-abliterated-v2-6.5bpw-h8-exl2 over 1 year ago

Can you produce a 4.5bpw quantized model of this model?

2

#1 opened over 1 year ago by

xldistance

New activity in matatonic/r1-1776-distill-llama-70b-6.5bpw-h8-exl2 over 1 year ago

Running 1776 with draft model

1

#1 opened over 1 year ago by

ernestr

New activity in cyan2k/molmo-7B-D-bnb-4bit almost 2 years ago

conversion script please

5

#2 opened almost 2 years ago by

ctranslate2-4you

New activity in Qwen/Qwen2-VL-7B-Instruct-AWQ almost 2 years ago

config.json breaking change?

😔 1

2

#4 opened almost 2 years ago by

matatonic

New activity in internlm/internlm-xcomposer2d5-7b about 2 years ago

xcomposer2d5 3rd party sft support

3

#12 opened about 2 years ago by

tastelikefeet

New activity in OpenGVLab/InternVL-Chat-V1-5-AWQ about 2 years ago

How to load without lmdeploy?

6

#1 opened about 2 years ago by

matatonic

New activity in qihoo360/360VL-70B about 2 years ago

Fix invalid quotes in modeling_360vl.py

5

#1 opened about 2 years ago by

matatonic

New activity in echo840/Monkey over 2 years ago

problem loading tokenizer

5

#4 opened over 2 years ago by

matatonic

New activity in dphn/dolphin-2.2-70b over 2 years ago

Safetensors version?

6

#2 opened over 2 years ago by

matatonic

New activity in TheBloke/guanaco-7B-GGML about 3 years ago

Problems with guanaco-7B.ggmlv3.q3_K_S.bin

3

#3 opened about 3 years ago by

matatonic

Problems with guanaco-7B.ggmlv3.q3_K_S.bin

3

#3 opened about 3 years ago by

matatonic