Benjamin Marie PRO

bnjmnmarie's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in kaitchup/Qwen3.8-27B-hum-quality-MTP-19.2GB about 1 month ago

Maybe add vLLM FP8 KVCache calibration scales

3

#2 opened about 1 month ago by

ibaldonl

New activity in kaitchup/Ornith-1.5-9B-hum-high about 1 month ago

Mixed up model names

2

#1 opened about 1 month ago by

owao

New activity in kaitchup/MiniMax-M3-GGUF-MoQ 3 months ago

Which llama.cpp version?

3

#2 opened 3 months ago by

MLDataScientist

New activity in kaitchup/Qwen3.6-27B-GGUF-MoQ 4 months ago

LMStudio sees the GGUF as MTP enabled

4

#2 opened 4 months ago by

Hachann

Higher-BPW MoQ variant (bf16 K/V + Q5_K FFN)?

🧠 1

2

#1 opened 4 months ago by

zockin

New activity in 0xSero/Qwen3.6-28B 5 months ago

error with vLLM

6

#3 opened 5 months ago by

bnjmnmarie

New activity in kaitchup/Qwen3.5-27B-autoround-NVFP4-linearattn-BF16 6 months ago

ValueError: Tokenizer class TokenizersBackend does not exist or is not currently imported

3

#1 opened 6 months ago by

Qnibbles

New activity in kaitchup/Olmo-3.1-32B-Instruct-fp8-dynamic 9 months ago

Error running vllm 12

1

#1 opened 9 months ago by

evetsagg

New activity in mistralai/Ministral-3-14B-Reasoning-2512 10 months ago

Reasoning not parsing correctly within VLLM

11

#4 opened 10 months ago by

SuperbEmphasis

New activity in Firworks/INTELLECT-3-nvfp4 11 months ago

works with vLLM, with FLASHINFER_MOE_FP4

1

#2 opened 11 months ago by

bnjmnmarie

New activity in kaitchup/Olmo-3-7B-Instruct-fp8-dynamic 11 months ago

Update README.md

#1 opened 11 months ago by

bmarie

New activity in microsoft/UserLM-8b 12 months ago

Question about Llama 3.1 license compliance

🧠👍 7

3

#3 opened 12 months ago by

tokinasin

New activity in unsloth/Qwen3-30B-A3B-Instruct-2507-GGUF about 1 year ago

qwen3moe instead of qwen3_moe?

3

#5 opened about 1 year ago by

bnjmnmarie

New activity in kaitchup-toolboxes/Qwen2.5 over 1 year ago

How can I get the access?

1

#1 opened over 1 year ago by

minjunsz

New activity in kaitchup/Qwen2.5-72B-Instruct-AutoRound-GPTQ-4bit over 1 year ago

how to run this model

4

#1 opened over 1 year ago by

cicdatopea

New activity in kaitchup/QwQ-32B-AutoRoundGPTQ-4bit over 1 year ago

Qwen-32B overflow issue

8

#1 opened over 1 year ago by

cicdatopea

New activity in kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit over 1 year ago

Your quants are not listed in the base model

2

#2 opened over 1 year ago by

dazipe

New activity in kaitchup/Mistral-Small-24B-Instruct-2501-AutoRound-GPTQ-4bit over 1 year ago

Any plan for 8 bit?

1

#1 opened over 1 year ago by

jm4n21

New activity in kaitchup-toolboxes/Llama3 over 1 year ago

github?

4

#2 opened over 1 year ago by

silvacarl

New activity in kaitchup/Mistral-Nemo-Base-2407-AutoRound-GPTQ-asym-4bit over 1 year ago

Request for Mistral Large 2 Instruct 2407 3bit with Autoround GPTQ

4

#1 opened over 1 year ago by

MLDataScientist