Gleb Kurchanov

nephepritou's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in deepseek-ai/DeepSeek-V4-Flash-Vision-Exp about 1 month ago

Working recipe: DeepSeek-V4-Flash-Vision-Exp on 2× RTX PRO 6000 (SM120) with vLLM — 365k context, 7.06× concurrency (patched flashinfer + KV accounting fix)

1

#18 opened about 1 month ago by

GleLerAdmin

New activity in Lasimeri/MiniMax-M2.7-int4-AutoRound 5 months ago

OutOfMemory during weights loading (vLLM)

#1 opened 5 months ago by

nephepritou

New activity in cyankiwi/Qwen3.5-122B-A10B-AWQ-4bit 6 months ago

Updated weights

2

#5 opened 6 months ago by

nephepritou

New activity in Intel/Qwen3.5-122B-A10B-int4-AutoRound 7 months ago

Does the A100 work?

12

#1 opened 7 months ago by

xz123321

New activity in Sehyo/Qwen3.5-122B-A10B-NVFP4 7 months ago

Quantization instruction

5

#6 opened 7 months ago by

nephepritou

New activity in unsloth/Qwen3-Coder-Next-FP8-Dynamic 8 months ago

Inconsistent output (resolved)

5

#2 opened 8 months ago by

nephepritou

New activity in Qwen/Qwen3-Coder-Next 8 months ago

Very specific json formatting issue in tool calls

➕ 1

4

#14 opened 8 months ago by deleted

New activity in zai-org/GLM-4.7-Flash 8 months ago

Thank you Z.AI, I love this model! ❤

👀❤️ 8

5

#43 opened 9 months ago by

MrDevolver

Model breaks apart when used with different languages

2

#38 opened 9 months ago by

nephepritou

New activity in zai-org/GLM-4.7-Flash 9 months ago

Enormous KV-cache size?

👍➕ 6

23

#3 opened 9 months ago by

nephepritou

Why does the KV cache occupy so much GPU memory?

13

#21 opened 9 months ago by

yyg201708

New activity in cyankiwi/GLM-4.5-Air-AWQ-4bit 10 months ago

Running on 4 GPUs with TP=4

3

#11 opened 10 months ago by

nephepritou

New activity in nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 10 months ago

Tool calling with reasoning parsing broken

11

#3 opened 10 months ago by

nephepritou

New activity in cyankiwi/GLM-4.6V-AWQ-4bit 10 months ago

Question about group size

2

#1 opened 10 months ago by

nephepritou

New activity in cyankiwi/Qwen3-Next-80B-A3B-Thinking-AWQ-4bit 11 months ago

Model not loading

7

#8 opened 11 months ago by

nephepritou

New activity in INC4AI/Qwen3-Next-80B-A3B-Thinking-int4-mixed-AutoRound 11 months ago

No longer works with vllm

1

#5 opened 11 months ago by

bgreene010

New activity in anthracite-org/magnum-v2-72b-exl2 almost 2 years ago

Odd tokens output by 3.0bpw quant.

15

#1 opened about 2 years ago by

Feorn