Li dongyang

lsm03624's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/DeepSeek-V4-Flash-GGUF about 1 month ago

Could you convert this Tencent model to GGUF: https://huggingface.co/tencent/Hy3 This model's capability is better than DeepSeek-V4-Flash.

👀 1

1

#8 opened about 1 month ago by

lsm03624

DeepSeek-V4-Flash is now ready to run locally! 🐳

❤️👍 8

19

#6 opened about 1 month ago by

danielhanchen

My output is garbled

4

#4 opened about 1 month ago by

pliskin123

New activity in Jackrong/Qwopus3.6-27B-v2-FP8 about 1 month ago

hello,The model's output is garbled.

8

#1 opened 3 months ago by

zhao198300

New activity in ornith-ai/Ornith-1.0-35B-FP8 about 1 month ago

FP8 seems to be broken

➕ 1

3

#1 opened about 1 month ago by

Neiko2002

New activity in lovedheart/Qwen-AgentWorld-35B-A3B-FP8 about 2 months ago

You didn't quantize it, did you? FP8 can't be the same size as BF16.

1

#1 opened about 2 months ago by

lsm03624

New activity in WeiboAI/VibeThinker-3B about 2 months ago

怎么自我认知还是deepseek？而且好像没有做快慢思考，无法自适应控制思考长度

3

#12 opened about 2 months ago by

user48271

New activity in cyankiwi/Qwen3-Coder-Next-AWQ-4bit 5 months ago

模型量化的效果并不理想

5

#2 opened 6 months ago by

mediali

New activity in cyankiwi/Qwen3.5-35B-A3B-AWQ-8bit 5 months ago

The VLLM installed in this way can run this model.

#1 opened 5 months ago by

lsm03624

New activity in cyankiwi/Qwen3.5-35B-A3B-AWQ-4bit 5 months ago

Unable to run (vllm/sglang)

8

#1 opened 5 months ago by

nfunctor

New activity in cyankiwi/Qwen3-Coder-Next-AWQ-4bit 6 months ago

Can we perform 4-bit quantization for the awq of the Step-3.5-Flash model? The VLLM can run it.

1

#3 opened 6 months ago by

lsm03624

New activity in ubergarm/Kimi-K2-Thinking-GGUF 9 months ago

the faster the inference speed becomes. Why is that?

👍 1

1

#9 opened 9 months ago by

lsm03624

New activity in MidnightPhreaker/GLM-4.5-Air-REAP-82B-A12B-GPTQ-INT4-gs32 9 months ago

GPU: 5060Ti*4, vllm version 0.11. The following error occurred:

1

#1 opened 9 months ago by

lsm03624

New activity in cyankiwi/Kimi-Linear-48B-A3B-Instruct-AWQ-4bit 9 months ago

Error installing from PR branch

👍 1

14

#1 opened 9 months ago by

DrRos

New activity in QuantTrio/GLM-4.5-Air-AWQ-FP16Mix 9 months ago

Thanks!

❤️ 2

9

#1 opened about 1 year ago by

lightenup

New activity in DevQuasar/MiniMaxAI.MiniMax-M2-GGUF 9 months ago

Seems to be working with PR and `--jinja`

🤝❤️ 3

4

#1 opened 9 months ago by

ubergarm