Paul

paolovic

·

AI & ML interests

None yet

Organizations

None yet

New activity in nvidia/GLM-5.2-NVFP4 2 months ago

tool_choice: "required" causes xgrammar FSM crash / infinite hang with GLM-5.2 on vLLM 0.24.0

#7 opened 2 months ago by

New activity in zai-org/GLM-5.2 3 months ago

Will you provide a DFlash model?

#27 opened 3 months ago by

New activity in mistralai/Mistral-Medium-3.5-128B 5 months ago

IndexError: list index out of range

#19 opened 5 months ago by

consolidated vs model safetensors

#13 opened 5 months ago by

New activity in koushd/GLM-5.1-NVFP4 5 months ago

RuntimeError: Both events must be completed before calculating elapsed time.

#1 opened 5 months ago by

New activity in lukealonso/GLM-5.1-NVFP4 5 months ago

RuntimeError: The size of tensor a (3072) must match the size of tensor b (6144) at non-singleton dimension 1

#5 opened 6 months ago by

New activity in cyankiwi/MiniMax-M2.1-AWQ-4bit 9 months ago

Tokenizer set to Mistral?

#1 opened 9 months ago by

New activity in QuantTrio/MiniMax-M2.1-AWQ 9 months ago

Thank you for your Quant!

#1 opened 9 months ago by

New activity in deepseek-ai/DeepSeek-OCR 11 months ago

How to use it correctly with online serving via vllm openai compatible server?

#55 opened 11 months ago by

New activity in dots-studio/dots.ocr about 1 year ago

ERROR：ModuleNotFoundError: No module named 'transformers_modules.rednote-hilab.dots'

#1 opened about 1 year ago by

New activity in bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF almost 2 years ago

Q6_K Output is just exclamation marks, e.g., !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

#5 opened almost 2 years ago by

New activity in bartowski/reader-lm-1.5b-GGUF about 2 years ago

vllm: ....does not appear to have a file named config.json

#1 opened about 2 years ago by

New activity in bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF over 2 years ago

Error loading model

#1 opened over 2 years ago by

Error loading model

#1 opened over 2 years ago by