Paul
paolovic
AI & ML interests
None yet
Organizations
None yet
tool_choice: "required" causes xgrammar FSM crash / infinite hang with GLM-5.2 on vLLM 0.24.0
1
#7 opened 2 months ago
by
paolovic
Will you provide a DFlash model?
🔥 4
#27 opened 3 months ago
by
paolovic
IndexError: list index out of range
👀👍 2
16
#19 opened 5 months ago
by
paolovic
consolidated vs model safetensors
2
#13 opened 5 months ago
by
paolovic
RuntimeError: Both events must be completed before calculating elapsed time.
#1 opened 5 months ago
by
paolovic
Tokenizer set to Mistral?
5
#1 opened 9 months ago
by
zmarty
Thank you for your Quant!
👀 3
7
#1 opened 9 months ago
by
mtcl
How to use it correctly with online serving via vllm openai compatible server?
12
#55 opened 11 months ago
by
dhruvil237
ERROR:ModuleNotFoundError: No module named 'transformers_modules.rednote-hilab.dots'
6
#1 opened about 1 year ago
by
Chienwang
Q6_K Output is just exclamation marks, e.g., !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
17
#5 opened almost 2 years ago
by
paolovic
vllm: ....does not appear to have a file named config.json
2
#1 opened about 2 years ago
by
paolovic
Error loading model
👀👍 4
14
#1 opened over 2 years ago
by
sm54
Error loading model
👀👍 4
14
#1 opened over 2 years ago
by
sm54