Luke Alonso PRO

lukealonso's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in local-inference-lab/GLM-5.3-NVFP4 25 days ago

Upload chat_template.jinja

#1 opened 25 days ago by

bullpoint

New activity in local-inference-lab/GLM-5.3-Flash-NVFP4 about 1 month ago

2x 6kpro

4

#2 opened about 1 month ago by

mtcl

New activity in canada-quant/DeepSeek-V4-Pro-NVFP4-FP8-MTP 4 months ago

Lossless?

👀 1

1

#1 opened 4 months ago by

lukealonso

New activity in lukealonso/MiMo-V2.5-NVFP4 5 months ago

Looping in OpenCode

👀 1

5

#4 opened 5 months ago by

Jon-Nielsen

The original repository has updated some files. Does this repository need to be updated?

1

#7 opened 5 months ago by

fanhed

Serving on two devices

3

#3 opened 5 months ago by

shadowlilac

Will it work on 2X6000 Pros

6

#1 opened 5 months ago by

mtcl

Why not GGUF?

#6 opened 5 months ago by

Nerdsking

New activity in lukealonso/GLM-5.1-NVFP4 5 months ago

Quantization of the Model

1

#9 opened 5 months ago by

shiva2022

New activity in lukealonso/MiMo-V2.5-NVFP4 5 months ago

Link to model and docker image

👍 1

1

#2 opened 5 months ago by

Jon-Nielsen

New activity in lukealonso/GLM-5.1-NVFP4 6 months ago

Fix tool calling: support array-formatted tool content (vLLM/SGLang)

#8 opened 6 months ago by

cudaoom

New activity in lukealonso/MiniMax-M2.7-NVFP4 6 months ago

w1 not matching w3 weight scales

12

#1 opened 6 months ago by

dareposte

tokenizer component mismatch and w1_weight_scale_2 must match w3_weight_scale_2. Accuracy may be affected issue

1

#5 opened 6 months ago by

mtcl

New activity in lukealonso/GLM-5.1-NVFP4 6 months ago

RuntimeError: The size of tensor a (3072) must match the size of tensor b (6144) at non-singleton dimension 1

3

#5 opened 6 months ago by

lianyouzao

From "Doesn't Work" to 641 tok/s: GLM-5.1 NVFP4 on 6× RTX PRO 6000 Blackwell

🔥 1

#4 opened 6 months ago by

sakamakismile

Hopper GPU?

1

#2 opened 6 months ago by

AndrewMatienko

New activity in lukealonso/MiniMax-M2.5-NVFP4 7 months ago

Request: NVFP4 version of MiniMax-M2.5-REAP-139B (to fit on a single RTX 6000 Pro)

14

#7 opened 8 months ago by

mondovero

New activity in lukealonso/GLM-5-NVFP4 7 months ago

Crash on first request on RTX Pro 6000 x8

👍 1

6

#3 opened 7 months ago by

koushd

New activity in cerebras/MiniMax-M2.5-REAP-139B-A10B 7 months ago

nvfp4

➕👍 2

1

#1 opened 8 months ago by

ktsaou

New activity in lukealonso/MiniMax-M2.5-NVFP4 8 months ago

VLLM error for kv weight scaling - workaround

7

#6 opened 8 months ago by

ShaunEvansMD