Stephen McConnachie

stephenmcconnachie's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/GLM-4.7-Flash-FP8-Dynamic 9 months ago

Reasoning content is output in 'content' when serving with vLLM and calling openAI API, using --reasoning-parser glm45

1

#6 opened 9 months ago by

stephenmcconnachie

Recommended VLLM nightly has no wheels with x86_64 (intel/amd), only aarch64 (arm64)

1

#5 opened 9 months ago by

stephenmcconnachie

Recommended VLLM nightly has no wheels with x86_64 (intel/amd), only aarch64 (arm64)

1

#5 opened 9 months ago by

stephenmcconnachie