exolabs/agents-a1-4bit-text-dequant-bf16

Public dequantized BF16 export for vLLM validation.

  • Internal model id: agents-a1-4bit
  • MLX source: mlx-community/Agents-A1-4bit
  • Original HF comparison model: InternScience/Agents-A1
  • Export dtype: bfloat16
  • Text-only export: False

This checkpoint is the result of dequantizing the quantized MLX checkpoint. It is not the original upstream BF16 checkpoint.

Downloads last month
7
Safetensors
Model size
35B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support