nativ-community/LFM3-VL-2B-8bit

LFM3-VL-2B · 8bit

Native MLX text and image/video generation.

Converted from lq-preview/LFM3-VL-2B at 6a5dd2481695581b7838c7e66164b72d792f6bac. Conversion implementation: 5d5ff5af600ec99ce01a833697a4aa1417844ce3 (recorded in conversion.json). Public inference code: Blaizzy/mlx-vlm.

Weights: affine 8-bit, group size 64. Multimodal towers/projectors remain BF16. Activations and KV caches are not quantized.

Usage

Install the pinned public implementation:

pip install 'mlx-vlm @ git+https://github.com/Blaizzy/mlx-vlm.git@3070dcc31948f48f9d8639b606af7bc019494fac'

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template

model, processor = load("nativ-community/LFM3-VL-2B-8bit", trust_remote_code=False)
prompt = apply_chat_template(processor, model.config, "What is 17 + 25?", enable_thinking=False)
print(generate(model, processor, prompt, max_tokens=128, temperature=0).text)

prompt = apply_chat_template(processor, model.config, "What is in this image?", num_images=1, enable_thinking=False)
print(generate(model, processor, prompt, image=["image.png"], max_tokens=128, temperature=0).text)

Validation

Strict native reload on Apple M3 Ultra, MLX 0.32.4; no remote Python code is executed. These are short capability smoke checks, not a general quality benchmark. Exact inputs, outputs, expectations and BF16 comparisons are in validation.json.

Check	Result
finite_logits	completed; expected result matched
arithmetic	42
capital	Canberra.
image_ocr	5739
video_ocr	5739

Fixture mismatches: none on these fixtures. The recorded results are retained even when a quantized answer differs.

The native helper defaults to thinking off; pass enable_thinking=True to use the checkpoint template's thinking behavior. Low-bit quantization can change reasoning and tool-use quality. These short checks do not establish long-context or broader benchmark parity.

The source revision, implementation commit, precision, and tensor audit are in conversion.json; SHA256SUMS covers the release files. The original checkpoint terms apply: see LICENSE and ORIGINAL_MODEL_CARD.md. No new weight license is assigned.