SmolLM3-3B — ONNX (INT4, onnxruntime-genai)

ONNX export of HuggingFaceTB/SmolLM3-3B in onnxruntime-genai format for efficient autoregressive text generation on CPU (INT4 RTN block-32 quantization).

Produced for use with inference4j, an inference-only AI library for Java.

Usage with inference4j

try (var generator = TextGenerator.builder()
        .model(ModelSources.smolLM3_3B())
        .build()) {
    GenerationResult result = generator.generate("Explain quantum computing in simple terms.");
    System.out.println(result.text());
}

Model Details

Property	Value
Architecture	SmolLM3 (3B parameters)
Task	Text generation / chat
Precision	INT4
ONNX format	onnxruntime-genai
License	Apache-2.0