Instructions to use mlboydaisuke/SmolLM3-3B-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use mlboydaisuke/SmolLM3-3B-LiteRT with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install -U litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli # A single .litertlm file in the repo is picked automatically; otherwise the CLI asks which one to run # (or pass its name right after the repo id). litert-lm run \ --from-huggingface-repo=mlboydaisuke/SmolLM3-3B-LiteRT \ --prompt="Write me a poem"
- LiteRT
How to use mlboydaisuke/SmolLM3-3B-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Commit History
6 days ago
-
Thinking cannot be switched off: ThinkingConfig(enable_thinking=False) has no effect on litert-lm 0.18.0; set thinking_token_budget (measured 2026-10-13)
Verified signature6e76cd3
28 days ago
-
Chat template: accept the 0.18 content-parts form (string form unchanged); weights, tokenizer and executor metadata byte-identical
Verified signatureb249f08
-
Card: base_model_relation: quantized (so the conversion lists under the base model's Quantizations, not Finetunes)
Verified signaturecac001b
-
Card: note the default-system-prompt fix (weights unchanged)
Verified signaturef0faf8e -
Restore the vendor's default system prompt in the chat template (weights unchanged). The converter's template probe never renders the block the upstream template emits when the caller sends no system message, so the bundle silently dropped it; with no system message the prompt now renders byte-identical to the upstream chat template's output (see the card note).
Verified signaturefafa648
-
Declare the thought channel so the reasoning is separable and the thinking budget applies (metadata only; weights byte-identical)
Verified signature590cac9
-
Declare the thought channel so the reasoning is separable and the thinking budget applies (metadata only; weights byte-identical)
Verified signatureb5e3390
-
Link the card back to its collection and the request box
Verified signature7eb88b0
-
Document Gallery 1.0.16 direct Hugging Face import + desktop LiteRT-LM CLI (serve/run)
Verified signature8c88e1d
-
Upload model.litertlm with huggingface_hub
Verified signature2a59aa5 -
Upload README.md with huggingface_hub
Verified signature6268296 -
initial commit
Verified signature6183bb0