Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

litert-community
/
Olmo-3-7B-Think

Text Generation
LiteRT-LM
LiteRT
English
litertlm
on-device
edge
olmo3
reasoning
Model card Files Files and versions
xet
Community

Instructions to use litert-community/Olmo-3-7B-Think with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • LiteRT-LM

    How to use litert-community/Olmo-3-7B-Think with LiteRT-LM:

    # LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM)
    # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter).
    # For platform-specific integration guides, please refer to the official developer website:
    # https://ai.google.dev/edge/litert-lm
    
    # To try LiteRT-LM, the easiest way is to use our CLI tool.
    # 1. Install the LiteRT-LM CLI tool:
    pip install -U litert-lm
    
    # 2. Download and run this model locally:
    # See: https://ai.google.dev/edge/litert-lm/cli
    # A single .litertlm file in the repo is picked automatically; otherwise the CLI asks which one to run
    # (or pass its name right after the repo id).
    litert-lm run \
      --from-huggingface-repo=litert-community/Olmo-3-7B-Think \
      --prompt="Write me a poem"
  • LiteRT

    How to use litert-community/Olmo-3-7B-Think with LiteRT:

    # No code snippets available yet for this library.
    
    # To use this model, check the repository files and the library's documentation.
    
    # Want to help? PRs adding snippets are welcome at:
    # https://github.com/huggingface/huggingface.js
  • Notebooks
  • Google Colab
  • Kaggle
Olmo-3-7B-Think
16.1 GB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 3 commits
mlboydaisuke's picture
mlboydaisuke
Link LiteRT-LM #4057 from the init-time note
67d84aa verified 4 days ago
  • .gitattributes
    1.72 kB
    Olmo-3-7B-Think in LiteRT-LM format: int8, int4 and int4 with a 2,048-token cache (the phone form), model card, litertlm_manifest.json and the Apache-2.0 LICENSE 7 days ago
  • LICENSE
    11.4 kB
    Olmo-3-7B-Think in LiteRT-LM format: int8, int4 and int4 with a 2,048-token cache (the phone form), model card, litertlm_manifest.json and the Apache-2.0 LICENSE 7 days ago
  • Olmo-3-7B-Think_int4.litertlm
    4.31 GB
    xet
    Olmo-3-7B-Think in LiteRT-LM format: int8, int4 and int4 with a 2,048-token cache (the phone form), model card, litertlm_manifest.json and the Apache-2.0 LICENSE 7 days ago
  • Olmo-3-7B-Think_int4_c2048.litertlm
    4.31 GB
    xet
    Olmo-3-7B-Think in LiteRT-LM format: int8, int4 and int4 with a 2,048-token cache (the phone form), model card, litertlm_manifest.json and the Apache-2.0 LICENSE 7 days ago
  • Olmo-3-7B-Think_int8.litertlm
    7.43 GB
    xet
    Olmo-3-7B-Think in LiteRT-LM format: int8, int4 and int4 with a 2,048-token cache (the phone form), model card, litertlm_manifest.json and the Apache-2.0 LICENSE 7 days ago
  • README.md
    25.1 kB
    Link LiteRT-LM #4057 from the init-time note 4 days ago
  • litertlm_manifest.json
    28.8 kB
    Olmo-3-7B-Think in LiteRT-LM format: int8, int4 and int4 with a 2,048-token cache (the phone form), model card, litertlm_manifest.json and the Apache-2.0 LICENSE 7 days ago