Text Generation
LiteRT-LM
edgerock
quantized

EdgeRock-4B-LiteRT-LM-INT8

Public development preview for Google AI Edge Gallery device validation. The container includes the text decoder, tokenizer, ChatML prompt template and fixed-state executor metadata. The graph retains recurrent state, local attention and RMA reads and block-boundary commits. Full-model long-memory checks and Android device validation are in progress.

The model file is 4.688 GB (decimal file size, not runtime memory). Use the CPU backend in Gallery 1.0.19 / LiteRT-LM 0.18.0. Image and audio inputs are not included.

python -m pip install -r requirements.txt
python run_litert.py --model EdgeRock-4B-int8.litertlm --prompt 'Calculate 17 * 23. Give only the answer.'

Weights retain the EdgeRock Model License 1.0. Code retains Apache-2.0.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for hkust-aaron/EdgeRock-4B-LiteRT-LM-INT8

Quantized
(13)
this model