Instructions to use Xenova/tiny_starcoder_py with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use Xenova/tiny_starcoder_py with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'Xenova/tiny_starcoder_py');
Commit History
-
Add/update the quantized ONNX model files and README.md for Transformers.js v3
Verified signature## Applied Quantizations ### ✅ Based on `decoder_model.onnx` *with* slimming ↳ ✅ `int8`: `decoder_model_int8.onnx` (added) ↳ ✅ `uint8`: `decoder_model_uint8.onnx` (added) ↳ ✅ `q4`: `decoder_model_q4.onnx` (added) ↳ ✅ `q4f16`: `decoder_model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `decoder_model_bnb4.onnx` (added) ### ✅ Based on `decoder_model.onnx` *with* slimming ↳ ✅ `int8`: `decoder_model_int8.onnx` (added) ↳ ✅ `uint8`: `decoder_model_uint8.onnx` (added) ↳ ✅ `q4`: `decoder_model_q4.onnx` (added) ↳ ✅ `q4f16`: `decoder_model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `decoder_model_bnb4.onnx` (added) ### ✅ Based on `decoder_with_past_model.onnx` *with* slimming ↳ ✅ `fp16`: `decoder_with_past_model_fp16.onnx` (added) ↳ ✅ `int8`: `decoder_with_past_model_int8.onnx` (added) ↳ ✅ `uint8`: `decoder_with_past_model_uint8.onnx` (added) ↳ ✅ `q4`: `decoder_with_past_model_q4.onnx` (added) ↳ ✅ `q4f16`: `decoder_with_past_model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `decoder_with_past_model_bnb4.onnx` (added) ### ✅ …bed8038
-
[Automated] Update base model metadata
Verified signatureSet base model to "bigcode/tiny_starcoder_py"8a19c35
-
Upload folder using huggingface_hub
Verified signature282efc0
-
Upload fp16 ONNX weights
Verified signature48ea906
-
Upload folder using huggingface_hub
b645993 -
Upload README.md with huggingface_hub
9cc962f -
Upload folder using huggingface_hub
1c7ebbb -
Upload README.md with huggingface_hub
f56109e -
Upload folder using huggingface_hub
247a083 -
Upload README.md with huggingface_hub
7c833c7
-
Upload folder using huggingface_hub
141c21d -
Upload README.md with huggingface_hub
5f570e7 -
initial commit
173d521