Instructions to use BricksDisplay/stablelm-2-1_6b-q4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use BricksDisplay/stablelm-2-1_6b-q4 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'BricksDisplay/stablelm-2-1_6b-q4');
Download quantize_config.json from BricksDisplay/stablelm-2-1_6b-q4: direct link, hf CLI and curl.
- Browser
- Download file 110 Bytes
-
https://huggingface.co/BricksDisplay/stablelm-2-1_6b-q4/resolve/main/quantize_config.json
- Command line
-
hf download hf://BricksDisplay/stablelm-2-1_6b-q4/quantize_config.json
-
curl -L -o quantize_config.json https://huggingface.co/BricksDisplay/stablelm-2-1_6b-q4/resolve/main/quantize_config.json
110 Bytes
| { | |
| "per_channel": false, | |
| "reduce_range": false, | |
| "quantize_mode": "q4", | |
| "per_model_config": {} | |
| } |