Instructions to use BricksDisplay/stablelm-2-1_6b-bnb4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use BricksDisplay/stablelm-2-1_6b-bnb4 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'BricksDisplay/stablelm-2-1_6b-bnb4');
Download quantize_config.json from BricksDisplay/stablelm-2-1_6b-bnb4: direct link, hf CLI and curl.
- Browser
- Download file 112 Bytes
-
https://huggingface.co/BricksDisplay/stablelm-2-1_6b-bnb4/resolve/main/quantize_config.json
- Command line
-
hf download hf://BricksDisplay/stablelm-2-1_6b-bnb4/quantize_config.json
-
curl -L -o quantize_config.json https://huggingface.co/BricksDisplay/stablelm-2-1_6b-bnb4/resolve/main/quantize_config.json
112 Bytes
| { | |
| "per_channel": false, | |
| "reduce_range": false, | |
| "quantize_mode": "bnb4", | |
| "per_model_config": {} | |
| } |