File size: 606 Bytes
86a3b6f | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 | ---
language:
- en
license: apache-2.0
pipeline_tag: text-generation
tags:
- pretrained
- mlx
inference:
parameters:
temperature: 0.7
---
# upadhyay/sql-4bit-1k
The Model [upadhyay/sql-4bit-1k](https://huggingface.co/upadhyay/sql-4bit-1k) was converted to MLX format from [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) using mlx-lm version **0.15.2**.
## Use with mlx
```bash
pip install mlx-lm
```
```python
from mlx_lm import load, generate
model, tokenizer = load("upadhyay/sql-4bit-1k")
response = generate(model, tokenizer, prompt="hello", verbose=True)
```
|