Instructions to use IoakeimE/sft_normal_simplification_mini with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use IoakeimE/sft_normal_simplification_mini with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("IoakeimE/sft_normal_simplification_mini", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Unsloth Desktop
File size: 1,543 Bytes
c7ea7ec f2e4572 8c98e3d c7ea7ec 8c98e3d 9fa8d67 8c98e3d c7ea7ec 8c98e3d c7ea7ec 8c98e3d c7ea7ec 8c98e3d c7ea7ec 8c98e3d c7ea7ec 8c98e3d c7ea7ec 8c98e3d f2e4572 8c98e3d 401997a f2e4572 8c98e3d f2e4572 8c98e3d c7ea7ec 8c98e3d 401997a c7ea7ec 8c98e3d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 | ---
base_model: unsloth/mistral-7b-v0.3-bnb-4bit
library_name: transformers
model_name: sft_normal_simplification_mini
tags:
- generated_from_trainer
- unsloth
- trl
- sft
licence: license
---
# Model Card for sft_normal_simplification_mini
This model is a fine-tuned version of [unsloth/mistral-7b-v0.3-bnb-4bit](https://huggingface.co/unsloth/mistral-7b-v0.3-bnb-4bit).
It has been trained using [TRL](https://github.com/huggingface/trl).
## Quick start
```python
from transformers import pipeline
question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
generator = pipeline("text-generation", model="IoakeimE/sft_normal_simplification_mini", device="cuda")
output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
print(output["generated_text"])
```
## Training procedure
This model was trained with SFT.
### Framework versions
- TRL: 0.24.0
- Transformers: 4.57.3
- Pytorch: 2.9.0
- Datasets: 4.3.0
- Tokenizers: 0.22.1
## Citations
Cite TRL as:
```bibtex
@misc{vonwerra2022trl,
title = {{TRL: Transformer Reinforcement Learning}},
author = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallou{\'e}dec},
year = 2020,
journal = {GitHub repository},
publisher = {GitHub},
howpublished = {\url{https://github.com/huggingface/trl}}
}
``` |