Instructions to use JunHowie/Fin-R1-GPTQ-Int4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use JunHowie/Fin-R1-GPTQ-Int4 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="JunHowie/Fin-R1-GPTQ-Int4")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("JunHowie/Fin-R1-GPTQ-Int4") model = AutoModel.from_pretrained("JunHowie/Fin-R1-GPTQ-Int4", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download model.safetensors from JunHowie/Fin-R1-GPTQ-Int4: direct link, hf CLI and curl.
- Browser
- Download file 4.49 GB
-
https://huggingface.co/JunHowie/Fin-R1-GPTQ-Int4/resolve/main/model.safetensors
- Command line
-
hf download hf://JunHowie/Fin-R1-GPTQ-Int4/model.safetensors
-
curl -L -o model.safetensors https://huggingface.co/JunHowie/Fin-R1-GPTQ-Int4/resolve/main/model.safetensors
4.49 GB
- Xet hash:
- 390cd1d8a089dfa4bdfa72f7f70b717f1b8447296df1d9fa9195fb85e808c714
- Size of remote file:
- 4.49 GB
- SHA256:
- a731d96185592470106496281d7b04dac08cf719c7fcf4c357816a73afa05f47
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.