Instructions to use hipfire-models/carnice-9b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- HERMES
How to use hipfire-models/carnice-9b with HERMES:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Commit History
-
Upload carnice-9b.mq6 with huggingface_hub
Verified signature28018dc
-
Add MQ4 (MagnumQuant FWHT-rotated 4-bit) quantization
Verified signaturefc383b3
-
Add README
Verified signature087a105 -
Add Carnice-9B HF6 (hipfire 6-bit)
Verified signatureb0412da -
Add Carnice-9B HF4 (hipfire 4-bit)
Verified signaturebaa9329 -
initial commit
Verified signature0abc496