Instructions to use hakurei/lit-6B-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use hakurei/lit-6B-8bit with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("hakurei/lit-6B-8bit", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
a
6761845
-
thumb
9088155
-
Add modelcard
e2e9d5b -
Delete README.md
bf1e105
-
Merge branch 'main' of https://huggingface.co/hakurei/lit-6B-8bit
b89625c -
Add weights
bc9a0ac -
Add modelcard
4bbd662 -
Add modelcard
48ebe45 -
initial commit
ae5d4d9