Instructions to use thoddnn/chat-adapter with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use thoddnn/chat-adapter with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download thoddnn/chat-adapter --local-dir chat-adapter
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Download adapter_config.json from thoddnn/chat-adapter: direct link, hf CLI and curl.
- Browser
- Download file 132 Bytes
-
https://huggingface.co/thoddnn/chat-adapter/resolve/main/adapter_config.json
- Command line
-
hf download hf://thoddnn/chat-adapter/adapter_config.json
-
curl -L -o adapter_config.json https://huggingface.co/thoddnn/chat-adapter/resolve/main/adapter_config.json
132 Bytes
| { | |
| "fine_tune_type": "lora", | |
| "num_layers": 4, | |
| "lora_parameters": { | |
| "rank": 16, | |
| "scale": 16.0, | |
| "dropout": 0.0 | |
| } | |
| } | |