Instructions to use gradientdegen/task-10-Qwen-Qwen4-1KB-Instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use gradientdegen/task-10-Qwen-Qwen4-1KB-Instruct with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-7B-Instruct") model = PeftModel.from_pretrained(base_model, "gradientdegen/task-10-Qwen-Qwen4-1KB-Instruct") - Notebooks
- Google Colab
- Kaggle
Upload folder using huggingface_hub
Browse files- adapter_config.json +2 -2
- adapter_model.safetensors +1 -1
- training_args.bin +1 -1
adapter_config.json
CHANGED
|
@@ -22,9 +22,9 @@
|
|
| 22 |
"target_modules": [
|
| 23 |
"down_proj",
|
| 24 |
"qkv_proj",
|
|
|
|
| 25 |
"gate_proj",
|
| 26 |
-
"o_proj"
|
| 27 |
-
"up_proj"
|
| 28 |
],
|
| 29 |
"task_type": "CAUSAL_LM",
|
| 30 |
"use_dora": false,
|
|
|
|
| 22 |
"target_modules": [
|
| 23 |
"down_proj",
|
| 24 |
"qkv_proj",
|
| 25 |
+
"up_proj",
|
| 26 |
"gate_proj",
|
| 27 |
+
"o_proj"
|
|
|
|
| 28 |
],
|
| 29 |
"task_type": "CAUSAL_LM",
|
| 30 |
"use_dora": false,
|
adapter_model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 1205630632
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b2b565d50b64f316872cef8a87a9d134a6e2dca77645747ccb9a7fc9219845fa
|
| 3 |
size 1205630632
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5560
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4b44feb759ca81f2e570615e42d3eec3ac9aeb30ed72a590d3a30548e0617e5a
|
| 3 |
size 5560
|