2stacks commited on
Commit
47adc19
·
verified ·
1 Parent(s): 9851af8

Add v2 model card (final loss 3.8498)

Browse files
Files changed (1) hide show
  1. README.md +69 -13
README.md CHANGED
@@ -1,21 +1,77 @@
1
  ---
2
- base_model: unsloth/gemma-3-4b-it-unsloth-bnb-4bit
 
 
 
3
  tags:
4
- - text-generation-inference
5
- - transformers
6
- - unsloth
7
- - gemma3
8
- license: apache-2.0
 
9
  language:
10
- - en
11
  ---
12
 
13
- # Uploaded finetuned model
14
 
15
- - **Developed by:** 2stacks
16
- - **License:** apache-2.0
17
- - **Finetuned from model :** unsloth/gemma-3-4b-it-unsloth-bnb-4bit
 
18
 
19
- This gemma3 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
 
20
 
21
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: cc-by-nc-4.0
3
+ base_model: unsloth/gemma-3-4b-it
4
+ datasets:
5
+ - 2stacks/comedy-style-instruct
6
  tags:
7
+ - qlora
8
+ - unsloth
9
+ - gemma-3
10
+ - humor
11
+ - comedy
12
+ - style-transfer
13
  language:
14
+ - en
15
  ---
16
 
17
+ # gemma3-4b-it-comedy-v2
18
 
19
+ QLoRA fine-tune of `unsloth/gemma-3-4b-it` on
20
+ [`2stacks/comedy-style-instruct`](https://huggingface.co/datasets/2stacks/comedy-style-instruct)
21
+ (316 examples: 120 verbatim H/A/J + 96 30-comedian variety + 100
22
+ in-the-style-of originals).
23
 
24
+ This model is trained to respond to user prompts with stand-up-style jokes,
25
+ with a particular emphasis on the voices of **Mitch Hedberg**, **Dave Attell**,
26
+ and **Anthony Jeselnik**. Style coverage extends to 30 additional comedians
27
+ via the variety set.
28
 
29
+ ## Training
30
+
31
+ | | |
32
+ |---|---|
33
+ | Base | `unsloth/gemma-3-4b-it` |
34
+ | Method | QLoRA r=64, alpha=128, dropout 0 |
35
+ | Targets | q,k,v,o,gate,up,down |
36
+ | Schedule | 6 epochs, lr 0.0001, cosine, warmup 5 |
37
+ | Batch | 2×4 effective 8 |
38
+ | Seq len | 1024 |
39
+ | Hardware | 1×H100 on Modal |
40
+ | Final loss | 3.8498 |
41
+
42
+ W&B: `gemma3-comedy-qlora` / run `gemma3-4b-it-r64-a128-6ep-316ex-v2`.
43
+
44
+ ## Files
45
+ - LoRA adapter (peft format)
46
+ - `*.safetensors` — merged 16-bit
47
+ - `*.Q4_K_M.gguf` — llama.cpp / Ollama format
48
+
49
+ ## Use
50
+
51
+ ```python
52
+ from transformers import AutoModelForCausalLM, AutoTokenizer
53
+ m = AutoModelForCausalLM.from_pretrained("2stacks/gemma3-4b-it-comedy-v2")
54
+ t = AutoTokenizer.from_pretrained("2stacks/gemma3-4b-it-comedy-v2")
55
+ ```
56
+
57
+ Or in Ollama via the GGUF artifact.
58
+
59
+ ## Caveats
60
+
61
+ - **Joke-by-default.** This model trades general helpfulness for comedic
62
+ voice. Use it for jokes; use the base model for tasks.
63
+ - **Dark humor over-represented.** Jeselnik / Attell / Stanhope material
64
+ pushes the distribution toward edgier output. Expect the model to take
65
+ dark turns even on innocent prompts.
66
+ - **Non-commercial license.** Per the underlying dataset, this model is
67
+ CC-BY-NC-4.0 — research, education, and personal use only.
68
+
69
+ ## Attribution
70
+
71
+ The training data is sourced from publicly-available stand-up material
72
+ released by 33 working comedians. Per-special and per-comedian attribution
73
+ tables are maintained on the
74
+ [dataset card](https://huggingface.co/datasets/2stacks/comedy-style-instruct).
75
+
76
+ If you enjoy the voices this model imitates, please support those comedians
77
+ by buying or streaming their specials directly.