coderecode95 commited on
Commit
cca00cc
ยท
verified ยท
1 Parent(s): 96de600

Upload folder using huggingface_hub

Browse files
Files changed (8) hide show
  1. README.md +266 -23
  2. TRAINING.md +5 -1
  3. config.json +10 -0
  4. judge.py +225 -27
  5. judge_pipeline.py +52 -0
  6. quickstart.ipynb +204 -0
  7. space/README.md +31 -0
  8. space/index.html +801 -0
README.md CHANGED
@@ -68,34 +68,276 @@ model-index:
68
  ## ๋น ๋ฅด๊ฒŒ ์‹œ์ž‘ํ•˜๊ธฐ
69
 
70
  ```bash
71
- pip install torch "transformers>=5" accelerate huggingface_hub
72
  ```
73
 
74
- ์ด ์ €์žฅ์†Œ์˜ [`judge.py`](judge.py)๋ฅผ ๋‚ด๋ ค๋ฐ›์•„ ์“ฐ๋Š” ๊ฒƒ์ด ๊ฐ€์žฅ ๊ฐ„๋‹จํ•ฉ๋‹ˆ๋‹ค (ํ•™์Šตยทํ‰๊ฐ€์™€ ๊ฐ™์€ ํ”„๋กฌํ”„ํŠธ, ์˜จ๋„ ๋ณด์ •, ๋ฌถ์Œ ํŒ์ • ํฌํ•จ).
 
 
 
 
 
 
 
75
 
76
  ```python
77
- import os, sys
78
- from huggingface_hub import hf_hub_download
79
- sys.path.insert(0, os.path.dirname(hf_hub_download("coderecode95/KJH-Judge-4B-ko", "judge.py")))
80
- from judge import Judge
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
81
 
82
- j = Judge("coderecode95/KJH-Judge-4B-ko") # GPU๊ฐ€ ์žˆ์œผ๋ฉด bf16, ์—†์œผ๋ฉด CPU fp32
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
83
 
84
- j.decide("๋ฌธ์žฅ์˜ ์ „๋ฐ˜์ ์ธ ๊ฐ์ • ๊ทน์„ฑ์„ ํŒ๋‹จํ•œ๋‹ค. ๋ถ€์ • ํ‘œํ˜„๊ณผ ๋ฐ˜์–ด๋ฅผ ๊ณ ๋ คํ•œ๋‹ค.",
85
- {"text": "๋ฐฐ์†ก์€ ๋А๋ ธ์ง€๋งŒ ๋ฌผ๊ฑด์€ ์ •๋ง ๋งˆ์Œ์— ๋“ค์–ด์š”"},
86
- ["๊ธ์ •์  ๊ฐ์ •", "๋ถ€์ •์  ๊ฐ์ •"])
87
- # {'choice': 'A', 'index': 0, 'text': '๊ธ์ •์  ๊ฐ์ •', 'confidence': 0.9โ€ฆ, 'probs': {'A': 0.9โ€ฆ, 'B': 0.0โ€ฆ}}
88
 
89
- # ์—ฌ๋Ÿฌ ๊ฐœ๋ฅผ ํ•œ ๋ฒˆ์— (GPU์—์„œ ๋ฌถ์–ด ๊ณ„์‚ฐ)
90
- j.decide_batch([
91
- {"instruction": "ํ•œ๊ตญ์–ด ๋‰ด์Šค ์ œ๋ชฉ์˜ ์ค‘์‹ฌ ์ฃผ์ œ๋ฅผ ๊ณ ๋ฅธ๋‹ค.", "item": {"headline": "์†ํฅ๋ฏผ, ์‹œ์ฆŒ 10ํ˜ธ๊ณจ"},
92
- "choices": ["์‚ฌํšŒ", "IT๊ณผํ•™", "์„ธ๊ณ„", "์ƒํ™œ๋ฌธํ™”", "์ •์น˜", "์Šคํฌ์ธ ", "๊ฒฝ์ œ"]},
93
- {"instruction": "์ „์ œ๋ฅผ ์ฐธ์ด๋ผ๊ณ  ํ•  ๋•Œ ๊ฐ€์„ค์„ ๋ถ„๋ฅ˜ํ•œ๋‹ค.", "item": {"premise": "๋ณด์ฆ๊ธˆ์€ ํ‡ด๊ฑฐ ํ›„ 30์ผ ์ด๋‚ด ๋ฐ˜ํ™˜ํ•œ๋‹ค.", "hypothesis": "๋ณด์ฆ๊ธˆ์€ ํ‡ด๊ฑฐ ๋‹น์ผ ๋Œ๋ ค๋ฐ›๋Š”๋‹ค."},
94
- "choices": ["entailment", "contradiction", "neutral"]},
95
- ])
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
96
  ```
97
 
98
- ### judge.py ์—†์ด transformers๋งŒ์œผ๋กœ
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
99
 
100
  ```python
101
  import torch, json
@@ -126,13 +368,13 @@ print({c: round(p, 4) for c, p in zip(choices, probs.tolist())})
126
 
127
  ```
128
  <|im_start|>user
129
- {๊ณผ์ œ ์„ค๋ช…}
130
 
131
- {ํ•ญ๋ชฉ ์ด๋ฆ„}: {๊ฐ’} โ† ํ•ญ๋ชฉ๋งˆ๋‹ค ํ•œ ์ค„. ๊ฐ’์ด ๋ฌธ์ž์—ด์ด ์•„๋‹ˆ๋ฉด JSON
132
  {ํ•ญ๋ชฉ ์ด๋ฆ„}: {๊ฐ’}
133
 
134
  ๋ณด๊ธฐ:
135
- A. {๋ณด๊ธฐ 1}
136
  B. {๋ณด๊ธฐ 2}
137
  โ€ฆ
138
 
@@ -140,6 +382,7 @@ B. {๋ณด๊ธฐ 2}
140
  <|im_start|>assistant
141
  ```
142
 
 
143
  - ๋ณด๊ธฐ๋Š” 2~26๊ฐœ์ž…๋‹ˆ๋‹ค.
144
  - ๊ณผ์ œ ์„ค๋ช…์€ ์งง๊ณ  ๊ตฌ์ฒด์ ์œผ๋กœ ์“ฐ์„ธ์š”. ํŒ๋‹จ ๊ธฐ์ค€์„ ํ•œ๋‘ ๋ฌธ์žฅ ๋ง๋ถ™์ด๋ฉด(์˜ˆ: โ€œ๋ฐ˜์–ด๋ฅผ ๊ณ ๋ คํ•œ๋‹คโ€, โ€œ์ •๋ณด๊ฐ€ ์—†๋‹ค๋Š” ์ด์œ ๋งŒ์œผ๋กœ ๋ชจ์ˆœ์„ ๊ณ ๋ฅด์ง€ ์•Š๋Š”๋‹คโ€) ์ •ํ™•๋„๊ฐ€ ํฌ๊ฒŒ ์˜ค๋ฆ…๋‹ˆ๋‹ค.
145
  - `generate()`๋กœ ์“ธ ๊ฒฝ์šฐ `max_new_tokens=1`๋กœ ๋ณด๊ธฐ ๊ธฐํ˜ธ ํ•˜๋‚˜๋งŒ ๋ฐ›์œผ์„ธ์š” (์ด ์ €์žฅ์†Œ์˜ `generation_config.json`์€ `do_sample: false`์ž…๋‹ˆ๋‹ค). ํ™•๋ฅ ์ด ํ•„์š”ํ•˜๋ฉด ์œ„์ฒ˜๋Ÿผ logits๋ฅผ ์ฝ์œผ์„ธ์š”.
@@ -208,7 +451,7 @@ B. {๋ณด๊ธฐ 2}
208
  | ๋™์‹œ 4๊ฐœ์”ฉ ๋ณด๋ƒˆ์„ ๋•Œ ์ฒ˜๋ฆฌ๋Ÿ‰ | 3.9๊ฑด/์ดˆ | **9.9๊ฑด/์ดˆ** |
209
  | ์ƒ๊ฐ์„ ์ผœ๊ณ  ๋‹ต์„ ์ƒ์„ฑํ•  ๋•Œ | | 6.3์ดˆ |
210
 
211
- - ๋™์‹œ ์ฒ˜๋ฆฌ๋Ÿ‰์€ ๋น„๊ต ๋ชจ๋ธ์ด ์•ž์„ฐ์Šต๋‹ˆ๋‹ค. ๋น„๊ต ๋ชจ๋ธ์€ ์š”์ฒญ์„ ๋ฌถ์–ด ์ฒ˜๋ฆฌํ•˜๋Š” ์„œ๋น™ ์—”์ง„์—์„œ, ์ด ๋ชจ๋ธ์€ ํ•˜๋‚˜์”ฉ ์ฒ˜๋ฆฌํ•˜๋Š” ๋‹จ์ˆœํ•œ ์„œ๋ฒ„์—์„œ ๋Œ์•˜๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค. ๋Œ€๋Ÿ‰ ์ฒ˜๋ฆฌ์—๋Š” [`judge.py`](judge.py)์˜ `decide_batch`๋ฅผ ์“ฐ์„ธ์š”.
212
  - CPU(๋…ธํŠธ๋ถ, fp32)์—์„œ๋Š” ํŒ์ • ํ•œ ๋ฒˆ์— 6์ดˆ์—์„œ ์ˆ˜ ๋ถ„์ด ๊ฑธ๋ ค ์‹ค์‚ฌ์šฉ์ด ์–ด๋ ต์Šต๋‹ˆ๋‹ค.
213
 
214
  ## ์ž˜ํ•˜๋Š” ๊ฒƒ๊ณผ ๋ชปํ•˜๋Š” ๊ฒƒ
 
68
  ## ๋น ๋ฅด๊ฒŒ ์‹œ์ž‘ํ•˜๊ธฐ
69
 
70
  ```bash
71
+ pip install torch "transformers>=5" accelerate
72
  ```
73
 
74
+ ```python
75
+ from transformers import pipeline
76
+
77
+ judge = pipeline(model="coderecode95/KJH-Judge-4B-ko", trust_remote_code=True,
78
+ device=0, dtype="bfloat16") # GPU๊ฐ€ ์—†์œผ๋ฉด device, dtype ๋ฅผ ๋นผ์„ธ์š” (๋งค์šฐ ๋А๋ฆผ)
79
+ ```
80
+
81
+ ์“ฐ๋Š” ๋ฐฉ๋ฒ•์€ ์„ธ ๊ฐ€์ง€์ด๊ณ , **๊ฒฐ๊ณผ๋Š” ๋ชจ๋‘ ๊ฐ™์€ ๋ชจ์–‘**์ž…๋‹ˆ๋‹ค.
82
 
83
  ```python
84
+ {'choice': '๊ธ์ •', 'confidence': 0.97, 'probabilities': {'๊ธ์ •': 0.97, '๋ถ€์ •': 0.03}}
85
+ # ๊ณ ๋ฅธ ๋ณด๊ธฐ ๊ทธ ๋ณด๊ธฐ์˜ ํ™•๋ฅ (๋ณด์ •๋จ) ๋ณด๊ธฐ๋ณ„ ํ™•๋ฅ 
86
+ ```
87
+
88
+ #### 1. ์ž์ฃผ ์“ฐ๋Š” ํŒ์ • โ€” ๋ฉ”์„œ๋“œ ํ•˜๋‚˜๋กœ
89
+
90
+ ํ•™์Šต ๋•Œ์™€ ๊ฐ™์€ ์ง€์นจยท๋ณด๊ธฐ ๋ฌธ๊ตฌ๊ฐ€ ์ž๋™์œผ๋กœ ๋“ค์–ด๊ฐ€์„œ, ๋”ฐ๋กœ ํ”„๋กฌํ”„ํŠธ๋ฅผ ์“ธ ํ•„์š”๊ฐ€ ์—†๊ณ  ์ •ํ™•๋„๋„ ๊ฐ€์žฅ ์ž˜ ๋‚˜์˜ต๋‹ˆ๋‹ค.
91
+
92
+ ```python
93
+ judge.sentiment("๋ฐฐ์†ก์€ ๋А๋ ธ์ง€๋งŒ ๋ฌผ๊ฑด์€ ์ •๋ง ๋งˆ์Œ์— ๋“ค์–ด์š”") # โ†’ ๊ธ์ •
94
+ judge.nli("๋ณด์ฆ๊ธˆ์€ ํ‡ด๊ฑฐ ํ›„ 30์ผ ์ด๋‚ด ๋ฐ˜ํ™˜ํ•œ๋‹ค.", "๋ณด์ฆ๊ธˆ์€ ํ‡ด๊ฑฐ 40์ผ ๋’ค์— ๋ฐ›๋Š”๋‹ค.") # โ†’ contradiction
95
+ judge.next_action("๊ฐ•๋‚จ์—ญ์—์„œ ์„œ์šธ์—ญ๊นŒ์ง€ ํƒ์‹œ ๋ถˆ๋Ÿฌ์ค˜", tools) # โ†’ CALL:call_taxi
96
+ ```
97
+
98
+ | ๋ฉ”์„œ๋“œ | ํŒ์ • | ๊ณ ๋ฅด๋Š” ๊ฐ’ |
99
+ |---|---|---|
100
+ | `sentiment(๋ฌธ์žฅ)` | ๊ฐ์ • | ๊ธ์ • / ๋ถ€์ • |
101
+ | `topic(๋‰ด์Šค ์ œ๋ชฉ)` | ๋‰ด์Šค ์ฃผ์ œ | ์‚ฌํšŒ / IT๊ณผํ•™ / ์„ธ๊ณ„ / ์ƒํ™œ๋ฌธํ™” / ์ •์น˜ / ์Šคํฌ์ธ  / ๊ฒฝ์ œ |
102
+ | `hate(๋ฌธ์žฅ)` | ํ˜์˜คยท๋น„ํ•˜ ํ‘œํ˜„ | ๋น„ํ˜์˜ค / ํ˜์˜ค |
103
+ | `offensive(๋Œ“๊ธ€, news_title=None)` | ๋Œ“๊ธ€ ๊ณต๊ฒฉ์„ฑ 3๋‹จ๊ณ„ | ์—†์Œ / ๊ณต๊ฒฉ์  / ํ˜์˜ค |
104
+ | `nli(์ „์ œ, ๊ฐ€์„ค)` | ๋ฌธ์žฅ ๊ด€๊ณ„ | entailment / contradiction / neutral |
105
+ | `similar(๋ฌธ์žฅ1, ๋ฌธ์žฅ2)` | ๊ฐ™์€ ๋œป์ธ์ง€ | ๊ฐ™์Œ / ๋‹ค๋ฆ„ |
106
+ | `yes_no(์งˆ๋ฌธ, ์ง€๋ฌธ)` | ์ง€๋ฌธ ๊ทผ๊ฑฐ ์˜ˆ/์•„๋‹ˆ์˜ค | ์˜ˆ / ์•„๋‹ˆ์˜ค |
107
+ | `same_meaning(๋‹จ์–ด, ๋ฌธ๋งฅ1, ๋ฌธ๋งฅ2)` | ๋‹จ์–ด ๋œป์ด ๊ฐ™์€์ง€ | ๊ฐ™์Œ / ๋‹ค๋ฆ„ |
108
+ | `reading(์ง€๋ฌธ, ์งˆ๋ฌธ, ๋ณด๊ธฐ)` | ๋…ํ•ด ๊ฐ๊ด€์‹ | ๋ณด๊ธฐ ์ค‘ ํ•˜๋‚˜ |
109
+ | `next_action(๋Œ€ํ™”, ๋„๊ตฌ ๋ชฉ๋ก)` | ์—์ด์ „ํŠธ ๋‹ค์Œ ํ–‰๋™ | CALL:<๋„๊ตฌ> / ASK / RESPOND |
110
+ | `policy_action(์ •์ฑ…, ๊ณ ๊ฐ ์š”์ฒญ)` | ์ •์ฑ…์— ๋”ฐ๋ฅธ ํ–‰๋™ | ANSWER / ASK_CLARIFICATION / ASK_CONFIRMATION / CALL_TOOL / CALL_MULTIPLE_TOOLS / ESCALATE / REFUSE |
111
+
112
+ ๋ฌธ์žฅ ํ•˜๋‚˜๋งŒ ๋ฐ›๋Š” ๋ฉ”์„œ๋“œ(`sentiment`, `topic`, `hate`, `nli` ๋“ฑ)๋Š” **๋ฆฌ์ŠคํŠธ๋ฅผ ๋„ฃ์œผ๋ฉด ์—ฌ๋Ÿฌ ๊ฐœ๋ฅผ ํ•œ ๋ฒˆ์—** ํŒ์ •ํ•ฉ๋‹ˆ๋‹ค.
113
+
114
+ #### 2. ๋‚ด ํŒ์ • ๋งŒ๋“ค๊ธฐ โ€” JEV ํ˜•์‹
115
+
116
+ [Korean JEV Benchmark](https://huggingface.co/datasets/DaehanKim/korean-jev-benchmark)ยทJEV API์™€ ๊ฐ™์€ ๋ชจ์–‘์ž…๋‹ˆ๋‹ค. **์ƒํ™ฉ(`state`) ํ•˜๋‚˜์— ์ด๋ฆ„ ๋ถ™์ธ ์งˆ๋ฌธ ์—ฌ๋Ÿฌ ๊ฐœ**๋ฅผ ํ•œ ๋ฒˆ์— ๋ฌป๊ณ , ๋ณด๊ธฐ์—๋Š” **๋‚ด๊ฐ€ ์“ธ ID**๋ฅผ ๋ถ™์ž…๋‹ˆ๋‹ค. ๊ฒฐ๊ณผ๋Š” ๊ทธ ID๋กœ ๋Œ์•„์˜ต๋‹ˆ๋‹ค.
117
+
118
+ ```python
119
+ judge.decide(
120
+ state={"๊ณ ๊ฐ ๋ฌธ์˜": "์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”. ์˜ค๋Š˜ ์•ˆ์— ์ฒ˜๋ฆฌํ•ด ์ฃผ์„ธ์š”."},
121
+ questions={
122
+ "๋ถ€์„œ": {
123
+ "instructions": "๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.",
124
+ "criteria": {"billing": "๊ฒฐ์ œยทํ™˜๋ถˆ", "delivery": "๋ฐฐ์†ก", "account": "๊ณ„์ •ยท๋กœ๊ทธ์ธ"},
125
+ },
126
+ "๊ธด๊ธ‰": {
127
+ "instructions": "๊ณ ๊ฐ์ด ์ฆ‰์‹œ ์ฒ˜๋ฆฌ๋ฅผ ์š”๊ตฌํ•˜๋Š”์ง€ ํŒ๋‹จํ•œ๋‹ค.",
128
+ "criteria": {"urgent": "์ฆ‰์‹œ ์ฒ˜๋ฆฌ ์š”๊ตฌ", "normal": "์ผ๋ฐ˜ ๋ฌธ์˜"},
129
+ },
130
+ },
131
+ )
132
+ # {'๋ถ€์„œ': {'choice': 'billing', 'confidence': 0.9โ€ฆ, 'probabilities': {...}},
133
+ # '๊ธด๊ธ‰': {'choice': 'urgent', 'confidence': 0.9โ€ฆ, 'probabilities': {...}}}
134
+ ```
135
+
136
+ - **`state`**: ํŒ๋‹จํ•  ๋‚ด์šฉ. `{"์ด๋ฆ„": ๊ฐ’}`์ด ํ”„๋กฌํ”„ํŠธ์— ํ•œ ์ค„์”ฉ ๋“ค์–ด๊ฐ‘๋‹ˆ๋‹ค. ๋ฌธ์žฅ ํ•˜๋‚˜๋ฉด ๊ทธ๋ƒฅ ๋ฌธ์ž์—ด๋กœ ๋„ฃ์–ด๋„ ๋ฉ๋‹ˆ๋‹ค.
137
+ - **`instructions`**: ๋ฌด์—‡์„ ์–ด๋–ค ๊ธฐ์ค€์œผ๋กœ ๊ณ ๋ฅผ์ง€. ํŒ๋‹จ ๊ธฐ์ค€์„ ํ•œ๋‘ ๋ฌธ์žฅ ๋ง๋ถ™์ด๋ฉด(์˜ˆ: โ€œ๋ฐ˜์–ด๋ฅผ ๊ณ ๋ คํ•œ๋‹คโ€) ์ •ํ™•๋„๊ฐ€ ํฌ๊ฒŒ ์˜ค๋ฆ…๋‹ˆ๋‹ค.
138
+ - **`criteria`**: `{ID: ์„ค๋ช…}`, 2~26๊ฐœ. ID๋Š” ๊ฒฐ๊ณผ๋กœ ๋Œ๋ ค๋ฐ›๋Š” ๊ฐ’์ด๊ณ , ๋ชจ๋ธ์€ ์„ค๋ช…์„ ๋ณด๊ณ  ๊ณ ๋ฆ…๋‹ˆ๋‹ค. ID๊ฐ€ ํ•„์š” ์—†์œผ๋ฉด `["๊ฒฐ์ œยทํ™˜๋ถˆ", "๋ฐฐ์†ก"]`์ฒ˜๋Ÿผ ๋ฆฌ์ŠคํŠธ๋กœ ๋„ฃ์–ด๋„ ๋ฉ๋‹ˆ๋‹ค.
139
+
140
+ #### 3. ํ•œ ์ค„๋กœ
141
+
142
+ ```python
143
+ judge("์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”", choices=["๊ฒฐ์ œยทํ™˜๋ถˆ", "๋ฐฐ์†ก", "๊ธฐํƒ€"],
144
+ instruction="๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.")
145
+ ```
146
+
147
+ `judge.decide`์—์„œ ์งˆ๋ฌธ์ด ํ•˜๋‚˜์ผ ๋•Œ์™€ ๊ฐ™์Šต๋‹ˆ๋‹ค. ๋ฆฌ์ŠคํŠธ๋ฅผ ๋„ฃ๊ณ  `batch_size=8`์ฒ˜๋Ÿผ ์ฃผ๋ฉด ๋ฌถ์–ด์„œ ๊ณ„์‚ฐํ•ฉ๋‹ˆ๋‹ค.
148
+
149
+ ---
150
+
151
+ `trust_remote_code=True`๋Š” ์ด ์ €์žฅ์†Œ์˜ [`judge_pipeline.py`](judge_pipeline.py)์™€ [`judge.py`](judge.py)(ํ”„๋กฌํ”„ํŠธ ๋งŒ๋“ค๊ธฐ์™€ ๋ณด๏ฟฝ๏ฟฝ๏ฟฝ ์ ์ˆ˜ ๊ณ„์‚ฐ)๋ฅผ ์‹คํ–‰ํ•œ๋‹ค๋Š” ๋œป์ž…๋‹ˆ๋‹ค. ์›๊ฒฉ ์ฝ”๋“œ๋ฅผ ์“ฐ๊ณ  ์‹ถ์ง€ ์•Š์œผ๋ฉด `judge.py`๋ฅผ ๋‚ด๋ ค๋ฐ›์•„ `from judge import Judge; judge = Judge()`๋กœ ๋˜‘๊ฐ™์ด ์“ธ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. [`quickstart.ipynb`](quickstart.ipynb)์— ์˜ˆ์‹œ๋ฅผ ๋ชจ์•„ ๋‘์—ˆ์Šต๋‹ˆ๋‹ค.
152
+
153
+ ## ์‚ฌ์šฉ ์˜ˆ์‹œ
154
+
155
+ ์ด ๋ชจ๋ธ์€ **โ€œ๋ฌด์—‡์„ ํ• ์ง€โ€๋ฅผ ๋น ๋ฅด๊ฒŒ ์ •ํ•˜๋Š” ์•ž๋‹จ**์— ๋‘๋Š” ๊ฒƒ์ด ๊ฐ€์žฅ ์ž˜ ๋งž์Šต๋‹ˆ๋‹ค. ์ •ํ•ด์ง„ ๋ณด๊ธฐ ์ค‘ ํ•˜๋‚˜๋ฅผ ๊ณ ๋ฅด๋Š” ํŒ๋‹จ์€ ์ด ๋ชจ๋ธ์ด ํ•˜๊ณ , ๊ธ€ ์“ฐ๊ธฐ๋‚˜ ๊ฐ’ ์ฑ„์šฐ๊ธฐ์ฒ˜๋Ÿผ ์ƒ์„ฑ์ด ํ•„์š”ํ•œ ์ผ๋งŒ ํฐ ๋ชจ๋ธ์ด๋‚˜ ์‚ฌ๋žŒ์—๊ฒŒ ๋„˜๊ธฐ๋Š” ๊ตฌ์„ฑ์ž…๋‹ˆ๋‹ค. ์•„๋ž˜ ์˜ˆ์‹œ๋Š” ๋ชจ๋‘ ์œ„์—์„œ ๋งŒ๋“  `judge`๋กœ ๋ฐ”๋กœ ๋Œ์•„๊ฐ‘๋‹ˆ๋‹ค. ์ฃผ์„์— ์ ์€ ๊ฒฐ๊ณผ๋Š” ์˜๋„ํ•œ ์ •๋‹ต์ด๊ณ , ์‹ค์ œ ํ™•๋ฅ ์€ ์ง์ ‘ ์‹คํ–‰ํ•ด ํ™•์ธํ•˜์„ธ์š”.
156
+
157
+ ### 1. ๊ณ ๊ฐ ๋ฌธ์˜ ๋ถ„๋ฅ˜ โ€” ๋ถ€์„œ์™€ ๊ธด๊ธ‰๋„๋ฅผ ํ•œ ๋ฒˆ์—
158
+
159
+ ๋ฌธ์˜ ํ•˜๋‚˜๋ฅผ ์—ฌ๋Ÿฌ ๊ด€์ ์œผ๋กœ ๋™์‹œ์— ๋ถ„๋ฅ˜ํ•ฉ๋‹ˆ๋‹ค. ์งˆ๋ฌธ๋งˆ๋‹ค ๋ณด๊ธฐ ID๋ฅผ ์ •ํ•ด ๋‘๋ฉด ๊ฒฐ๊ณผ๋ฅผ ๋ฐ”๋กœ ์—…๋ฌด ์ฝ”๋“œ์— ์—ฐ๊ฒฐํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
160
+
161
+ ```python
162
+ def route_ticket(text):
163
+ r = judge.decide(
164
+ state={"๊ณ ๊ฐ ๋ฌธ์˜": text},
165
+ questions={
166
+ "๋ถ€์„œ": {
167
+ "instructions": "๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค. ์—ฌ๋Ÿฌ ๋‚ด์šฉ์ด ์„ž์—ฌ ์žˆ์œผ๋ฉด ๊ณ ๊ฐ์ด ํ•ด๊ฒฐ์„ ์›ํ•˜๋Š” ๋ฌธ์ œ๋ฅผ ์šฐ์„ ํ•œ๋‹ค.",
168
+ "criteria": {"billing": "๊ฒฐ์ œยทํ™˜๋ถˆ", "delivery": "๋ฐฐ์†ก", "account": "๊ณ„์ •ยท๋กœ๊ทธ์ธ",
169
+ "product": "์ œํ’ˆ ์‚ฌ์šฉยท๊ณ ์žฅ", "other": "๊ธฐํƒ€"},
170
+ },
171
+ "๊ธด๊ธ‰": {
172
+ "instructions": "๊ณ ๊ฐ์ด ์ฆ‰์‹œ ์ฒ˜๋ฆฌ๋ฅผ ์š”๊ตฌํ•˜๊ฑฐ๋‚˜ ๊ธˆ์ „ ํ”ผํ•ด๊ฐ€ ์ง„ํ–‰ ์ค‘์ธ์ง€ ํŒ๋‹จํ•œ๋‹ค.",
173
+ "criteria": {"urgent": "์ฆ‰์‹œ ์ฒ˜๋ฆฌ ํ•„์š”", "normal": "์ผ๋ฐ˜ ์ฒ˜๋ฆฌ"},
174
+ },
175
+ },
176
+ )
177
+ return r["๋ถ€์„œ"]["choice"], r["๊ธด๊ธ‰"]["choice"]
178
+
179
+ route_ticket("์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”. ์˜ค๋Š˜ ์•ˆ์— ํ™˜๋ถˆํ•ด ์ฃผ์„ธ์š”.") # ('billing', 'urgent')
180
+ ```
181
+
182
+ - ์ง€์นจ์— **ํ—ท๊ฐˆ๋ฆฌ๋Š” ๊ฒฝ์šฐ์˜ ๊ธฐ์ค€**์„ ํ•œ ๋ฌธ์žฅ ๋„ฃ์œผ๋ฉด(โ€œ์—ฌ๋Ÿฌ ๋‚ด์šฉ์ด ์„ž์—ฌ ์žˆ์œผ๋ฉด โ€ฆ์„ ์šฐ์„ ํ•œ๋‹คโ€) ์ •ํ™•๋„๊ฐ€ ์˜ค๋ฆ…๋‹ˆ๋‹ค.
183
+ - ๋ณด๊ธฐ์— `๊ธฐํƒ€`๋ฅผ ๋‘๋ฉด ์–ด๋””์—๋„ ์•ˆ ๋งž๋Š” ๋ฌธ์˜๋ฅผ ์–ต์ง€๋กœ ๋ผ์›Œ ๋„ฃ์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
184
+
185
+ ### 2. ๋ฆฌ๋ทฐ ๊ฐ์ • ๋ถ„์„ โ€” ๋Œ€๋Ÿ‰ ์ฒ˜๋ฆฌ์™€ ์‚ฌ๋žŒ ๊ฒ€ํ†  ๊ธฐ์ค€
186
+
187
+ ๋ฆฌ์ŠคํŠธ๋กœ ๋„ฃ์œผ๋ฉด ๋ฌถ์–ด์„œ ๊ณ„์‚ฐํ•ฉ๋‹ˆ๋‹ค. ํ™•์‹ ์ด ๋‚ฎ์€ ๊ฑด ๋”ฐ๋กœ ๋ชจ์•„ ์‚ฌ๋žŒ์ด ๋ด…๋‹ˆ๋‹ค.
188
+
189
+ ```python
190
+ reviews = ["๋ฐฐ์†ก ์ฐธ ๋น ๋ฅด๋„ค์š”. 2์ฃผ ๊ฑธ๋ ธ์–ด์š”", "๊ฐ€๊ฒฉ ๋Œ€๋น„ ๊ดœ์ฐฎ์•„์š”", "๋‹ค์‹œ๋Š” ์•ˆ ์‚ฝ๋‹ˆ๋‹ค", "๊ทธ๋ƒฅ ๊ทธ๋ž˜์š”"]
191
+ results = judge.sentiment(reviews)
192
+
193
+ auto = [(t, r["choice"]) for t, r in zip(reviews, results) if r["confidence"] >= 0.7]
194
+ review = [t for t, r in zip(reviews, results) if r["confidence"] < 0.7] # ์‚ฌ๋žŒ์ด ํ™•์ธ
195
+ ```
196
+
197
+ - **๋ฐ˜์–ดยท๋น„๊ผผ**(โ€œ๋ฐฐ์†ก ์ฐธ ๋น ๋ฅด๋„ค์š”. 2์ฃผ ๊ฑธ๋ ธ์–ด์š”โ€)์€ ๋†’์€ ํ™•์‹ ์œผ๋กœ ํ‹€๋ฆฌ๊ธฐ๋„ ํ•ฉ๋‹ˆ๋‹ค. ์ค‘์š”ํ•œ ๊ณณ์—๋Š” ํ‘œ๋ณธ์„ ์‚ฌ๋žŒ์ด ๋‹ค์‹œ ๋ณด์„ธ์š”.
198
+ - ๊ธฐ์ค€๊ฐ’ 0.7์€ ์˜ˆ์‹œ์ž…๋‹ˆ๋‹ค. ์‹ค์ œ ๋ฐ์ดํ„ฐ ์ˆ˜๋ฐฑ ๊ฑด์— ์ •๋‹ต์„ ๋‹ฌ์•„ ๋ณด๊ณ  โ€œ์ด ๊ธฐ์ค€ ์ด์ƒ์ด๋ฉด ๋ช‡ %๊ฐ€ ๋งž๋Š”์ง€โ€๋ฅผ ํ™•์ธํ•ด ์ •ํ•˜์„ธ์š”.
199
+
200
+ ### 3. ๋ฆฌ๋ทฐ๋ฅผ ์—ฌ๋Ÿฌ ์ธก๋ฉด์œผ๋กœ โ€” ๋ฐฐ์†กยทํ’ˆ์งˆยท๊ฐ€๊ฒฉ ๊ฐ๊ฐ
201
+
202
+ ํ•œ ๋ฆฌ๋ทฐ์—์„œ ์ธก๋ฉด๋ณ„๋กœ ๋”ฐ๋กœ ํŒ๋‹จํ•ฉ๋‹ˆ๋‹ค. ๊ฐ™์€ `state`์— ์งˆ๋ฌธ๋งŒ ๋Š˜๋ฆฌ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
203
 
204
+ ```python
205
+ ASPECT = {"pos": "๊ธ์ •์ ์œผ๋กœ ์–ธ๊ธ‰", "neg": "๋ถ€์ •์ ์œผ๋กœ ์–ธ๊ธ‰", "none": "์–ธ๊ธ‰ํ•˜์ง€ ์•Š์Œ"}
206
+
207
+ judge.decide(
208
+ state={"๋ฆฌ๋ทฐ": "๋ฐฐ์†ก์€ ํ•˜๋ฃจ ๋งŒ์— ์™”๋Š”๋ฐ ๋งˆ๊ฐ์ด ์—‰๋ง์ด๋„ค์š”. ์ด ๊ฐ€๊ฒฉ์ด๋ฉด ๊ทธ๋ƒฅ ๊ทธ๋ž˜์š”."},
209
+ questions={
210
+ "๋ฐฐ์†ก": {"instructions": "๋ฆฌ๋ทฐ๊ฐ€ ๋ฐฐ์†ก(์†๋„ยทํฌ์žฅ)์„ ์–ด๋–ป๊ฒŒ ์–ธ๊ธ‰ํ•˜๋Š”์ง€ ๊ณ ๋ฅธ๋‹ค.", "criteria": ASPECT},
211
+ "ํ’ˆ์งˆ": {"instructions": "๋ฆฌ๋ทฐ๊ฐ€ ์ œํ’ˆ ํ’ˆ์งˆ(๋งˆ๊ฐยท๋‚ด๊ตฌ์„ฑยท์„ฑ๋Šฅ)์„ ์–ด๋–ป๊ฒŒ ์–ธ๊ธ‰ํ•˜๋Š”์ง€ ๊ณ ๋ฅธ๋‹ค.", "criteria": ASPECT},
212
+ "๊ฐ€๊ฒฉ": {"instructions": "๋ฆฌ๋ทฐ๊ฐ€ ๊ฐ€๊ฒฉยท๊ฐ€์„ฑ๋น„๋ฅผ ์–ด๋–ป๊ฒŒ ์–ธ๊ธ‰ํ•˜๋Š”์ง€ ๊ณ ๋ฅธ๋‹ค. ์• ๋งคํ•œ ํ‰๊ฐ€๋Š” ์–ธ๊ธ‰ํ•œ ๊ฒƒ์œผ๋กœ ๋ณด๋˜ ๊ธ์ •ยท๋ถ€์ •์„ ๋ฌธ๋งฅ์œผ๋กœ ํŒ๋‹จํ•œ๋‹ค.", "criteria": ASPECT},
213
+ },
214
+ )
215
+ # {'๋ฐฐ์†ก': {'choice': 'pos', โ€ฆ}, 'ํ’ˆ์งˆ': {'choice': 'neg', โ€ฆ}, '๊ฐ€๊ฒฉ': {โ€ฆ}}
216
+ ```
217
+
218
+ ### 4. ๋Œ“๊ธ€ ๊ฒ€์ˆ˜ โ€” ํ˜์˜ค ์—ฌ๋ถ€์™€ ๊ณต๊ฒฉ์„ฑ ์ˆ˜์ค€
219
+
220
+ `hate`๋กœ ์ฐจ๋ณ„ยท๋น„ํ•˜ ์—ฌ๋ถ€๋ฅผ ๊ฑฐ๋ฅด๊ณ , `offensive`๋กœ ๊ณต๊ฒฉ์„ฑ ์ˆ˜์ค€์„ ๋‚˜๋ˆ•๋‹ˆ๋‹ค. ๊ธฐ์‚ฌ ๋Œ“๊ธ€์ด๋ฉด ์ œ๋ชฉ์„ ๋ฌธ๋งฅ์œผ๋กœ ํ•จ๊ป˜ ๋„ฃ์Šต๋‹ˆ๋‹ค.
221
+
222
+ ```python
223
+ comment = "์ด๋Ÿฐ ๊ธฐ์‚ฌ ์“ฐ๋Š” ๊ธฐ์ž๋Š” ๋จธ๋ฆฌ๊ฐ€ ์žˆ๋Š” ๊ฑด์ง€"
224
+
225
+ judge.hate(comment) # ๋น„ํ˜์˜ค / ํ˜์˜ค
226
+ judge.offensive(comment, news_title="์ •๋ถ€, ๋‚ด๋…„ ์˜ˆ์‚ฐ์•ˆ ๋ฐœํ‘œ") # ์—†์Œ / ๊ณต๊ฒฉ์  / ํ˜์˜ค
227
+ ```
228
+
229
+ - ๋‘ ๋ฉ”์„œ๋“œ๋Š” ๊ธฐ์ค€์ด ๋‹ค๋ฆ…๋‹ˆ๋‹ค. `hate`๋Š” ์„ฑ๋ณ„ยท๋‚˜์ดยท์ถœ์‹  ๊ฐ™์€ ์ง‘๋‹จ์— ๋Œ€ํ•œ ์ฐจ๋ณ„ยท๋น„ํ•˜(APEACH ๊ธฐ์ค€), `offensive`๋Š” ๊ฐœ์ธ์„ ํ–ฅํ•œ ๋ชจ์š•๊นŒ์ง€ ํฌํ•จํ•œ ๊ณต๊ฒฉ์„ฑ 3๋‹จ๊ณ„(BEEP ๊ธฐ์ค€)์ž…๋‹ˆ๋‹ค.
230
+ - ์‚ฌ๋žŒ์—๊ฒŒ ๋ถˆ์ด์ต์„ ์ฃผ๋Š” ๊ฒฐ์ •(์‚ญ์ œยท์ œ์žฌ)์— ์“ธ ๋•Œ๋Š” ํ™•์‹ ์ด ๋‚ฎ์€ ๊ฑด ๋ฐ˜๋“œ์‹œ ์‚ฌ๋žŒ์ด ๊ฒ€ํ† ํ•˜๊ฒŒ ํ•˜์„ธ์š”.
231
+
232
+ ### 5. ์—์ด์ „ํŠธ ๋ผ์šฐํ„ฐ โ€” ๋„๊ตฌ ํ˜ธ์ถœ / ๋˜๋ฌป๊ธฐ / ์ง์ ‘ ๋‹ต๋ณ€
233
+
234
+ ์—์ด์ „ํŠธ๊ฐ€ ๋งค ํ„ด ํฐ ๋ชจ๋ธ์— โ€œ๋‹ค์Œ์— ๋ญ˜ ํ• ์ง€โ€๋ฅผ ๋ฌป๋Š” ๋Œ€์‹ , ์ด ๋ชจ๋ธ์ด ๋จผ์ € ์ •ํ•ฉ๋‹ˆ๋‹ค. ๋„๊ตฌ ์ธ์ž ์ฑ„์šฐ๊ธฐ์™€ ๋‹ต๋ณ€ ์ž‘์„ฑ๋งŒ ํฐ ๋ชจ๋ธ์— ๋งก๊น๋‹ˆ๋‹ค.
235
+
236
+ ```python
237
+ tools = [
238
+ {"type": "function", "function": {"name": "call_taxi", "description": "ํƒ์‹œ๋ฅผ ํ˜ธ์ถœํ•œ๋‹ค",
239
+ "parameters": {"type": "object", "properties": {"pickup": {"type": "string"}, "destination": {"type": "string"}},
240
+ "required": ["pickup", "destination"]}}},
241
+ {"type": "function", "function": {"name": "get_weather", "description": "์ง€์—ญ์˜ ํ˜„์žฌ ๋‚ ์”จ๋ฅผ ์•Œ๋ ค์ค€๋‹ค",
242
+ "parameters": {"type": "object", "properties": {"city": {"type": "string"}}, "required": ["city"]}}},
243
+ ]
244
+ messages = [{"role": "user", "content": "๊ฐ•๋‚จ์—ญ์—์„œ ์„œ์šธ์—ญ๊นŒ์ง€ ํƒ์‹œ ๋ถˆ๋Ÿฌ์ค˜"}]
245
+
246
+ r = judge.next_action(messages, tools)
247
+ if r["confidence"] < 0.7:
248
+ action = "ํฐ ๋ชจ๋ธ์—๊ฒŒ ๋‹ค์Œ ํ–‰๋™์„ ๋งก๊น€"
249
+ elif r["choice"].startswith("CALL:"):
250
+ action = f"ํฐ ๋ชจ๋ธ๋กœ {r['choice'][5:]} ์˜ ์ธ์ž๋ฅผ ์ฑ„์›Œ ํ˜ธ์ถœ" # ์ด ๋ชจ๋ธ์€ ์ธ์ž๋ฅผ ์ฑ„์šฐ์ง€ ๋ชปํ•ฉ๋‹ˆ๋‹ค
251
+ elif r["choice"] == "ASK":
252
+ action = "๋น ์ง„ ํ•„์ˆ˜ ์ •๋ณด๋ฅผ ์‚ฌ์šฉ์ž์—๊ฒŒ ๋˜๋ฌป๊ธฐ"
253
+ else: # RESPOND
254
+ action = "๋„๊ตฌ ์—†์ด ๋ฐ”๋กœ ๋‹ต๋ณ€"
255
+ ```
256
+
257
+ - ๋„๊ตฌ๋Š” **OpenAI ํ˜•์‹ ๊ทธ๋Œ€๋กœ**, ํŠนํžˆ `required`๋ฅผ ๊ผญ ๋„ฃ์œผ์„ธ์š”. ์ด๋ฆ„๋งŒ ์ฃผ๋ฉด ํ•„์ˆ˜ ์ธ์ž๋ฅผ ๋ณผ ์ˆ˜ ์—†์–ด ASK์™€ CALL์„ ๊ตฌ๋ณ„ํ•˜์ง€ ๋ชปํ•ฉ๋‹ˆ๋‹ค.
258
+ - ๋Œ€ํ™” ๊ธฐ๋ก(์•ž ํ„ด, ๋„๊ตฌ ๊ฒฐ๊ณผ `{"role": "tool", โ€ฆ}`)์„ ํ•จ๊ป˜ ๋„ฃ์œผ๋ฉด โ€œ์ด๋ฏธ ์ฒ˜๋ฆฌ๋์œผ๋‹ˆ ๊ฒฐ๊ณผ ์•ˆ๋‚ด(RESPOND)โ€ ๊ฐ™์€ ํŒ๋‹จ๋„ ํ•ฉ๋‹ˆ๋‹ค.
259
+ - ๋„๊ตฌ๋Š” ์ตœ๋Œ€ 24๊ฐœ๊นŒ์ง€ ๋„ฃ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค (๋ณด๊ธฐ 26๊ฐœ ์ค‘ 2๊ฐœ๊ฐ€ ASKยทRESPOND).
260
+
261
+ ### 6. ์ •์ฑ…์— ๋”ฐ๋ฅธ ๊ณ ๊ฐ์„ผํ„ฐ ํ–‰๋™ ๊ฒฐ์ •
262
+
263
+ ์ •์ฑ… ๋ฌธ์„œ์™€ ๊ณ ๊ฐ ์š”์ฒญ์„ ์ฃผ๋ฉด ์‹คํ–‰ / ํ™•์ธ / ๋˜๋ฌป๊ธฐ / ์ด๊ด€ / ๊ฑฐ์ ˆ ์ค‘ ๋ฌด์—‡์„ ํ• ์ง€ ๊ณ ๋ฆ…๋‹ˆ๋‹ค. ์˜ˆ์™ธ ์กฐํ•ญ์ด ์ ์šฉ๋˜๋Š”์ง€๊นŒ์ง€ ๋”ฐ์ง‘๋‹ˆ๋‹ค.
264
+
265
+ ```python
266
+ policy = ("ํ•ด์™ธ ์นด๋“œ ์Šน์ธ ๊ธˆ์•ก์ด 100,000์› ์ด์ƒ์ด๋ฉด ๊ณ ๊ฐ์˜ ํ™•์ธ์„ ๋ฐ›์€ ํ›„์—๋งŒ ์‹คํ–‰ํ•œ๋‹ค. "
267
+ "๋‹ค๋งŒ VIP ๋“ฑ๊ธ‰ ๊ณ ๊ฐ์€ ํ™•์ธ ์—†์ด ๋ฐ”๋กœ ์‹คํ–‰ํ•œ๋‹ค.")
268
+
269
+ judge.policy_action(policy, "ํ™์ฝฉ์—์„œ ์นด๋“œ๋กœ 149,000์› ๊ฒฐ์ œํ•˜๋ ค๋Š”๋ฐ ์Šน์ธํ•ด์ค˜. ๋‚ด ๋“ฑ๊ธ‰์€ ์ผ๋ฐ˜์ด์•ผ.")
270
+ # โ†’ ASK_CONFIRMATION (๊ธˆ์•ก ๊ธฐ์ค€์„ ๋„˜์—ˆ๊ณ  VIP ์˜ˆ์™ธ๊ฐ€ ์•„๋‹˜)
271
+ ```
272
+
273
+ - ์ •์ฑ…์— **์ ํ˜€ ์žˆ๋Š” ๊ฒƒ๋งŒ** ๊ทผ๊ฑฐ๋กœ ํŒ๋‹จํ•˜๋„๋ก ํ•™์Šตํ–ˆ์Šต๋‹ˆ๋‹ค. ์‹ค์ œ ์—…๋ฌด ๊ทœ์ •์„ ๋ชจ๋ธ์ด ์•Œ์•„์„œ ๋ณด์ถฉํ•˜์ง€ ์•Š์œผ๋‹ˆ, ํ•„์š”ํ•œ ์กฐ๊ฑด์€ ์ •์ฑ… ๋ฌธ์žฅ์— ๋‹ค ์“ฐ์„ธ์š”.
274
+ - ๋ณด๊ธฐ: `ANSWER`, `ASK_CLARIFICATION`, `ASK_CONFIRMATION`, `CALL_TOOL`, `CALL_MULTIPLE_TOOLS`, `ESCALATE`, `REFUSE`.
275
 
276
+ ### 7. ๋‹ต๋ณ€์ด ๊ทผ๊ฑฐ ๋ฌธ์„œ์™€ ๋งž๋Š”์ง€ ํ™•์ธ (RAG ๊ฒ€์ฆ)
 
 
 
277
 
278
+ ๊ฒ€์ƒ‰ํ•œ ๋ฌธ์„œ๋ฅผ ์ „์ œ๋กœ, ์ƒ์„ฑ๋œ ๋‹ต๋ณ€์˜ ๋ฌธ์žฅ์„ ๊ฐ€์„ค๋กœ ๋„ฃ์Šต๋‹ˆ๋‹ค. `contradiction`์ด๋ฉด ๋ฌธ์„œ์™€ ์–ด๊ธ‹๋‚œ ๋‹ต์ด๊ณ , `neutral`์ด๋ฉด ๋ฌธ์„œ์— ๊ทผ๊ฑฐ๊ฐ€ ์—†๋Š” ๋‚ด์šฉ์ž…๋‹ˆ๋‹ค.
279
+
280
+ ```python
281
+ doc = "์ž„๋Œ€์ธ์€ ๊ณ„์•ฝ์ด ๋๋‚˜๊ณ  ์ž„์ฐจ์ธ์ด ์ง‘์„ ๋น„์šด ๋‚ ๋ถ€ํ„ฐ 30์ผ ์ด๋‚ด์— ๋ณด์ฆ๊ธˆ์„ ๋Œ๋ ค์ค€๋‹ค."
282
+ answer_sentences = ["๋ณด์ฆ๊ธˆ์€ ์ง‘์„ ๋น„์šด ๋’ค 30์ผ ์•ˆ์— ๋Œ๋ ค๋ฐ›์Šต๋‹ˆ๋‹ค.",
283
+ "๋ณด์ฆ๊ธˆ์€ ์ง‘์„ ๋น„์šด ๋’ค 40์ผ ๋’ค์— ๋Œ๋ ค๋ฐ›์Šต๋‹ˆ๋‹ค.",
284
+ "๋ณด์ฆ๊ธˆ์—๋Š” ์—ฐ 3% ์ด์ž๊ฐ€ ๋ถ™์Šต๋‹ˆ๋‹ค."]
285
+
286
+ for s, r in zip(answer_sentences, judge.nli([doc] * len(answer_sentences), answer_sentences)):
287
+ print(r["choice"], s)
288
+ # entailment โ€ฆ 30์ผ ์•ˆ์— โ€ฆ โ†’ ๊ทผ๊ฑฐ ์žˆ์Œ
289
+ # contradiction โ€ฆ 40์ผ ๋’ค์— โ€ฆ โ†’ ๋ฌธ์„œ์™€ ์–ด๊ธ‹๋‚จ
290
+ # neutral โ€ฆ ์—ฐ 3% ์ด์ž โ€ฆ โ†’ ๋ฌธ์„œ์— ๊ทผ๊ฑฐ ์—†์Œ
291
+ ```
292
+
293
+ - ๋‹ต๋ณ€์€ **๋ฌธ์žฅ ๋‹จ์œ„๋กœ ๋‚˜๋ˆ ** ๋„ฃ์œผ์„ธ์š”. ์—ฌ๋Ÿฌ ์ฃผ์žฅ์ด ์„ž์ธ ๊ธด ๋‹ต๋ณ€์€ ํŒ๋‹จ์ด ํ๋ ค์ง‘๋‹ˆ๋‹ค.
294
+ - ํ•™์Šต ์ตœ๋Œ€ ๊ธธ์ด๊ฐ€ 2,048ํ† ํฐ์ด๋ผ ๏ฟฝ๏ฟฝ ๋ฌธ์„œ๋Š” ๊ด€๋ จ ๋‹จ๋ฝ๋งŒ ์ž˜๋ผ ๋„ฃ์œผ์„ธ์š”.
295
+
296
+ ### 8. ์•ฝ๊ด€ยท๋ฌธ์„œ์— ๊ทผ๊ฑฐํ•œ ์˜ˆ/์•„๋‹ˆ์˜ค
297
+
298
+ ๋ฌธ์„œ๋ฅผ ์ฃผ๊ณ  ์งˆ๋ฌธ์— ์˜ˆ/์•„๋‹ˆ์˜ค๋กœ ๋‹ตํ•˜๊ฒŒ ํ•ฉ๋‹ˆ๋‹ค. ๋ฌธ์„œ์— ์—†๋Š” ์ƒ์‹์œผ๋กœ ๋‹ตํ•˜์ง€ ์•Š๋„๋ก ํ•™์Šตํ–ˆ์Šต๋‹ˆ๋‹ค.
299
+
300
+ ```python
301
+ terms = "๊ตฌ๋งค ํ›„ 7์ผ ์ด๋‚ด์—๋Š” ๋‹จ์ˆœ ๋ณ€์‹ฌ์œผ๋กœ๋„ ํ™˜๋ถˆํ•  ์ˆ˜ ์žˆ๋‹ค. ๋‹จ, ํฌ์žฅ์„ ๋œฏ์€ ์†Œํ”„ํŠธ์›จ์–ด๋Š” ํ™˜๋ถˆ ๋Œ€์ƒ์—์„œ ์ œ์™ธํ•œ๋‹ค."
302
+
303
+ judge.yes_no("ํฌ์žฅ์„ ๋œฏ์€ ๊ฒŒ์ž„ CD๋ฅผ 3์ผ ๋งŒ์— ํ™˜๋ถˆํ•  ์ˆ˜ ์žˆ๋‚˜์š”?", terms) # โ†’ ์•„๋‹ˆ์˜ค
304
+ judge.yes_no("๋œฏ์ง€ ์•Š์€ ํ‚ค๋ณด๋“œ๋ฅผ 5์ผ ๋งŒ์— ํ™˜๋ถˆํ•  ์ˆ˜ ์žˆ๋‚˜์š”?", terms) # โ†’ ์˜ˆ
305
+ ```
306
+
307
+ ### 9. ๋น„์Šทํ•œ ์งˆ๋ฌธ ์ฐพ๊ธฐ โ€” FAQ ์ค‘๋ณต ํ™•์ธ
308
+
309
+ ์ƒˆ๋กœ ๋“ค์–ด์˜จ ์งˆ๋ฌธ์ด ๊ธฐ์กด FAQ์™€ ๊ฐ™์€ ๋œป์ธ์ง€ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค. ํ›„๋ณด๋Š” ๊ฒ€์ƒ‰(์ž„๋ฒ ๋”ฉ ๋“ฑ)์œผ๋กœ ๋จผ์ € ์ขํžˆ๊ณ , ์ตœ์ข… ํ™•์ธ์— ์ด ๋ชจ๋ธ์„ ์“ฐ๋Š” ๊ตฌ์„ฑ์ด ์ข‹์Šต๋‹ˆ๋‹ค.
310
+
311
+ ```python
312
+ faq = ["๋น„๋ฐ€๋ฒˆํ˜ธ๋ฅผ ์žŠ์–ด๋ฒ„๋ ธ์–ด์š”", "๋ฐฐ์†ก์ง€๋Š” ์–ด๋–ป๊ฒŒ ๋ฐ”๊พธ๋‚˜์š”", "ํšŒ์› ํƒˆํ‡ด๋Š” ์–ด๋””์„œ ํ•˜๋‚˜์š”"]
313
+ q = "๋กœ๊ทธ์ธ ๋น„๋ฒˆ์ด ๊ธฐ์–ต์ด ์•ˆ ๋‚˜์š”"
314
+
315
+ hits = judge.similar([q] * len(faq), faq)
316
+ best = max(range(len(faq)), key=lambda i: hits[i]["probabilities"]["๊ฐ™์Œ"])
317
+ faq[best], hits[best]["choice"] # ('๋น„๋ฐ€๋ฒˆํ˜ธ๋ฅผ ์žŠ์–ด๋ฒ„๋ ธ์–ด์š”', '๊ฐ™์Œ')
318
  ```
319
 
320
+ - `similar`๋Š” ํ•™์Šตํ•˜์ง€ ์•Š์€ ๊ณผ์ œ์ž…๋‹ˆ๋‹ค (ํ•™์Šตํ•˜์ง€ ์•Š์€ KLUE-STS์—์„œ 85.9%).
321
+
322
+ ### 10. ๋‚ด ๋ถ„๋ฅ˜ ์ฒด๊ณ„ ๊ทธ๋Œ€๋กœ ์“ฐ๊ธฐ
323
+
324
+ ์–ด๋–ค ๋ถ„๋ฅ˜๋“  ์ง€์นจ๊ณผ ๋ณด๊ธฐ๋งŒ ์“ฐ๋ฉด ๋ฉ๋‹ˆ๋‹ค. ํ•™์Šตํ•˜์ง€ ์•Š์€ ๊ณผ์ œ๋ผ๋„ **ํŒ๋‹จ ๊ธฐ์ค€์„ ์ง€์นจ์— ์ ์–ด ์ฃผ๋Š” ๊ฒƒ**์ด ์ •ํ™•๋„๋ฅผ ๊ฐ€์žฅ ํฌ๊ฒŒ ์ขŒ์šฐํ•ฉ๋‹ˆ๋‹ค.
325
+
326
+ ```python
327
+ judge.decide(
328
+ state={"๋ณด๊ณ ์„œ ๋ฌธ์žฅ": "3๋ถ„๊ธฐ ๋งค์ถœ์€ ์ „๋…„ ๋Œ€๋น„ 12% ์ฆ๊ฐ€ํ–ˆ์œผ๋‚˜ ์˜์—…์ด์ต๋ฅ ์€ ์†Œํญ ํ•˜๋ฝํ–ˆ๋‹ค."},
329
+ questions={
330
+ "๋…ผ์กฐ": {
331
+ "instructions": "๋ฌธ์žฅ์ด ํšŒ์‚ฌ ์‹ค์ ์„ ์–ด๋–ค ๋…ผ์กฐ๋กœ ์ „๋‹ฌํ•˜๋Š”์ง€ ๊ณ ๋ฅธ๋‹ค. ์ข‹์€ ์ ๊ณผ ๋‚˜์œ ์ ์ด ํ•จ๊ป˜ ์žˆ์œผ๋ฉด ํ˜ผํ•ฉ์œผ๋กœ ๋ณธ๋‹ค.",
332
+ "criteria": {"positive": "๊ธ์ •์ ", "negative": "๋ถ€์ •์ ", "mixed": "ํ˜ผํ•ฉ", "neutral": "์‚ฌ์‹ค ์ „๋‹ฌ๋งŒ"},
333
+ },
334
+ },
335
+ )
336
+ ```
337
+
338
+ **์ž˜ ์•ˆ ๋˜๋Š” ์“ฐ์ž„์ƒˆ**: ์ˆซ์ž ๋น„๊ตยท๊ณ„์‚ฐ์ด ํ•ต์‹ฌ์ธ ํŒ๋‹จ(โ€œ์–ด๋А ์ชฝ์ด ๋” ์‹ผ๊ฐ€โ€), ๋ฌธ์žฅ์—์„œ ๊ฐ’ ๋ฝ‘๊ธฐ, ๋‹ต๋ณ€ ์ž‘์„ฑ, ๋‹ค๋ฅธ ๋ชจ๋ธ ๋‹ต๋ณ€์˜ ํ’ˆ์งˆ ์ฑ„์ (LLM-as-a-judge). ์ด๋Ÿฐ ์ผ์€ ์ƒ์„ฑ ๋ชจ๋ธ์— ๋งก๊ธฐ์„ธ์š”.
339
+
340
+ ### ์›๋ฆฌ: transformers๋งŒ์œผ๋กœ ์ง์ ‘ ๊ณ„์‚ฐํ•˜๊ธฐ
341
 
342
  ```python
343
  import torch, json
 
368
 
369
  ```
370
  <|im_start|>user
371
+ {๊ณผ์ œ ์„ค๋ช…} โ† instructions
372
 
373
+ {ํ•ญ๋ชฉ ์ด๋ฆ„}: {๊ฐ’} โ† state ์˜ ํ•ญ๋ชฉ๋งˆ๋‹ค ํ•œ ์ค„. ๊ฐ’์ด ๋ฌธ์ž์—ด์ด ์•„๋‹ˆ๋ฉด JSON
374
  {ํ•ญ๋ชฉ ์ด๋ฆ„}: {๊ฐ’}
375
 
376
  ๋ณด๊ธฐ:
377
+ A. {๋ณด๊ธฐ 1} โ† criteria ์˜ ์„ค๋ช…
378
  B. {๋ณด๊ธฐ 2}
379
  โ€ฆ
380
 
 
382
  <|im_start|>assistant
383
  ```
384
 
385
+ - `judge.decide()`์™€ ๋ฉ”์„œ๋“œ๋“ค์€ ์ด ํ˜•์‹์„ ์ž๋™์œผ๋กœ ๋งŒ๋“ญ๋‹ˆ๋‹ค. ์ง์ ‘ ๋งŒ๋“ค ๋•Œ๋งŒ ์‹ ๊ฒฝ ์“ฐ๋ฉด ๋ฉ๋‹ˆ๋‹ค.
386
  - ๋ณด๊ธฐ๋Š” 2~26๊ฐœ์ž…๋‹ˆ๋‹ค.
387
  - ๊ณผ์ œ ์„ค๋ช…์€ ์งง๊ณ  ๊ตฌ์ฒด์ ์œผ๋กœ ์“ฐ์„ธ์š”. ํŒ๋‹จ ๊ธฐ์ค€์„ ํ•œ๋‘ ๋ฌธ์žฅ ๋ง๋ถ™์ด๋ฉด(์˜ˆ: โ€œ๋ฐ˜์–ด๋ฅผ ๊ณ ๋ คํ•œ๋‹คโ€, โ€œ์ •๋ณด๊ฐ€ ์—†๋‹ค๋Š” ์ด์œ ๋งŒ์œผ๋กœ ๋ชจ์ˆœ์„ ๊ณ ๋ฅด์ง€ ์•Š๋Š”๋‹คโ€) ์ •ํ™•๋„๊ฐ€ ํฌ๊ฒŒ ์˜ค๋ฆ…๋‹ˆ๋‹ค.
388
  - `generate()`๋กœ ์“ธ ๊ฒฝ์šฐ `max_new_tokens=1`๋กœ ๋ณด๊ธฐ ๊ธฐํ˜ธ ํ•˜๋‚˜๋งŒ ๋ฐ›์œผ์„ธ์š” (์ด ์ €์žฅ์†Œ์˜ `generation_config.json`์€ `do_sample: false`์ž…๋‹ˆ๋‹ค). ํ™•๋ฅ ์ด ํ•„์š”ํ•˜๋ฉด ์œ„์ฒ˜๋Ÿผ logits๋ฅผ ์ฝ์œผ์„ธ์š”.
 
451
  | ๋™์‹œ 4๊ฐœ์”ฉ ๋ณด๋ƒˆ์„ ๋•Œ ์ฒ˜๋ฆฌ๋Ÿ‰ | 3.9๊ฑด/์ดˆ | **9.9๊ฑด/์ดˆ** |
452
  | ์ƒ๊ฐ์„ ์ผœ๊ณ  ๋‹ต์„ ์ƒ์„ฑํ•  ๋•Œ | | 6.3์ดˆ |
453
 
454
+ - ๋™์‹œ ์ฒ˜๋ฆฌ๋Ÿ‰์€ ๋น„๊ต ๋ชจ๋ธ์ด ์•ž์„ฐ์Šต๋‹ˆ๋‹ค. ๋น„๊ต ๋ชจ๋ธ์€ ์š”์ฒญ์„ ๋ฌถ์–ด ์ฒ˜๋ฆฌํ•˜๋Š” ์„œ๋น™ ์—”์ง„์—์„œ, ์ด ๋ชจ๋ธ์€ ํ•˜๋‚˜์”ฉ ์ฒ˜๋ฆฌํ•˜๋Š” ๋‹จ์ˆœํ•œ ์„œ๋ฒ„์—์„œ ๋Œ์•˜๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค. ๋Œ€๋Ÿ‰ ์ฒ˜๋ฆฌ์—๋Š” ๋ฆฌ์ŠคํŠธ๋กœ ๋„ฃ๊ณ  `batch_size`๋ฅผ ์ฃผ์–ด ๋ฌถ์–ด ๊ณ„์‚ฐํ•˜์„ธ์š”.
455
  - CPU(๋…ธํŠธ๋ถ, fp32)์—์„œ๋Š” ํŒ์ • ํ•œ ๋ฒˆ์— 6์ดˆ์—์„œ ์ˆ˜ ๋ถ„์ด ๊ฑธ๋ ค ์‹ค์‚ฌ์šฉ์ด ์–ด๋ ต์Šต๋‹ˆ๋‹ค.
456
 
457
  ## ์ž˜ํ•˜๋Š” ๊ฒƒ๊ณผ ๋ชปํ•˜๋Š” ๊ฒƒ
TRAINING.md CHANGED
@@ -70,6 +70,8 @@ A<|im_end|>
70
 
71
  ๊ณผ์ œ ์„ค๋ช…์€ ๊ณผ์ œ๋งˆ๋‹ค ํŒ๋‹จ ๊ธฐ์ค€์„ ํ•œ๋‘ ๋ฌธ์žฅ ๋‹ด์•˜์Šต๋‹ˆ๋‹ค (์˜ˆ: ๋ฌธ์žฅ ๊ด€๊ณ„์—์„œ๋Š” โ€œ์ •๋ณด๊ฐ€ ์—†๋‹ค๋Š” ์ด์œ ๋งŒ์œผ๋กœ ๋ชจ์ˆœ์„ ๊ณ ๋ฅด์ง€ ์•Š๋Š”๋‹คโ€). ๊ฐ™์€ ํ˜•์‹์— ๋‹ค์–‘ํ•œ ๊ณผ์ œ ์„ค๋ช…์ด ์„ž์—ฌ ์žˆ์–ด์„œ, ํ•™์Šตํ•˜์ง€ ์•Š์€ ์ง€์‹œ๋ฌธ๋„ ๋”ฐ๋ฅด๊ฒŒ ๋ฉ๋‹ˆ๋‹ค.
72
 
 
 
73
  ### 3.3 ๋ณด๊ธฐ ์ˆœ์„œ ์„ž๊ธฐ์™€ ์—ญ์ˆœ ๋„ฃ๊ธฐ
74
 
75
  - ๋ณด๊ธฐ ์ˆœ์„œ๋Š” ๋ฌธํ•ญ๋งˆ๋‹ค ๋ฌด์ž‘์œ„๋กœ ์„ž์—ˆ์Šต๋‹ˆ๋‹ค. ์ •๋‹ต ๊ธฐํ˜ธ๊ฐ€ A๋‚˜ B์— ๋ชฐ๋ฆฌ๋ฉด ๋ชจ๋ธ์ด ๋‚ด์šฉ ๋Œ€์‹  ์œ„์น˜๋ฅผ ์™ธ์šฐ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค (์›๋ณธ ๋ชจ๋ธ์€ ์ด ํ˜•์‹์—์„œ ๊ฑฐ์˜ ๋Š˜ A๋ฅผ ๊ณจ๋ž์Šต๋‹ˆ๋‹ค).
@@ -139,7 +141,9 @@ A<|im_end|>
139
  | KorNLI | 74.5 | 83.6 | +9.1 |
140
  | KLUE-STS | 85.9 | 87.4 | +1.5 |
141
  | KMMLU | 42.6 | 52.9 | +10.2 |
142
- | HAE-RAE 1.0 | 56.1 | 57.1 | +1.0 | ๋ณด์ • ์˜จ๋„๋Š” [`calibration.json`](calibration.json)์— ์žˆ๊ณ  [`judge.py`](judge.py)๊ฐ€ ์ž๋™์œผ๋กœ ์ ์šฉํ•ฉ๋‹ˆ๋‹ค.
 
 
143
 
144
  ## 6. ํ‰๊ฐ€
145
 
 
70
 
71
  ๊ณผ์ œ ์„ค๋ช…์€ ๊ณผ์ œ๋งˆ๋‹ค ํŒ๋‹จ ๊ธฐ์ค€์„ ํ•œ๋‘ ๋ฌธ์žฅ ๋‹ด์•˜์Šต๋‹ˆ๋‹ค (์˜ˆ: ๋ฌธ์žฅ ๊ด€๊ณ„์—์„œ๋Š” โ€œ์ •๋ณด๊ฐ€ ์—†๋‹ค๋Š” ์ด์œ ๋งŒ์œผ๋กœ ๋ชจ์ˆœ์„ ๊ณ ๋ฅด์ง€ ์•Š๋Š”๋‹คโ€). ๊ฐ™์€ ํ˜•์‹์— ๋‹ค์–‘ํ•œ ๊ณผ์ œ ์„ค๋ช…์ด ์„ž์—ฌ ์žˆ์–ด์„œ, ํ•™์Šตํ•˜์ง€ ์•Š์€ ์ง€์‹œ๋ฌธ๋„ ๋”ฐ๋ฅด๊ฒŒ ๋ฉ๋‹ˆ๋‹ค.
72
 
73
+ ํ•™์Šต์— ์“ด ๊ณผ์ œ ์„ค๋ช…๊ณผ ๋ณด๊ธฐ ๋ฌธ๊ตฌ๋Š” [`judge.py`](judge.py)์˜ `TASKS`ยท`CRITERIA`์— ๊ทธ๋Œ€๋กœ ๋“ค์–ด ์žˆ์Šต๋‹ˆ๋‹ค. `judge.sentiment()`, `judge.nli()` ๊ฐ™์€ ๋ฉ”์„œ๋“œ๋Š” ์ด ๋ฌธ๊ตฌ๋กœ ํ”„๋กฌํ”„ํŠธ๋ฅผ ๋งŒ๋“ค๊ธฐ ๋•Œ๋ฌธ์— ํ•™์Šต ๋•Œ์™€ ๊ฐ™์€ ์กฐ๊ฑด์œผ๋กœ ํŒ์ •ํ•ฉ๋‹ˆ๋‹ค.
74
+
75
  ### 3.3 ๋ณด๊ธฐ ์ˆœ์„œ ์„ž๊ธฐ์™€ ์—ญ์ˆœ ๋„ฃ๊ธฐ
76
 
77
  - ๋ณด๊ธฐ ์ˆœ์„œ๋Š” ๋ฌธํ•ญ๋งˆ๋‹ค ๋ฌด์ž‘์œ„๋กœ ์„ž์—ˆ์Šต๋‹ˆ๋‹ค. ์ •๋‹ต ๊ธฐํ˜ธ๊ฐ€ A๋‚˜ B์— ๋ชฐ๋ฆฌ๋ฉด ๋ชจ๋ธ์ด ๋‚ด์šฉ ๋Œ€์‹  ์œ„์น˜๋ฅผ ์™ธ์šฐ๊ธฐ ๋•Œ๋ฌธ์ž…๋‹ˆ๋‹ค (์›๋ณธ ๋ชจ๋ธ์€ ์ด ํ˜•์‹์—์„œ ๊ฑฐ์˜ ๋Š˜ A๋ฅผ ๊ณจ๋ž์Šต๋‹ˆ๋‹ค).
 
141
  | KorNLI | 74.5 | 83.6 | +9.1 |
142
  | KLUE-STS | 85.9 | 87.4 | +1.5 |
143
  | KMMLU | 42.6 | 52.9 | +10.2 |
144
+ | HAE-RAE 1.0 | 56.1 | 57.1 | +1.0 |
145
+
146
+ ๋ณด์ • ์˜จ๋„๋Š” [`calibration.json`](calibration.json)์— ์žˆ๊ณ  [`judge.py`](judge.py)๊ฐ€ ์ž๋™์œผ๋กœ ์ ์šฉํ•ฉ๋‹ˆ๋‹ค.
147
 
148
  ## 6. ํ‰๊ฐ€
149
 
config.json CHANGED
@@ -5,6 +5,16 @@
5
  "attention_bias": false,
6
  "attention_dropout": 0.0,
7
  "bos_token_id": 151643,
 
 
 
 
 
 
 
 
 
 
8
  "dtype": "bfloat16",
9
  "eos_token_id": 151645,
10
  "head_dim": 128,
 
5
  "attention_bias": false,
6
  "attention_dropout": 0.0,
7
  "bos_token_id": 151643,
8
+ "custom_pipelines": {
9
+ "kjh-judge": {
10
+ "impl": "judge_pipeline.KJHJudgePipeline",
11
+ "pt": [
12
+ "AutoModelForCausalLM"
13
+ ],
14
+ "tf": [],
15
+ "type": "text"
16
+ }
17
+ },
18
  "dtype": "bfloat16",
19
  "eos_token_id": 151645,
20
  "head_dim": 128,
judge.py CHANGED
@@ -1,17 +1,40 @@
1
  """KJH-Judge-4B-ko ํŒ์ • ๋„์šฐ๋ฏธ โ€” ์ •ํ•ด์ง„ ๋ณด๊ธฐ ์ค‘ ํ•˜๋‚˜๋ฅผ ๊ณจ๋ผ ๋ณด์ •๋œ ํ™•๋ฅ ๊ณผ ํ•จ๊ป˜ ๋Œ๋ ค์ค€๋‹ค.
2
 
3
- from judge import Judge
4
- j = Judge("coderecode95/KJH-Judge-4B-ko") # ๋˜๋Š” ๋‚ด๋ ค๋ฐ›์€ ํด๋” ๊ฒฝ๋กœ
5
- j.decide("๋ฌธ์žฅ์˜ ๊ฐ์ • ๊ทน์„ฑ์„ ํŒ๋‹จํ•œ๋‹ค.", {"text": "ํƒ๋ฐฐ์‚ฌ ์ •๋ง ๋งˆ์Œ์— ๋“ฌ"}, ["๊ธ์ •์  ๊ฐ์ •", "๋ถ€์ •์  ๊ฐ์ •"])
6
- # โ†’ {'choice': 'A', 'index': 0, 'text': '๊ธ์ •์  ๊ฐ์ •', 'confidence': 0.9966, 'probs': {'A': 0.9966, 'B': 0.0034}}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
 
8
  ๋™์ž‘: ์•„๋ž˜ ํ˜•์‹์˜ ํ”„๋กฌํ”„ํŠธ๋ฅผ ํ•œ ๋ฒˆ ๊ณ„์‚ฐํ•˜๊ณ , ๋‹ค์Œ ํ† ํฐ ์ž๋ฆฌ์—์„œ ๋ณด๊ธฐ ๊ธฐํ˜ธ(A, B, โ€ฆ) ํ† ํฐ์˜ ์ ์ˆ˜๋งŒ ๊บผ๋‚ด
9
- calibration.json ์˜ ์˜จ๋„๋กœ ๋‚˜๋ˆ  softmax ํ•œ๋‹ค. ๊ธ€์„ ์ƒ์„ฑํ•˜์ง€ ์•Š์œผ๋ฏ€๋กœ ๋น ๋ฅด๋‹ค (GPU์—์„œ ํŒ์ • ํ•œ ๋ฒˆ ์ˆ˜์‹ญ ms).
10
 
11
  <|im_start|>user
12
- {๊ณผ์ œ ์„ค๋ช…}
13
 
14
- {ํ•ญ๋ชฉ ์ด๋ฆ„}: {๊ฐ’} โ† item ์˜ ํ‚ค๋งˆ๋‹ค ํ•œ ์ค„ (๊ฐ’์ด ๋ฌธ์ž์—ด์ด ์•„๋‹ˆ๋ฉด JSON)
15
 
16
  ๋ณด๊ธฐ:
17
  A. {๋ณด๊ธฐ 1}
@@ -21,58 +44,237 @@ calibration.json ์˜ ์˜จ๋„๋กœ ๋‚˜๋ˆ  softmax ํ•œ๋‹ค. ๊ธ€์„ ์ƒ์„ฑํ•˜์ง€ ์•Š์œผ
21
  <|im_start|>assistant
22
  """
23
  import json
 
24
  from pathlib import Path
25
 
26
  import torch
27
  from transformers import AutoModelForCausalLM, AutoTokenizer
28
 
 
29
  HINT = "์ •๋‹ต ๋ณด๊ธฐ์˜ ๊ธฐํ˜ธ ํ•˜๋‚˜๋งŒ ๋‹ตํ•˜์„ธ์š”."
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
30
 
31
 
32
  def render_prompt(instruction, item, choices):
 
 
33
  lines = [f"{k}: {v if isinstance(v, str) else json.dumps(v, ensure_ascii=False)}" for k, v in item.items()]
34
  opts = "\n".join(f"{chr(65 + i)}. {c}" for i, c in enumerate(choices))
35
- return "\n\n".join([instruction.strip(), "\n".join(lines), "๋ณด๊ธฐ:\n" + opts, HINT])
36
 
37
 
38
  def chat_prefix(prompt):
39
  return f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
40
 
41
 
42
- def _temperature(model):
 
 
 
 
 
 
 
 
 
43
  p = Path(model) / "calibration.json"
44
  if not p.is_file():
45
  try:
46
  from huggingface_hub import hf_hub_download
47
  p = Path(hf_hub_download(model, "calibration.json"))
48
  except Exception:
 
49
  return 1.0
50
  return float(json.loads(p.read_text(encoding="utf-8"))["temperature"])
51
 
52
 
53
- class Judge:
54
- def __init__(self, model="coderecode95/KJH-Judge-4B-ko", device=None, dtype=None):
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
  device = device or ("cuda" if torch.cuda.is_available() else "cpu")
56
  dtype = dtype or (torch.bfloat16 if device != "cpu" else torch.float32)
57
  self.tok = AutoTokenizer.from_pretrained(model)
58
  self.model = AutoModelForCausalLM.from_pretrained(model, dtype=dtype).to(device).eval()
59
  self.device = device
60
- self.temperature = _temperature(model)
61
- self.letter_ids = [self.tok.encode(chr(65 + i), add_special_tokens=False)[0] for i in range(26)]
62
 
63
- def _encode(self, instruction, item, choices):
64
- return self.tok.encode(chat_prefix(render_prompt(instruction, item, choices)), add_special_tokens=False)
 
 
 
 
 
65
 
66
  @torch.no_grad()
67
  def decide_batch(self, requests, batch_size=16, max_tokens=8000):
68
- """requests: [{"instruction": str, "item": dict, "choices": [str, โ€ฆ]}, โ€ฆ] โ†’ ๊ฐ™์€ ์ˆœ์„œ์˜ ๊ฒฐ๊ณผ ๋ชฉ๋ก.
69
- ๋ณด๊ธฐ๋Š” 2~26๊ฐœ. ๊ธธ์ด๊ฐ€ ๋น„์Šทํ•œ ๊ฒƒ๋ผ๋ฆฌ ๋ฌถ์–ด ๊ณ„์‚ฐํ•œ๋‹ค (์˜ค๋ฅธ์ชฝ์„ ์ฑ„์šฐ๊ณ  ๊ฐ ๋ฌธ์žฅ์˜ ๋งˆ์ง€๋ง‰ ์ž๋ฆฌ๋งŒ ์ฝ์œผ๋ฏ€๋กœ ๊ฒฐ๊ณผ๋Š” ํ•˜๋‚˜์”ฉ ๊ณ„์‚ฐํ•œ ๊ฒƒ๊ณผ ๊ฐ™๋‹ค)."""
 
 
70
  seqs = []
71
  for r in requests:
72
- ch = [c["text"] if isinstance(c, dict) else str(c) for c in r["choices"]]
73
- if not 2 <= len(ch) <= 26:
74
- raise ValueError("๋ณด๊ธฐ๋Š” 2~26๊ฐœ์—ฌ์•ผ ํ•ฉ๋‹ˆ๋‹ค")
75
- seqs.append((self._encode(r["instruction"], r["item"], ch), ch))
76
  order = sorted(range(len(seqs)), key=lambda i: len(seqs[i][0]))
77
  out = [None] * len(seqs)
78
  W = self.model.get_output_embeddings().weight
@@ -90,18 +292,14 @@ class Judge:
90
  for r, k in enumerate(grp):
91
  ids, ch = seqs[k]
92
  rows = torch.tensor(self.letter_ids[:len(ch)], device=self.device)
93
- scores = (h[r, len(ids) - 1].float() @ W[rows].float().T) / self.temperature
94
- p = torch.softmax(scores, -1).tolist()
95
  b = max(range(len(p)), key=p.__getitem__)
96
  out[k] = {"choice": chr(65 + b), "index": b, "text": ch[b], "confidence": round(p[b], 4),
97
  "probs": {chr(65 + j): round(v, 4) for j, v in enumerate(p)}}
98
  return out
99
 
100
- def decide(self, instruction, item, choices):
101
- return self.decide_batch([{"instruction": instruction, "item": item, "choices": choices}])[0]
102
-
103
 
104
  if __name__ == "__main__":
105
  import sys
106
  j = Judge(sys.argv[1] if len(sys.argv) > 1 else ".")
107
- print(j.decide("๋ฌธ์žฅ์˜ ๊ฐ์ • ๊ทน์„ฑ์„ ํŒ๋‹จํ•œ๋‹ค.", {"text": "ํƒ๋ฐฐ์‚ฌ ์ •๋ง ๋งˆ์Œ์— ๋“ฌ"}, ["๊ธ์ •์  ๊ฐ์ •", "๋ถ€์ •์  ๊ฐ์ •"]))
 
1
  """KJH-Judge-4B-ko ํŒ์ • ๋„์šฐ๋ฏธ โ€” ์ •ํ•ด์ง„ ๋ณด๊ธฐ ์ค‘ ํ•˜๋‚˜๋ฅผ ๊ณจ๋ผ ๋ณด์ •๋œ ํ™•๋ฅ ๊ณผ ํ•จ๊ป˜ ๋Œ๋ ค์ค€๋‹ค.
2
 
3
+ from transformers import pipeline
4
+ judge = pipeline(model="coderecode95/KJH-Judge-4B-ko", trust_remote_code=True, device=0, dtype="bfloat16")
5
+ # ๋˜๋Š”: from judge import Judge; judge = Judge() (์ด ํŒŒ์ผ์„ ๋‚ด๋ ค๋ฐ›์•„ ์“ธ ๋•Œ)
6
+
7
+ 1) JEV ํ˜•์‹ โ€” ์ƒํ™ฉ(state) ํ•˜๋‚˜์— ์ด๋ฆ„ ๋ถ™์ธ ์งˆ๋ฌธ ์—ฌ๋Ÿฌ ๊ฐœ. ๋ณด๊ธฐ ID๋Š” ๋งˆ์Œ๋Œ€๋กœ ์ •ํ•œ๋‹ค.
8
+
9
+ judge.decide(
10
+ state={"๊ณ ๊ฐ ๋ฌธ์˜": "์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”. ์˜ค๋Š˜ ์•ˆ์— ์ฒ˜๋ฆฌํ•ด ์ฃผ์„ธ์š”."},
11
+ questions={
12
+ "๋ถ€์„œ": {"instructions": "๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.",
13
+ "criteria": {"billing": "๊ฒฐ์ œยทํ™˜๋ถˆ", "delivery": "๋ฐฐ์†ก", "account": "๊ณ„์ •ยท๋กœ๊ทธ์ธ"}},
14
+ "๊ธด๊ธ‰": {"instructions": "๊ณ ๊ฐ์ด ์ฆ‰์‹œ ์ฒ˜๋ฆฌ๋ฅผ ์š”๊ตฌํ•˜๋Š”์ง€ ํŒ๋‹จํ•œ๋‹ค.",
15
+ "criteria": {"urgent": "์ฆ‰์‹œ ์ฒ˜๋ฆฌ ์š”๊ตฌ", "normal": "์ผ๋ฐ˜ ๋ฌธ์˜"}},
16
+ },
17
+ )
18
+ # โ†’ {'๋ถ€์„œ': {'choice': 'billing', 'confidence': 0.98, 'probabilities': {...}},
19
+ # '๊ธด๊ธ‰': {'choice': 'urgent', 'confidence': 0.91, 'probabilities': {...}}}
20
+
21
+ 2) ์ž์ฃผ ์“ฐ๋Š” ํŒ์ • โ€” ํ•™์Šต ๋•Œ์™€ ๊ฐ™์€ ์ง€์นจยท๋ณด๊ธฐ๋ฅผ ์ž๋™์œผ๋กœ ๋„ฃ๋Š”๋‹ค.
22
+
23
+ judge.sentiment("๋ฐฐ์†ก์€ ๋А๋ ธ์ง€๋งŒ ๋ฌผ๊ฑด์€ ์ •๋ง ๋งˆ์Œ์— ๋“ค์–ด์š”") # โ†’ choice: ๊ธ์ • / ๋ถ€์ •
24
+ judge.nli("๋ณด์ฆ๊ธˆ์€ 30์ผ ์ด๋‚ด ๋ฐ˜ํ™˜ํ•œ๋‹ค.", "๋ณด์ฆ๊ธˆ์€ 40์ผ ๋’ค์— ๋ฐ›๋Š”๋‹ค.") # โ†’ entailment / contradiction / neutral
25
+ judge.next_action("ํƒ์‹œ ๋ถˆ๋Ÿฌ์ค˜", tools) # โ†’ CALL:call_taxi / ASK / RESPOND
26
+
27
+ 3) ํ•œ ์ค„๋กœ โ€” judge(์ƒํ™ฉ, ๋ณด๊ธฐ, instruction=โ€ฆ). ๊ฒฐ๊ณผ ํ˜•์‹์€ ๋ชจ๋‘ ๊ฐ™๋‹ค.
28
+
29
+ judge("์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”", ["๊ฒฐ์ œยทํ™˜๋ถˆ", "๋ฐฐ์†ก", "๊ธฐํƒ€"], instruction="๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.")
30
 
31
  ๋™์ž‘: ์•„๋ž˜ ํ˜•์‹์˜ ํ”„๋กฌํ”„ํŠธ๋ฅผ ํ•œ ๋ฒˆ ๊ณ„์‚ฐํ•˜๊ณ , ๋‹ค์Œ ํ† ํฐ ์ž๋ฆฌ์—์„œ ๋ณด๊ธฐ ๊ธฐํ˜ธ(A, B, โ€ฆ) ํ† ํฐ์˜ ์ ์ˆ˜๋งŒ ๊บผ๋‚ด
32
+ calibration.json ์˜ ์˜จ๋„๋กœ ๋‚˜๋ˆ  softmax ํ•œ๋‹ค. ๊ธ€์„ ์ƒ์„ฑํ•˜์ง€ ์•Š์œผ๋ฏ€๋กœ ๋น ๋ฅด๋‹ค.
33
 
34
  <|im_start|>user
35
+ {์ง€์นจ}
36
 
37
+ {ํ•ญ๋ชฉ ์ด๋ฆ„}: {๊ฐ’} โ† state ์˜ ํ‚ค๋งˆ๋‹ค ํ•œ ์ค„ (๊ฐ’์ด ๋ฌธ์ž์—ด์ด ์•„๋‹ˆ๋ฉด JSON). ๋ฌธ์ž์—ด๋งŒ ์ฃผ๋ฉด "text: {๋ฌธ์ž์—ด}"
38
 
39
  ๋ณด๊ธฐ:
40
  A. {๋ณด๊ธฐ 1}
 
44
  <|im_start|>assistant
45
  """
46
  import json
47
+ import warnings
48
  from pathlib import Path
49
 
50
  import torch
51
  from transformers import AutoModelForCausalLM, AutoTokenizer
52
 
53
+ REPO = "coderecode95/KJH-Judge-4B-ko"
54
  HINT = "์ •๋‹ต ๋ณด๊ธฐ์˜ ๊ธฐํ˜ธ ํ•˜๋‚˜๋งŒ ๋‹ตํ•˜์„ธ์š”."
55
+ DEFAULT_INSTRUCTION = "์ฃผ์–ด์ง„ ๋‚ด์šฉ์„ ์ฝ๊ณ  ๊ฐ€์žฅ ์•Œ๋งž์€ ๋ณด๊ธฐ๋ฅผ ๊ณ ๋ฅธ๋‹ค."
56
+
57
+ # ๊ณผ์ œ๋ณ„ ์ง€์นจ โ€” ํ•™์ŠตยทKorean JEV Benchmark ์™€ ๊ฐ™์€ ๋ฌธ๊ตฌ (๋ฐ”๊พธ๋ฉด ์ •ํ™•๋„๊ฐ€ ๋–จ์–ด์งˆ ์ˆ˜ ์žˆ๋‹ค)
58
+ TASKS = {
59
+ "sentiment": "๋ฌธ์žฅ์˜ ์ „๋ฐ˜์ ์ธ ๊ฐ์ • ๊ทน์„ฑ์„ ํŒ๋‹จํ•œ๋‹ค. ๋ถ€์ • ํ‘œํ˜„๊ณผ ๋ฐ˜์–ด๋ฅผ ๊ณ ๋ คํ•œ๋‹ค.",
60
+ "nli": ("์ „์ œ๋ฅผ ์ฐธ์ด๋ผ๊ณ  ํ•  ๋•Œ ๊ฐ€์„ค์„ ๋ถ„๋ฅ˜ํ•œ๋‹ค. entailment: ์ „์ œ๋กœ๋ถ€ํ„ฐ ๊ฐ€์„ค์ด ๋”ฐ๋ผ์˜จ๋‹ค. contradiction: ์ „์ œ์™€ ๊ฐ€์„ค์ด ์–‘๋ฆฝํ•  ์ˆ˜ ์—†๋‹ค. neutral: ๋‘˜ ๋‹ค ์•„๋‹ˆ๋‹ค. "
61
+ "์ •๋ณด๊ฐ€ ์—†๋‹ค๋Š” ์ด์œ ๋งŒ์œผ๋กœ contradiction์„ ๊ณ ๋ฅด์ง€ ์•Š๋Š”๋‹ค. neutral์€ ์ •์ƒ ์ •๋‹ต์ด๋ฉฐ insufficient_context๊ฐ€ ์•„๋‹ˆ๋‹ค. ํ†ต์ƒ์ ์ธ ๋ฌธ์žฅ ์˜๋ฏธ๋กœ ํŒ๋‹จํ•˜๋ฉฐ ํฌ๋ฐ•ํ•œ ๊ฐ€์ •์„ ๋งŒ๋“ค์–ด ๋ชจํ˜ธํ•˜๋‹ค๊ณ  ํ•˜์ง€ ์•Š๋Š”๋‹ค. "
62
+ "์ „์ œ์˜ ์—ด๊ฑฐ ๋Œ€์ƒ๊ณผ ๊ฐ€์„ค์˜ ๋ฒ”์œ„๋ฅผ ๋น ์ง์—†์ด ๋Œ€์กฐํ•œ๋‹ค. ๊ฐ€์„ค์˜ ๋งŒ/๋ฐ–์—/์˜ค์ง/๋ชจ๋‘ ๊ฐ™์€ ํ‘œํ˜„์ด ์ „์ œ์— ๋ช…์‹œ๋œ ๋‹ค๋ฅธ ๋Œ€์ƒ์ด๋‚˜ ์‚ฌ๋ก€๋ฅผ ๋ฐฐ์ œํ•˜๋Š”์ง€ ํ™•์ธํ•œ๋‹ค. "
63
+ "์ „์ œ์— ๋ฐฐํƒ€ ํ‘œํ˜„์ด ์—†๋‹ค๋Š” ์‚ฌ์‹ค๋งŒ์œผ๋กœ ์ค‘๋ฆฝ์ด๋ผ๊ณ  ํ•˜์ง€ ์•Š๋Š”๋‹ค. ํ†ต์ƒ์ ์ธ ๋ฌธ๋งฅ์ด ๋ช…ํ™•ํ•˜๋ฉด ๋‹ค๋ฅธ ์›์ธยท์ƒํ™ฉ์„ ์ž„์˜๋กœ ์ถ”๊ฐ€ํ•˜์ง€ ์•Š๋Š”๋‹ค."),
64
+ "topic": "ํ•œ๊ตญ์–ด ๋‰ด์Šค ์ œ๋ชฉ์˜ ์ค‘์‹ฌ ์ฃผ์ œ๋ฅผ ๊ณ ๋ฅธ๋‹ค. ์—ฌ๋Ÿฌ ๋ถ„์•ผ๊ฐ€ ์–ธ๊ธ‰๋˜์–ด๋„ ๊ธฐ์‚ฌ์˜ ์ฃผ๋œ ์‚ฌ๊ฑด์„ ์šฐ์„ ํ•œ๋‹ค.",
65
+ "hate": ("APEACH ์› ๋…ผ๋ฌธ์˜ ์ƒ์„ฑ ๊ธฐ์ค€์„ ๋”ฐ๋ฅธ๋‹ค. ์„ฑ๋ณ„ยท์„ฑ์  ์ง€ํ–ฅ/์ •์ฒด์„ฑยท๋‚˜์ด/์‹ ๋ถ„/๊ฒฝ๋ ฅยท๊ตญ์ /์ธ์ข…ยท์ถœ์‹ /๊ฑฐ์ฃผ์ง€ยท์™ธ๋ชจยท์งˆ๋ณ‘/์žฅ์• ยท์‹์Šต๊ด€ยทํ•™๋ ฅ/์ „๊ณต ๊ด€๋ จ ์ฐจ๋ณ„ยท๋น„ํ•˜ยท๊ณต๊ฒฉ์„ ํฌํ•จํ•œ๋‹ค. "
66
+ "๋ณดํ˜ธ์ง‘๋‹จ ์ •์ฒด์„ฑ์„ ๋ช…์‹œํ•ด์•ผ ํ•œ๋‹ค๋Š” ์ œํ•œ์€ ์—†๋‹ค. ๋ถˆํ•„์š”ํ•˜๊ฑฐ๋‚˜ ๊ณต๊ฒฉ์ ์ธ ์™ธ๋ชจ ํ‰๊ฐ€, ์‹์Šต๊ด€ ๊ฐ•์š”/ํ„ํ•˜๋„ ํ•ด๋‹นํ•œ๋‹ค. ๋น„๊ณต๊ฒฉ์ ์ธ ์ฃผ์ œ ์–ธ๊ธ‰์ด๋‚˜ ์ฐจ๋ณ„์— ๋Œ€ํ•œ ๋ฐ˜๋Œ€ ๋ฐœ์–ธ์€ ๋น„ํ˜์˜ค๋‹ค."),
67
+ "offensive": "BEEP ์› ์ง€์นจ์— ๋”ฐ๋ฅธ ๊ณต๊ฒฉ์„ฑ ์ˆ˜์ค€. hate ๋Œ€์ƒ์€ ๋ณดํ˜ธ ์ง‘๋‹จ์— ํ•œ์ •๋˜์ง€ ์•Š๊ณ  ๊ธฐ์‚ฌ ์† ์ธ๋ฌผยท์ž‘์„ฑ์ž ๋“ฑ ๊ฐœ์ธ๋„ ํฌํ•จํ•œ๋‹ค. ๋น„์†์–ด ์กด์žฌ๋งŒ์œผ๋กœ hate๊ฐ€ ๋˜์ง€๋Š” ์•Š๋Š”๋‹ค. ๋‰ด์Šค ์ œ๋ชฉ์„ ๋ฌธ๋งฅ์œผ๋กœ ์‚ฌ์šฉํ•œ๋‹ค.",
68
+ "yes_no": "๋ฌธ๋‹จ์— ๊ทผ๊ฑฐํ•˜์—ฌ ์งˆ๋ฌธ์— ์˜ˆ/์•„๋‹ˆ์˜ค๋กœ ๋‹ตํ•œ๋‹ค.",
69
+ "same_meaning": "๋‘ ๋ฌธ๋งฅ์—์„œ ํ‘œ์‹œ๋œ ๋‹จ์–ด์˜ ์˜๋ฏธ๊ฐ€ ๊ฐ™์€์ง€ ํŒ๋‹จํ•œ๋‹ค.",
70
+ "similar": "๋‘ ๋ฌธ์žฅ์˜ ์˜๋ฏธ๊ฐ€ ๊ฐ™์€์ง€ ํŒ๋‹จํ•œ๋‹ค. ํ‘œํ˜„์ด ๋‹ฌ๋ผ๋„ ์ „๋‹ฌํ•˜๋Š” ๋‚ด์šฉ์ด ๊ฐ™์œผ๋ฉด ๊ฐ™์€ ์˜๋ฏธ๋‹ค.",
71
+ "reading": "์ง€๋ฌธ์— ๊ทผ๊ฑฐํ•˜์—ฌ ์งˆ๋ฌธ์˜ ๋‹ต์„ ๊ณ ๋ฅธ๋‹ค. ๋ถ€์ • ์งˆ๋ฌธ์— ์ฃผ์˜ํ•œ๋‹ค.",
72
+ "next_action": ("๋‹ค์Œ ํ•œ ๋‹จ๊ณ„์˜ ํ–‰๋™์„ ์„ ํƒํ•œ๋‹ค. CALL:<name>: ์ œ๊ณต๋œ ๋„๊ตฌ๋กœ ์š”์ฒญ์„ ์ฒ˜๋ฆฌํ•  ์ˆ˜ ์žˆ๊ณ  ํ•„์š”ํ•œ ํ•„์ˆ˜ ์ธ์ž๊ฐ€ ๋Œ€ํ™”์— ๋ชจ๋‘ ์žˆ๋‹ค. "
73
+ "ASK: ๊ด€๋ จ ๋„๊ตฌ๋Š” ์žˆ์œผ๋‚˜ ํ•„์ˆ˜ ์ธ์ž๊ฐ€ ๋ถ€์กฑํ•ด ์งˆ๋ฌธ์ด ํ•„์š”ํ•˜๋‹ค. RESPOND: ๋„๊ตฌ๊ฐ€ ๋ถˆํ•„์š”ํ•œ ์„ค๋ช…/์™„๋ฃŒ ์•ˆ๋‚ด ๋˜๋Š” ์ œ๊ณต ๋„๊ตฌ๋กœ ์ง€์›ํ•˜์ง€ ์•Š๋Š” ์š”์ฒญ์— ๋Œ€ํ•œ ์•ˆ๋‚ด. "
74
+ "์‹ค์ œ ๋„๊ตฌ ์‹คํ–‰ยท์ธ์ž ์ž‘์„ฑ์€ ํ•˜์ง€ ์•Š๋Š”๋‹ค. ๊ณผ๊ฑฐ ๋„๊ตฌ ๊ฒฐ๊ณผ๋ฅผ ํ™œ์šฉํ•˜๊ณ  ํ˜„์žฌ ์ •๋‹ต์ด๋‚˜ ๋ฏธ๋ž˜ ํ„ด์„ ์ถ”์ธกํ•˜์ง€ ์•Š๋Š”๋‹ค. "
75
+ "๋„๊ตฌ schema๊ฐ€ ํ•„์ˆ˜ ๊ฐ’์˜ ๊ธฐ๋ณธ๊ฐ’ยท๋ฌธ๋งฅ ์ถ”๋ก ยท๋ช…์นญ ์ƒ์„ฑ์„ ๋ช…์‹œ์ ์œผ๋กœ ํ—ˆ์šฉํ•˜๋ฉด ๊ทธ ์ •์˜๋ฅผ ๋”ฐ๋ฅธ๋‹ค. ๊ทผ๊ฑฐ ์—†๋Š” ๊ฐ’์„ ๋งŒ๋“œ๋Š” ๊ฒƒ๊ณผ ๋„๊ตฌ ์ •์˜๊ฐ€ ํ—ˆ์šฉํ•˜๋Š” ๊ฐ’์„ ๋„์ถœํ•˜๋Š” ๊ฒƒ์„ ๊ตฌ๋ณ„ํ•œ๋‹ค. "
76
+ "ํ˜„์žฌ๊นŒ์ง€์˜ ๋„๊ตฌ ๊ฒฐ๊ณผ๋กœ ์š”์ฒญ์ด ํ•ด๊ฒฐ๋์œผ๋ฉด ๊ฒฐ๊ณผ ์•ˆ๋‚ด๊ฐ€ ๋‹ค์Œ ํ–‰๋™์ด๋ฉฐ ๊ฐ™์€ ๋„๊ตฌ๋ฅผ ๋ฐ˜๋ณต ํ˜ธ์ถœํ•˜์ง€ ์•Š๋Š”๋‹ค."),
77
+ "policy_action": ("๋ช…์‹œ๋œ ์ •์ฑ…๊ณผ ์˜ˆ์™ธ์˜ ์กฐ๊ฑด์— ๋”ฐ๋ผ ๋‹ค์Œ ํ–‰๋™์„ ๊ณ ๋ฅธ๋‹ค. ์˜ˆ์™ธ๋Š” ์“ฐ์ธ ์ ์šฉ ์กฐ๊ฑด์„ ๋งŒ์กฑํ•  ๋•Œ๋งŒ ๊ธฐ๋ณธ ๊ทœ์น™์„ ๋ฎ์–ด์“ด๋‹ค. ๋ช…์‹œ๋˜์ง€ ์•Š์€ ์‹ค์ œ ๊ธˆ์œต ์‹ค๋ฌด ์š”๊ฑด์„ ์ถ”๊ฐ€ํ•˜์ง€ ์•Š๋Š”๋‹ค. "
78
+ "ASK_CLARIFICATION๊ณผ ASK_CONFIRMATION์„ ๊ตฌ๋ณ„ํ•œ๋‹ค. ๋จผ์ € ๊ธฐ๋ณธ ๊ทœ์น™์˜ ์ ์šฉ ์กฐ๊ฑด๊ณผ ์˜ˆ์™ธ์˜ ์ ์šฉ ์กฐ๊ฑด์„ ๊ฐ๊ฐ ํ™•์ธํ•œ๋‹ค. "
79
+ "์กฐ๊ฑด์„ ๋งŒ์กฑํ•˜๋Š” ๋ช…์‹œ์  ํ–‰๋™ ์ง€์‹œ๋ฅผ ์šฐ์„ ํ•˜๋ฉฐ, ๊ณ ๊ฐ ๋ฌธ์žฅ์ด ์งˆ๋ฌธ ํ˜•ํƒœ๋ผ๋Š” ์ด์œ ๋กœ ์ด๋ฅผ ๋ฌด์‹œํ•˜์ง€ ์•Š๋Š”๋‹ค. ์กฐ๊ฑด์ด ๋งž์ง€ ์•Š๋Š” ์˜ˆ์™ธ๋Š” ์ ์šฉํ•˜์ง€ ์•Š๋Š”๋‹ค. "
80
+ "์ •์ฑ…์— ๋ณ„๋„ ํ–‰๋™ ์ง€์‹œ๊ฐ€ ์—†์œผ๋ฉด ์ฃผ์–ด์ง„ ํ–‰๋™ ์ •์˜์™€ ์‹ค์ œ ์š”์ฒญ์— ๋งž์ถฐ ํŒ๋‹จํ•œ๋‹ค. ์ •์ฑ…ยท์ผ๋ฐ˜ ์‚ฌ์‹ค ์„ค๋ช…๊ณผ ์™ธ๋ถ€ ๊ณ„์ขŒ ์ •๋ณด ์กฐํšŒ๋ฅผ ๊ตฌ๋ณ„ํ•œ๋‹ค. "
81
+ "๋ช…์‹œ๋œ ํ–‰๋™์„ ๊ณ ๋ฅด๋Š” ์ถ”์ƒ ๊ณผ์ œ์ด๋ฏ€๋กœ ์‹ค์ œ ๋„๊ตฌ ์Šคํ‚ค๋งˆ๋‚˜ ๊ณ„์ขŒ ์ธ์ฆ ์ ˆ์ฐจ๋ฅผ ์ถ”๊ฐ€๋กœ ์š”๊ตฌํ•˜์ง€ ์•Š๋Š”๋‹ค. ๋‹จ, ์›๋ณธ์— ์—†๋Š” ๊ธฐ๋ณธ ํ–‰๋™์ด๋‚˜ ์ •์ฑ…์„ ์ƒˆ๋กœ ๋งŒ๋“ค์ง€ ์•Š๋Š”๋‹ค."),
82
+ }
83
+ # ๊ณผ์ œ๋ณ„ ๋ณด๊ธฐ โ€” {๋Œ๋ ค์ค„ ID: ๋ชจ๋ธ์—๊ฒŒ ๋ณด์—ฌ ์ค„ ๋ณด๊ธฐ ๋ฌธ๊ตฌ}
84
+ CRITERIA = {
85
+ "sentiment": {"๊ธ์ •": "๊ธ์ •์  ๊ฐ์ •", "๋ถ€์ •": "๋ถ€์ •์  ๊ฐ์ •"},
86
+ "nli": {"entailment": "entailment", "contradiction": "contradiction", "neutral": "neutral"},
87
+ "topic": {k: k for k in ["์‚ฌํšŒ", "IT๊ณผํ•™", "์„ธ๊ณ„", "์ƒํ™œ๋ฌธํ™”", "์ •์น˜", "์Šคํฌ์ธ ", "๊ฒฝ์ œ"]},
88
+ "hate": {"๋น„ํ˜์˜ค": "๋น„ํ˜์˜ค: ๋น„ํ•˜ยท๊ณต๊ฒฉ์„ฑ์ด ์—†๋Š” ํ‘œํ˜„", "ํ˜์˜ค": "ํ˜์˜คยท๋น„ํ•˜ยท๊ณต๊ฒฉ์  ํ‘œํ˜„"},
89
+ "offensive": {"์—†์Œ": "ํ˜์˜คยท๋ชจ์š•ยท๋ถˆ์พŒ ํ‘œํ˜„ ์—†์Œ",
90
+ "๊ณต๊ฒฉ์ ": "๋ฌด๋ก€ยท๊ณต๊ฒฉยท๋น„๊ผผ ๋“ฑ ๋ถˆ์พŒํ•˜์ง€๋งŒ ๊ฐ•ํ•œ ํ˜์˜ค/๋ชจ์š• ์ˆ˜์ค€์€ ์•„๋‹˜",
91
+ "ํ˜์˜ค": "๊ฐœ์ธ/์ง‘๋‹จ์— ๋Œ€ํ•œ ๊ฐ•ํ•œ ํ˜์˜ค ๋˜๋Š” ์‚ฌํšŒ์  ์ง€์œ„๋ฅผ ์‹ฌํ•˜๊ฒŒ ํ›ผ์†ํ•˜๋Š” ๋ชจ์š•; ์„ฑํฌ๋กฑ ํฌํ•จ"},
92
+ "yes_no": {"์˜ˆ": "์˜ˆ", "์•„๋‹ˆ์˜ค": "์•„๋‹ˆ์˜ค"},
93
+ "same_meaning": {"๊ฐ™์Œ": "๊ฐ™์€ ์˜๋ฏธ", "๋‹ค๋ฆ„": "์„œ๋กœ ๋‹ค๋ฅธ ์˜๋ฏธ"},
94
+ "similar": {"๊ฐ™์Œ": "๊ฐ™์€ ์˜๋ฏธ", "๋‹ค๋ฆ„": "๋‹ค๋ฅธ ์˜๋ฏธ"},
95
+ "policy_action": {"ASK_CLARIFICATION": "ASK_CLARIFICATION: ๋ถ€์กฑํ•œ ์ •๋ณด๋ฅผ ๊ณ ๊ฐ์—๊ฒŒ ๋˜๋ฌป๋Š”๋‹ค",
96
+ "ASK_CONFIRMATION": "ASK_CONFIRMATION: ์‹คํ–‰ ์ „์— ๋ช…์‹œ์  ํ™•์ธยท๋™์˜๋ฅผ ๋ฐ›๋Š”๋‹ค",
97
+ "ANSWER": "ANSWER: ๋„๊ตฌ ํ˜ธ์ถœ์ด๋‚˜ ์‹คํ–‰ ์—†์ด ์ •์ฑ…ยท์‚ฌ์‹ค ์ •๋ณด๋กœ ๋‹ตํ•œ๋‹ค",
98
+ "CALL_TOOL": "CALL_TOOL: ๋„๊ตฌ ํ•˜๋‚˜๋กœ ์‹คํ–‰ํ•˜๊ฑฐ๋‚˜ ์กฐํšŒํ•œ๋‹ค",
99
+ "CALL_MULTIPLE_TOOLS": "CALL_MULTIPLE_TOOLS: ๋‘˜ ์ด์ƒ์˜ ๋„๊ตฌ๋ฅผ ์ฐจ๋ก€๋กœ ํ˜ธ์ถœํ•œ๋‹ค",
100
+ "ESCALATE": "ESCALATE: ์ž๋™ ์ฒ˜๋ฆฌ๋ฅผ ๋ฉˆ์ถ”๊ณ  ์‚ฌ๋žŒ ์ƒ๋‹ด์‚ฌ์—๊ฒŒ ๋„˜๊ธด๋‹ค",
101
+ "REFUSE": "REFUSE: ์š”์ฒญ์„ ์ดํ–‰ํ•˜์ง€ ์•Š๊ณ  ์‚ฌ์œ ๋ฅผ ์•ˆ๋‚ดํ•œ๋‹ค"},
102
+ }
103
+ ASK = "ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ"
104
+ RESPOND = "RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด"
105
 
106
 
107
  def render_prompt(instruction, item, choices):
108
+ if isinstance(item, str):
109
+ item = {"text": item}
110
  lines = [f"{k}: {v if isinstance(v, str) else json.dumps(v, ensure_ascii=False)}" for k, v in item.items()]
111
  opts = "\n".join(f"{chr(65 + i)}. {c}" for i, c in enumerate(choices))
112
+ return "\n\n".join([(instruction or DEFAULT_INSTRUCTION).strip(), "\n".join(lines), "๋ณด๊ธฐ:\n" + opts, HINT])
113
 
114
 
115
  def chat_prefix(prompt):
116
  return f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
117
 
118
 
119
+ def check_choices(choices):
120
+ choices = [c["text"] if isinstance(c, dict) else str(c) for c in choices]
121
+ if not 2 <= len(choices) <= 26:
122
+ raise ValueError(f"๋ณด๊ธฐ๋Š” 2~26๊ฐœ์—ฌ์•ผ ํ•ฉ๋‹ˆ๋‹ค (์ง€๊ธˆ {len(choices)}๊ฐœ)")
123
+ if len(set(choices)) != len(choices):
124
+ raise ValueError("๋ณด๊ธฐ ๋ฌธ๊ตฌ๊ฐ€ ๊ฒน์นฉ๋‹ˆ๋‹ค. ๋ณด๊ธฐ๋งˆ๋‹ค ๋‹ค๋ฅธ ๋ฌธ๊ตฌ๋ฅผ ์จ ์ฃผ์„ธ์š”")
125
+ return choices
126
+
127
+
128
+ def load_temperature(model):
129
  p = Path(model) / "calibration.json"
130
  if not p.is_file():
131
  try:
132
  from huggingface_hub import hf_hub_download
133
  p = Path(hf_hub_download(model, "calibration.json"))
134
  except Exception:
135
+ warnings.warn(f"{model} ์—์„œ calibration.json ์„ ์ฐพ์ง€ ๋ชปํ•ด ๋ณด์ • ์—†์ด(์˜จ๋„ 1.0) ํ™•๋ฅ ์„ ๊ณ„์‚ฐํ•ฉ๋‹ˆ๋‹ค.")
136
  return 1.0
137
  return float(json.loads(p.read_text(encoding="utf-8"))["temperature"])
138
 
139
 
140
+ def letter_ids(tokenizer):
141
+ return [tokenizer.encode(chr(65 + i), add_special_tokens=False)[0] for i in range(26)]
142
+
143
+
144
+ def as_result(ids, probs):
145
+ """๋ณด๊ธฐ ์ˆœ์„œ์˜ ํ™•๋ฅ  โ†’ {'choice', 'confidence', 'probabilities'}"""
146
+ b = max(range(len(probs)), key=probs.__getitem__)
147
+ return {"choice": ids[b], "confidence": round(probs[b], 4), "probabilities": {i: round(p, 4) for i, p in zip(ids, probs)}}
148
+
149
+
150
+ def _criteria(criteria):
151
+ """{ID: ์„ค๋ช…} ๋˜๋Š” [์„ค๋ช…, โ€ฆ] โ†’ (ID ๋ชฉ๋ก, ์„ค๋ช… ๋ชฉ๋ก). ๋ฆฌ์ŠคํŠธ๋ฉด ์„ค๋ช…์ด ๊ณง ID."""
152
+ if isinstance(criteria, dict):
153
+ return [str(k) for k in criteria], check_choices(list(criteria.values()))
154
+ texts = check_choices(criteria)
155
+ return texts, texts
156
+
157
+
158
+ def _rows(**fields):
159
+ """๊ฐ’์ด ๋ชจ๋‘ ๋ฌธ์ž์—ด์ด๋ฉด ํ•ญ๋ชฉ ํ•˜๋‚˜, ๋ชจ๋‘ ๊ฐ™์€ ๊ธธ์ด์˜ ๋ฆฌ์ŠคํŠธ๋ฉด ํ•ญ๋ชฉ ์—ฌ๋Ÿฌ ๊ฐœ."""
160
+ vals = list(fields.values())
161
+ if all(isinstance(v, list) for v in vals):
162
+ if len({len(v) for v in vals}) != 1:
163
+ raise ValueError("๋ฆฌ์ŠคํŠธ๋กœ ์—ฌ๋Ÿฌ ๊ฐœ๋ฅผ ๋„ฃ์„ ๋•Œ๋Š” ๊ธธ์ด๊ฐ€ ๊ฐ™์•„์•ผ ํ•ฉ๋‹ˆ๋‹ค")
164
+ return [dict(zip(fields, row)) for row in zip(*vals)], True
165
+ return dict(fields), False
166
+
167
+
168
+ def _tool_name(t):
169
+ return (t.get("function") or t)["name"] if isinstance(t, dict) else str(t)
170
+
171
+
172
+ class Tasks:
173
+ """JEV ํ˜•์‹ decide() ์™€ ์ž์ฃผ ์“ฐ๋Š” ํŒ์ •. self(์ƒํ™ฉ, choices=โ€ฆ, instruction=โ€ฆ) ๋งŒ ์žˆ์œผ๋ฉด ๋œ๋‹ค (Judge ์™€ pipeline ์ด ํ•จ๊ป˜ ์“ด๋‹ค)."""
174
+
175
+ def _choose(self, state, criteria, instructions, many=False):
176
+ ids, texts = _criteria(criteria)
177
+ res = self(state, choices=texts, instruction=instructions)
178
+
179
+ def rename(r):
180
+ return as_result(ids, [r["probabilities"][t] for t in texts])
181
+ return [rename(r) for r in res] if many else rename(res)
182
+
183
+ def decide(self, state, questions):
184
+ """JEV ํ˜•์‹. state: ์ƒํ™ฉ(dict ๋˜๋Š” ๋ฌธ์žฅ). questions: {์งˆ๋ฌธ ์ด๋ฆ„: {"instructions": ์ง€์นจ, "criteria": {ID: ์„ค๋ช…}}}.
185
+ โ†’ {์งˆ๋ฌธ ์ด๋ฆ„: {'choice': ID, 'confidence': ํ™•๋ฅ , 'probabilities': {ID: ํ™•๋ฅ }}}"""
186
+ out = {}
187
+ for name, q in questions.items():
188
+ if q.get("type", "choice") != "choice":
189
+ raise ValueError(f"'{name}': ์ง€์›ํ•˜๋Š” type ์€ 'choice' ๋ฟ์ž…๋‹ˆ๋‹ค")
190
+ out[name] = self._choose(state, q["criteria"], q.get("instructions"))
191
+ return out
192
+
193
+ def sentiment(self, text):
194
+ """๊ฐ์ • โ†’ ๊ธ์ • / ๋ถ€์ •. ๋ฌธ์žฅ ํ•˜๋‚˜ ๋˜๋Š” ๋ฆฌ์ŠคํŠธ."""
195
+ return self._choose(text, CRITERIA["sentiment"], TASKS["sentiment"], isinstance(text, list))
196
+
197
+ def topic(self, headline):
198
+ """๋‰ด์Šค ์ œ๋ชฉ ์ฃผ์ œ โ†’ ์‚ฌํšŒ / IT๊ณผํ•™ / ์„ธ๊ณ„ / ์ƒํ™œ๋ฌธํ™” / ์ •์น˜ / ์Šคํฌ์ธ  / ๊ฒฝ์ œ."""
199
+ rows, many = _rows(headline=headline)
200
+ return self._choose(rows, CRITERIA["topic"], TASKS["topic"], many)
201
+
202
+ def hate(self, text):
203
+ """ํ˜์˜คยท๋น„ํ•˜ ํ‘œํ˜„ ์—ฌ๋ถ€ โ†’ ๋น„ํ˜์˜ค / ํ˜์˜ค."""
204
+ return self._choose(text, CRITERIA["hate"], TASKS["hate"], isinstance(text, list))
205
+
206
+ def offensive(self, comment, news_title=None):
207
+ """๋Œ“๊ธ€ ๊ณต๊ฒฉ์„ฑ 3๋‹จ๊ณ„ โ†’ ์—†์Œ / ๊ณต๊ฒฉ์  / ํ˜์˜ค. ๋‰ด์Šค ์ œ๋ชฉ์ด ์žˆ์œผ๋ฉด ๋ฌธ๋งฅ์œผ๋กœ ์“ด๋‹ค."""
208
+ rows, many = _rows(news_title=news_title, comments=comment) if news_title is not None else _rows(comments=comment)
209
+ return self._choose(rows, CRITERIA["offensive"], TASKS["offensive"], many)
210
+
211
+ def nli(self, premise, hypothesis):
212
+ """๋ฌธ์žฅ ๊ด€๊ณ„ โ†’ entailment / contradiction / neutral."""
213
+ rows, many = _rows(premise=premise, hypothesis=hypothesis)
214
+ return self._choose(rows, CRITERIA["nli"], TASKS["nli"], many)
215
+
216
+ def similar(self, sentence1, sentence2):
217
+ """๋‘ ๋ฌธ์žฅ์ด ๊ฐ™์€ ๋œป์ธ์ง€ โ†’ ๊ฐ™์Œ / ๋‹ค๋ฆ„."""
218
+ rows, many = _rows(sentence1=sentence1, sentence2=sentence2)
219
+ return self._choose(rows, CRITERIA["similar"], TASKS["similar"], many)
220
+
221
+ def yes_no(self, question, passage):
222
+ """์ง€๋ฌธ์— ๊ทผ๊ฑฐํ•œ ์˜ˆ/์•„๋‹ˆ์˜ค โ†’ ์˜ˆ / ์•„๋‹ˆ์˜ค."""
223
+ rows, many = _rows(paragraph=passage, question=question)
224
+ return self._choose(rows, CRITERIA["yes_no"], TASKS["yes_no"], many)
225
+
226
+ def same_meaning(self, word, context_1, context_2):
227
+ """๋‘ ๋ฌธ๋งฅ์—์„œ ๋‹จ์–ด ๋œป์ด ๊ฐ™์€์ง€ โ†’ ๊ฐ™์Œ / ๋‹ค๋ฆ„. ๋ฌธ๋งฅ ์•ˆ์˜ ๋‹จ์–ด๋Š” [๋‹จ์–ด]๋กœ ํ‘œ์‹œํ•˜๋ฉด ์ข‹๋‹ค."""
228
+ rows, many = _rows(word=word, context_1=context_1, context_2=context_2)
229
+ return self._choose(rows, CRITERIA["same_meaning"], TASKS["same_meaning"], many)
230
+
231
+ def reading(self, passage, question, choices):
232
+ """์ง€๋ฌธ ๋…ํ•ด ๊ฐ๊ด€์‹ โ†’ ๋ณด๊ธฐ ์ค‘ ํ•˜๋‚˜ (๋ฆฌ์ŠคํŠธ๋ฉด ๋ณด๊ธฐ ๋ฌธ๊ตฌ, dict ๋ฉด ID)."""
233
+ return self._choose({"passage": passage, "question": question}, choices, TASKS["reading"])
234
+
235
+ def next_action(self, messages, tools):
236
+ """์—์ด์ „ํŠธ์˜ ๋‹ค์Œ ํ–‰๋™ โ†’ CALL:<๋„๊ตฌ ์ด๋ฆ„> / ASK (ํ•„์ˆ˜ ์ •๋ณด ๋ถ€์กฑ) / RESPOND (์ง์ ‘ ๋‹ต๋ณ€).
237
+ messages: ์‚ฌ์šฉ์ž ๋ฌธ์žฅ(str) ๋˜๋Š” [{"role", "content"}, โ€ฆ]. tools: OpenAI ํ˜•์‹ ๋„๊ตฌ ๋ชฉ๋ก ๋˜๋Š” ์ด๋ฆ„ ๋ชฉ๋ก."""
238
+ if isinstance(messages, str):
239
+ messages = [{"role": "user", "content": messages}]
240
+ criteria = {f"CALL:{_tool_name(t)}": f"CALL:{_tool_name(t)}" for t in tools} | {"ASK": ASK, "RESPOND": RESPOND}
241
+ return self._choose({"messages": messages, "tools": tools}, criteria, TASKS["next_action"])
242
+
243
+ def policy_action(self, policy, request):
244
+ """์ •์ฑ…์— ๋”ฐ๋ฅธ ํ–‰๋™ โ†’ ASK_CLARIFICATION / ASK_CONFIRMATION / ANSWER / CALL_TOOL / CALL_MULTIPLE_TOOLS / ESCALATE / REFUSE."""
245
+ text = f"์ •์ฑ…: {policy}\n\n๊ณ ๊ฐ ์š”์ฒญ: \"{request}\"\n์œ„ ์ •์ฑ…์— ๋”ฐ๋ผ ์˜ฌ๋ฐ”๋ฅด๊ฒŒ ์ฒ˜๋ฆฌํ•˜๋ผ."
246
+ return self._choose({"policy_and_request": text}, CRITERIA["policy_action"], TASKS["policy_action"])
247
+
248
+
249
+ class Judge(Tasks):
250
+ def __init__(self, model=REPO, device=None, dtype=None):
251
  device = device or ("cuda" if torch.cuda.is_available() else "cpu")
252
  dtype = dtype or (torch.bfloat16 if device != "cpu" else torch.float32)
253
  self.tok = AutoTokenizer.from_pretrained(model)
254
  self.model = AutoModelForCausalLM.from_pretrained(model, dtype=dtype).to(device).eval()
255
  self.device = device
256
+ self.temperature = load_temperature(model)
257
+ self.letter_ids = letter_ids(self.tok)
258
 
259
+ def __call__(self, inputs, choices, instruction=None):
260
+ """inputs: ๋ฌธ์žฅ(str) ยท ์ƒํ™ฉ(dict) ยท ๊ทธ ๋ฆฌ์ŠคํŠธ. choices: [์„ค๋ช…, โ€ฆ] ๋˜๋Š” {ID: ์„ค๋ช…}. ๋ฆฌ์ŠคํŠธ๋ฅผ ์ฃผ๋ฉด ๊ฒฐ๊ณผ๋„ ๋ฆฌ์ŠคํŠธ."""
261
+ many = isinstance(inputs, list)
262
+ ids, texts = _criteria(choices)
263
+ out = self.decide_batch([{"instruction": instruction, "item": x, "choices": texts} for x in (inputs if many else [inputs])])
264
+ res = [as_result(ids, [r["probs"][chr(65 + i)] for i in range(len(texts))]) for r in out]
265
+ return res if many else res[0]
266
 
267
  @torch.no_grad()
268
  def decide_batch(self, requests, batch_size=16, max_tokens=8000):
269
+ """์ €์ˆ˜์ค€ ๋ฌถ์Œ ํŒ์ • (ํ‰๊ฐ€ ์Šคํฌ๋ฆฝํŠธ์šฉ).
270
+ requests: [{"instruction": str, "item": dict|str, "choices": [str, โ€ฆ]}, โ€ฆ] โ†’ ๊ฐ™์€ ์ˆœ์„œ์˜ ๊ฒฐ๊ณผ ๋ชฉ๋ก.
271
+ ๊ฒฐ๊ณผ: {'choice': 'A', 'index': 0, 'text': ๋ณด๊ธฐ, 'confidence': ํ™•๋ฅ , 'probs': {'A': โ€ฆ, 'B': โ€ฆ}}
272
+ ๊ธธ์ด๊ฐ€ ๋น„์Šทํ•œ ๊ฒƒ๋ผ๋ฆฌ ๋ฌถ์–ด ๊ณ„์‚ฐํ•œ๋‹ค (์˜ค๋ฅธ์ชฝ์„ ์ฑ„์šฐ๊ณ  ๊ฐ ๋ฌธ์žฅ์˜ ๋งˆ์ง€๋ง‰ ์ž๋ฆฌ๋งŒ ์ฝ์œผ๋ฏ€๋กœ ๊ฒฐ๊ณผ๋Š” ํ•˜๋‚˜์”ฉ ๊ณ„์‚ฐํ•œ ๊ฒƒ๊ณผ ๊ฐ™๋‹ค)."""
273
  seqs = []
274
  for r in requests:
275
+ ch = check_choices(r["choices"])
276
+ ids = self.tok.encode(chat_prefix(render_prompt(r.get("instruction"), r["item"], ch)), add_special_tokens=False)
277
+ seqs.append((ids, ch))
 
278
  order = sorted(range(len(seqs)), key=lambda i: len(seqs[i][0]))
279
  out = [None] * len(seqs)
280
  W = self.model.get_output_embeddings().weight
 
292
  for r, k in enumerate(grp):
293
  ids, ch = seqs[k]
294
  rows = torch.tensor(self.letter_ids[:len(ch)], device=self.device)
295
+ p = torch.softmax((h[r, len(ids) - 1].float() @ W[rows].float().T) / self.temperature, -1).tolist()
 
296
  b = max(range(len(p)), key=p.__getitem__)
297
  out[k] = {"choice": chr(65 + b), "index": b, "text": ch[b], "confidence": round(p[b], 4),
298
  "probs": {chr(65 + j): round(v, 4) for j, v in enumerate(p)}}
299
  return out
300
 
 
 
 
301
 
302
  if __name__ == "__main__":
303
  import sys
304
  j = Judge(sys.argv[1] if len(sys.argv) > 1 else ".")
305
+ print(j.sentiment("๋ฐฐ์†ก์€ ๋А๋ ธ์ง€๋งŒ ๋ฌผ๊ฑด์€ ์ •๋ง ๋งˆ์Œ์— ๋“ค์–ด์š”"))
judge_pipeline.py ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """transformers pipeline ์œผ๋กœ KJH-Judge-4B-ko ๋ฅผ ์“ด๋‹ค (trust_remote_code=True ์ผ ๋•Œ ์ž๋™์œผ๋กœ ๋ถˆ๋ฆฐ๋‹ค).
2
+
3
+ from transformers import pipeline
4
+ judge = pipeline(model="coderecode95/KJH-Judge-4B-ko", trust_remote_code=True, device=0, dtype="bfloat16")
5
+
6
+ judge.decide(state={...}, questions={"์ด๋ฆ„": {"instructions": "โ€ฆ", "criteria": {"ID": "์„ค๋ช…", โ€ฆ}}}) # JEV ํ˜•์‹
7
+ judge.sentiment("๋ฐฐ์†ก์€ ๋А๋ ธ์ง€๋งŒ ๋ฌผ๊ฑด์€ ์ •๋ง ๋งˆ์Œ์— ๋“ค์–ด์š”") # ์ž์ฃผ ์“ฐ๋Š” ํŒ์ •
8
+ judge("์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”", choices=["๊ฒฐ์ œยทํ™˜๋ถˆ", "๋ฐฐ์†ก", "๊ธฐํƒ€"], instruction="โ€ฆ") # ํ•œ ์ค„๋กœ
9
+ # ๊ฒฐ๊ณผ๋Š” ๋ชจ๋‘ {'choice': โ€ฆ, 'confidence': โ€ฆ, 'probabilities': {โ€ฆ}}
10
+
11
+ ์‚ฌ์šฉ๋ฒ• ์ „์ฒด๋Š” judge.py ๋งจ ์œ„ ์„ค๋ช…์„ ๋ณด์„ธ์š”.
12
+ """
13
+ import torch
14
+ from transformers import Pipeline
15
+
16
+ from .judge import Tasks, _criteria, as_result, chat_prefix, letter_ids, load_temperature, render_prompt
17
+
18
+
19
+ class KJHJudgePipeline(Tasks, Pipeline):
20
+ def __init__(self, *args, **kwargs):
21
+ super().__init__(*args, **kwargs)
22
+ self.temperature = load_temperature(self.model.name_or_path)
23
+ self.letter_ids = letter_ids(self.tokenizer)
24
+
25
+ def _sanitize_parameters(self, choices=None, instruction=None, **kwargs):
26
+ pre, post = {}, {}
27
+ if choices is not None:
28
+ post["ids"], pre["choices"] = _criteria(choices)
29
+ if instruction is not None:
30
+ pre["instruction"] = instruction
31
+ return pre, {}, post
32
+
33
+ def preprocess(self, inputs, choices=None, instruction=None):
34
+ if choices is None:
35
+ raise ValueError("choices=[๋ณด๊ธฐ1, ๋ณด๊ธฐ2, โ€ฆ] ๋˜๋Š” {ID: ์„ค๋ช…} ์„ ๋„ฃ์–ด ์ฃผ์„ธ์š”")
36
+ enc = self.tokenizer(chat_prefix(render_prompt(instruction, inputs, choices)), add_special_tokens=False, return_tensors="pt")
37
+ return {"input_ids": enc["input_ids"], "attention_mask": enc["attention_mask"]}
38
+
39
+ def _forward(self, model_inputs):
40
+ mask = model_inputs["attention_mask"]
41
+ h = self.model.model(input_ids=model_inputs["input_ids"], attention_mask=mask).last_hidden_state
42
+ if self.tokenizer.padding_side == "left":
43
+ last = h[:, -1]
44
+ else:
45
+ last = h[torch.arange(h.size(0), device=h.device), mask.sum(-1) - 1]
46
+ W = self.model.get_output_embeddings().weight
47
+ rows = torch.tensor(self.letter_ids, device=h.device)
48
+ return {"logits": last.float() @ W[rows].float().T}
49
+
50
+ def postprocess(self, model_outputs, ids=None):
51
+ scores = model_outputs["logits"].reshape(-1)[:len(ids)].float() / self.temperature
52
+ return as_result(ids, torch.softmax(scores, -1).tolist())
quickstart.ipynb ADDED
@@ -0,0 +1,204 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cells": [
3
+ {
4
+ "cell_type": "markdown",
5
+ "metadata": {},
6
+ "source": [
7
+ "# KJH-Judge-4B-ko ๋น ๋ฅธ ํ…Œ์ŠคํŠธ\n",
8
+ "\n",
9
+ "ํ—ˆ๊น…ํŽ˜์ด์Šค์— ์˜ฌ๋ฆฐ ๋ชจ๋ธ์„ ๋‚ด๋ ค๋ฐ›์•„ ํŒ์ •ํ•ด ๋ด…๋‹ˆ๋‹ค.\n",
10
+ "\n",
11
+ "- **GPU ๋Ÿฐํƒ€์ž„**์—์„œ ์‹คํ–‰ํ•˜์„ธ์š” (Colab: ๋Ÿฐํƒ€์ž„ โ†’ ๋Ÿฐํƒ€์ž„ ์œ ํ˜• ๋ณ€๊ฒฝ โ†’ T4 GPU). CPU์—์„œ๋Š” ํŒ์ • ํ•œ ๋ฒˆ์— ์ˆ˜์‹ญ ์ดˆ ์ด์ƒ ๊ฑธ๋ฆฌ๊ณ  ๋ฉ”๋ชจ๋ฆฌ๋„ 16GB ๋„˜๊ฒŒ ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.\n",
12
+ "- ๋ชจ๋ธ ๋‚ด๋ ค๋ฐ›๊ธฐ์— ๋ช‡ ๋ถ„ ๊ฑธ๋ฆฝ๋‹ˆ๋‹ค (์•ฝ 8GB).\n",
13
+ "- ๊ฒฐ๊ณผ๋Š” ๋ชจ๋‘ `{'choice': ๊ณ ๋ฅธ ๋ณด๊ธฐ, 'confidence': ๊ทธ ํ™•๋ฅ , 'probabilities': ๋ณด๊ธฐ๋ณ„ ํ™•๋ฅ }` ๋ชจ์–‘์ž…๋‹ˆ๋‹ค."
14
+ ]
15
+ },
16
+ {
17
+ "cell_type": "code",
18
+ "execution_count": null,
19
+ "metadata": {},
20
+ "outputs": [],
21
+ "source": [
22
+ "%pip install -q -U \"transformers>=5\" accelerate\n",
23
+ "# Colab์—์„œ transformers ๊ฐ€ ์ด๋ฏธ 4.x ๋กœ ๊น”๋ ค ์žˆ์—ˆ๋‹ค๋ฉด, ์„ค์น˜ ํ›„ '๋Ÿฐํƒ€์ž„ โ†’ ์„ธ์…˜ ๋‹ค์‹œ ์‹œ์ž‘'์„ ํ•œ ๋ฒˆ ํ•˜๊ณ  ์•„๋ž˜ ์…€๋ถ€ํ„ฐ ์‹คํ–‰ํ•˜์„ธ์š”."
24
+ ]
25
+ },
26
+ {
27
+ "cell_type": "markdown",
28
+ "metadata": {},
29
+ "source": [
30
+ "์ €์žฅ์†Œ๊ฐ€ **๋น„๊ณต๊ฐœ**๋ผ๋ฉด ์•„๋ž˜ ์…€์˜ ์ฃผ์„์„ ํ’€๊ณ  ํ† ํฐ์œผ๋กœ ๋กœ๊ทธ์ธํ•˜์„ธ์š” (Colab์€ ์™ผ์ชฝ ์—ด์‡  ์•„์ด์ฝ˜์˜ ๋ณด์•ˆ ๋น„๋ฐ€์— `HF_TOKEN`์„ ๋„ฃ์–ด ๋‘๋ฉด ์ž๋™์œผ๋กœ ์”๋‹ˆ๋‹ค)."
31
+ ]
32
+ },
33
+ {
34
+ "cell_type": "code",
35
+ "execution_count": null,
36
+ "metadata": {},
37
+ "outputs": [],
38
+ "source": [
39
+ "# from huggingface_hub import login\n",
40
+ "# login()"
41
+ ]
42
+ },
43
+ {
44
+ "cell_type": "code",
45
+ "execution_count": null,
46
+ "metadata": {},
47
+ "outputs": [],
48
+ "source": [
49
+ "import torch\n",
50
+ "from transformers import pipeline\n",
51
+ "\n",
52
+ "gpu = torch.cuda.is_available()\n",
53
+ "print(\"GPU:\", torch.cuda.get_device_name(0) if gpu else \"์—†์Œ (CPU, ๋งค์šฐ ๋А๋ฆผ)\")\n",
54
+ "\n",
55
+ "judge = pipeline(model=\"coderecode95/KJH-Judge-4B-ko\", trust_remote_code=True,\n",
56
+ " device=0 if gpu else -1, dtype=\"bfloat16\" if gpu else \"float32\")"
57
+ ]
58
+ },
59
+ {
60
+ "cell_type": "markdown",
61
+ "metadata": {},
62
+ "source": [
63
+ "## 1. ์ž์ฃผ ์“ฐ๋Š” ํŒ์ • โ€” ๋ฉ”์„œ๋“œ ํ•˜๋‚˜๋กœ\n",
64
+ "\n",
65
+ "ํ•™์Šต ๋•Œ์™€ ๊ฐ™์€ ์ง€์นจยท๋ณด๊ธฐ๊ฐ€ ์ž๋™์œผ๋กœ ๋“ค์–ด๊ฐ‘๋‹ˆ๋‹ค."
66
+ ]
67
+ },
68
+ {
69
+ "cell_type": "code",
70
+ "execution_count": null,
71
+ "metadata": {},
72
+ "outputs": [],
73
+ "source": [
74
+ "judge.sentiment(\"๋ฐฐ์†ก์€ ๋А๋ ธ์ง€๋งŒ ๋ฌผ๊ฑด์€ ์ •๋ง ๋งˆ์Œ์— ๋“ค์–ด์š”\")"
75
+ ]
76
+ },
77
+ {
78
+ "cell_type": "code",
79
+ "execution_count": null,
80
+ "metadata": {},
81
+ "outputs": [],
82
+ "source": [
83
+ "print(judge.nli(\"ํก์—ฐ์ž๋ถ„๋“ค์€ ๋ฐœ์ฝ”๋‹ˆ๊ฐ€ ์žˆ๋Š” ๋ฐฉ์ด๋ฉด ๋ฐœ์ฝ”๋‹ˆ์—์„œ ํก์—ฐ์ด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค.\", \"์–ด๋–ค ๋ฐฉ์—์„œ๋„ ํก์—ฐ์€ ๊ธˆ์ง€๋ฉ๋‹ˆ๋‹ค.\"))\n",
84
+ "print(judge.topic(\"์†ํฅ๋ฏผ, ์‹œ์ฆŒ 10ํ˜ธ๊ณจโ€ฆํ† ํŠธ๋„˜ 3์—ฐ์Šน ์ด๋Œ์–ด\"))\n",
85
+ "print(judge.hate(\"์—ฐ๊ธฐ ์ง„์งœ ๋งŽ์ด ๋Š˜์—ˆ๋‹ค ๋‹ค์Œ ์ž‘ํ’ˆ๋„ ๊ธฐ๋Œ€๋จ\"))\n",
86
+ "print(judge.yes_no(\"์ฝœ๋ผ๋…๋ฆฝ 815๋Š” ์ฝ”์นด์ฝœ๋ผ์—์„œ ๋งŒ๋“ค์—ˆ๋‚˜์š”?\",\n",
87
+ " \"์ฝœ๋ผ๋…๋ฆฝ 815๋Š” ์ฝ”์นด์ฝœ๋ผ๋ฅผ ๋ผ์ด์„ ์Šค๋กœ ๋งŒ๋“ค์–ด ์˜ค๋˜ ๋ฒ”์–‘์‹ํ’ˆ์ด 1998๋…„์— ์ถœ์‹œํ•œ ํƒ„์‚ฐ์Œ๋ฃŒ๋‹ค.\"))"
88
+ ]
89
+ },
90
+ {
91
+ "cell_type": "code",
92
+ "execution_count": null,
93
+ "metadata": {},
94
+ "outputs": [],
95
+ "source": [
96
+ "# ์—์ด์ „ํŠธ์˜ ๋‹ค์Œ ํ–‰๋™: ํ•„์ˆ˜ ์ •๋ณด๊ฐ€ ๋น ์กŒ์œผ๋ฉด ASK, ๋‹ค ์žˆ์œผ๋ฉด CALL, ๋„๊ตฌ๊ฐ€ ํ•„์š” ์—†์œผ๋ฉด RESPOND\n",
97
+ "tools = [\n",
98
+ " {\"type\": \"function\", \"function\": {\"name\": \"call_taxi\", \"description\": \"ํƒ์‹œ๋ฅผ ํ˜ธ์ถœํ•œ๋‹ค\",\n",
99
+ " \"parameters\": {\"type\": \"object\", \"properties\": {\"pickup\": {\"type\": \"string\"}, \"destination\": {\"type\": \"string\"}}, \"required\": [\"pickup\", \"destination\"]}}},\n",
100
+ " {\"type\": \"function\", \"function\": {\"name\": \"get_weather\", \"description\": \"์ง€์—ญ์˜ ํ˜„์žฌ ๋‚ ์”จ๋ฅผ ์•Œ๋ ค์ค€๋‹ค\",\n",
101
+ " \"parameters\": {\"type\": \"object\", \"properties\": {\"city\": {\"type\": \"string\"}}, \"required\": [\"city\"]}}},\n",
102
+ "]\n",
103
+ "for msg in [\"ํƒ์‹œ ์ข€ ๋ถˆ๋Ÿฌ์ค˜\", \"๊ฐ•๋‚จ์—ญ์—์„œ ์„œ์šธ์—ญ๊นŒ์ง€ ํƒ์‹œ ๋ถˆ๋Ÿฌ์ค˜\", \"๋ถ€์‚ฐ ๋‚ ์”จ ์–ด๋•Œ?\", \"๊ณ ๋งˆ์›Œ!\"]:\n",
104
+ " r = judge.next_action(msg, tools)\n",
105
+ " print(f\"{r['choice']:<18} {r['confidence']:.1%} โ† {msg}\")"
106
+ ]
107
+ },
108
+ {
109
+ "cell_type": "code",
110
+ "execution_count": null,
111
+ "metadata": {},
112
+ "outputs": [],
113
+ "source": [
114
+ "# ๋ฆฌ์ŠคํŠธ๋ฅผ ๋„ฃ์œผ๋ฉด ์—ฌ๋Ÿฌ ๊ฐœ๋ฅผ ํ•œ ๋ฒˆ์—\n",
115
+ "headlines = [\"์†ํฅ๋ฏผ, ์‹œ์ฆŒ 10ํ˜ธ๊ณจโ€ฆํ† ํŠธ๋„˜ 3์—ฐ์Šน ์ด๋Œ์–ด\", \"์ฝ”์Šคํ”ผ 2,700 ๋ŒํŒŒโ€ฆ์™ธ๊ตญ์ธ ์ˆœ๋งค์ˆ˜\", \"์ƒˆ ์Šค๋งˆํŠธํฐ ๊ณต๊ฐœ, AI ๊ธฐ๋Šฅ ๊ฐ•ํ™”\", \"๊ตญํšŒ ๋ณธํšŒ์˜์„œ ์˜ˆ์‚ฐ์•ˆ ํ†ต๊ณผ\"]\n",
116
+ "for h, r in zip(headlines, judge.topic(headlines)):\n",
117
+ " print(f\"{r['choice']:<5} {r['confidence']:.1%} {h}\")"
118
+ ]
119
+ },
120
+ {
121
+ "cell_type": "markdown",
122
+ "metadata": {},
123
+ "source": [
124
+ "## 2. ๋‚ด ํŒ์ • ๋งŒ๋“ค๊ธฐ โ€” JEV ํ˜•์‹\n",
125
+ "\n",
126
+ "์ƒํ™ฉ(`state`) ํ•˜๋‚˜์— ์ด๋ฆ„ ๋ถ™์ธ ์งˆ๋ฌธ ์—ฌ๋Ÿฌ ๊ฐœ๋ฅผ ํ•œ ๋ฒˆ์— ๋ฌป์Šต๋‹ˆ๋‹ค. `criteria`์˜ ํ‚ค(ID)๊ฐ€ ๊ฒฐ๊ณผ๋กœ ๋Œ์•„์˜ต๋‹ˆ๋‹ค."
127
+ ]
128
+ },
129
+ {
130
+ "cell_type": "code",
131
+ "execution_count": null,
132
+ "metadata": {},
133
+ "outputs": [],
134
+ "source": [
135
+ "judge.decide(\n",
136
+ " state={\"๊ณ ๊ฐ ๋ฌธ์˜\": \"์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”. ์˜ค๋Š˜ ์•ˆ์— ์ฒ˜๋ฆฌํ•ด ์ฃผ์„ธ์š”.\"},\n",
137
+ " questions={\n",
138
+ " \"๋ถ€์„œ\": {\n",
139
+ " \"instructions\": \"๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.\",\n",
140
+ " \"criteria\": {\"billing\": \"๊ฒฐ์ œยทํ™˜๋ถˆ\", \"delivery\": \"๋ฐฐ์†ก\", \"account\": \"๊ณ„์ •ยท๋กœ๊ทธ์ธ\", \"other\": \"๊ธฐํƒ€\"},\n",
141
+ " },\n",
142
+ " \"๊ธด๊ธ‰\": {\n",
143
+ " \"instructions\": \"๊ณ ๊ฐ์ด ์ฆ‰์‹œ ์ฒ˜๋ฆฌ๋ฅผ ์š”๊ตฌํ•˜๋Š”์ง€ ํŒ๋‹จํ•œ๋‹ค.\",\n",
144
+ " \"criteria\": {\"urgent\": \"์ฆ‰์‹œ ์ฒ˜๋ฆฌ ์š”๊ตฌ\", \"normal\": \"์ผ๋ฐ˜ ๋ฌธ์˜\"},\n",
145
+ " },\n",
146
+ " },\n",
147
+ ")"
148
+ ]
149
+ },
150
+ {
151
+ "cell_type": "markdown",
152
+ "metadata": {},
153
+ "source": [
154
+ "## 3. ํ™•์‹ ์ด ๋‚ฎ์œผ๋ฉด ์‚ฌ๋žŒ์—๊ฒŒ ๋„˜๊ธฐ๊ธฐ\n",
155
+ "\n",
156
+ "๊ธฐ์ค€๊ฐ’(์—ฌ๊ธฐ์„œ๋Š” 0.7)์€ ์‹ค์ œ๋กœ ์“ธ ๋ฐ์ดํ„ฐ์—์„œ ๋‹ค์‹œ ๋งž์ถ”๋Š” ๊ฒƒ์ด ์ข‹์Šต๋‹ˆ๋‹ค. ํ•™์Šตํ•˜์ง€ ์•Š์€ ๋ฐ์ดํ„ฐ์—์„œ๋Š” ํ™•์‹ ์ด ์ •ํ™•๋„๋ณด๋‹ค ์กฐ๊ธˆ ๋†’๊ฒŒ ๋‚˜์˜ต๋‹ˆ๋‹ค."
157
+ ]
158
+ },
159
+ {
160
+ "cell_type": "code",
161
+ "execution_count": null,
162
+ "metadata": {},
163
+ "outputs": [],
164
+ "source": [
165
+ "reviews = [\"๋ฐฐ์†ก ์ฐธ ๋น ๋ฅด๋„ค์š”. 2์ฃผ ๊ฑธ๋ ธ์–ด์š”\", \"๊ฐ€๊ฒฉ ๋Œ€๋น„ ๊ดœ์ฐฎ์•„์š”\", \"๋‹ค์‹œ๋Š” ์•ˆ ์‚ฝ๋‹ˆ๋‹ค\", \"๊ทธ๋ƒฅ ๊ทธ๋ž˜์š”\"]\n",
166
+ "for t, r in zip(reviews, judge.sentiment(reviews)):\n",
167
+ " print(f\"{r['choice']} {r['confidence']:.1%} {'์ž๋™ ์ฒ˜๋ฆฌ' if r['confidence'] >= 0.7 else 'โ†’ ์‚ฌ๋žŒ ๊ฒ€ํ† ':<8} {t}\")"
168
+ ]
169
+ },
170
+ {
171
+ "cell_type": "markdown",
172
+ "metadata": {},
173
+ "source": [
174
+ "## 4. ํ•œ ์ค„๋กœ ์ง์ ‘ ํ•ด ๋ณด๊ธฐ"
175
+ ]
176
+ },
177
+ {
178
+ "cell_type": "code",
179
+ "execution_count": null,
180
+ "metadata": {},
181
+ "outputs": [],
182
+ "source": [
183
+ "judge(\"์ด ์•ฑ ๋กœ๊ทธ์ธ์ด ๊ณ„์† ์•ˆ ๋ผ์š”. ๋น„๋ฐ€๋ฒˆํ˜ธ๋ฅผ ๋ฐ”๊ฟ”๋„ ๋˜‘๊ฐ™์•„์š”.\",\n",
184
+ " choices=[\"๊ฒฐ์ œยทํ™˜๋ถˆ\", \"๋ฐฐ์†ก\", \"๊ณ„์ •ยท๋กœ๊ทธ์ธ\", \"์ œํ’ˆ ๋ฌธ์˜\", \"๊ธฐํƒ€\"],\n",
185
+ " instruction=\"๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.\")"
186
+ ]
187
+ }
188
+ ],
189
+ "metadata": {
190
+ "accelerator": "GPU",
191
+ "colab": {
192
+ "provenance": []
193
+ },
194
+ "kernelspec": {
195
+ "display_name": "Python 3",
196
+ "name": "python3"
197
+ },
198
+ "language_info": {
199
+ "name": "python"
200
+ }
201
+ },
202
+ "nbformat": 4,
203
+ "nbformat_minor": 0
204
+ }
space/README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: KJH-Judge-4B-ko Showreel
3
+ emoji: ๐ŸŽฌ
4
+ colorFrom: indigo
5
+ colorTo: blue
6
+ sdk: static
7
+ app_file: index.html
8
+ pinned: false
9
+ license: cc-by-sa-4.0
10
+ models:
11
+ - coderecode95/KJH-Judge-4B-ko
12
+ short_description: ์‹ค์ œ ํŒ์ • ๊ฒฐ๊ณผ๋กœ ๋งŒ๋“  KJH-Judge-4B-ko ์†Œ๊ฐœ ์‡ผ๋ฆด
13
+ ---
14
+
15
+ # KJH-Judge-4B-ko ์‡ผ๋ฆด
16
+
17
+ [KJH-Judge-4B-ko](https://huggingface.co/coderecode95/KJH-Judge-4B-ko)๋ฅผ ์†Œ๊ฐœํ•˜๋Š” ์•ฝ 2๋ถ„์งœ๋ฆฌ ์ž๋™ ์žฌ์ƒ ํŽ˜์ด์ง€์ž…๋‹ˆ๋‹ค. ํ™”๋ฉด์˜ ์ˆซ์ž์™€ ํŒ์ •์€ ๋ชจ๋‘ ์ด ๋ชจ๋ธ๋กœ ๋ฏธ๋ฆฌ ๊ณ„์‚ฐํ•ด ์ €์žฅํ•œ **์‹ค์ œ ์ถœ๋ ฅ**์ด๋ฉฐ, ํŽ˜์ด์ง€๊ฐ€ ๋ชจ๋ธ์„ ์ง์ ‘ ๋Œ๋ฆฌ์ง€๋Š” ์•Š์Šต๋‹ˆ๋‹ค.
18
+
19
+ - ์กฐ์ž‘: `Space` ์ผ์‹œ์ •์ง€ ยท `โ†` `โ†’` ์žฅ๋ฉด ์ด๋™ ยท `1`~`0` ์žฅ๋ฉด ๋ฐ”๋กœ๊ฐ€๊ธฐ ยท `R` ์ฒ˜์Œ๋ถ€ํ„ฐ ยท `C` ์ž๋ง‰ ยท `H` ์กฐ์ž‘๋ฐ” ์ˆจ๊น€ ยท `F` ์ „์ฒดํ™”๋ฉด
20
+ - ์ฃผ์†Œ ์˜ต์…˜: `?s=3` 3๋ฒˆ ์žฅ๋ฉด๋ถ€ํ„ฐ ยท `?loop=1` ๋ฐ˜๋ณต ยท `?cap=0` ์ž๋ง‰ ๋” ยท `?hold=1` ์ž๋™ ๋„˜๊น€ ๋”
21
+
22
+ ## ์ฃผ์˜
23
+
24
+ - ์ˆœ์œ„ ์žฅ๋ฉด์˜ ๋‹ค๋ฅธ ๋ชจ๋ธ ์ ์ˆ˜๋Š” Korean JEV Benchmark ๊ณต๊ฐœ ํ‘œ(2026-10-09)์˜ 0-shot ๊ฒฐ๊ณผ์ž…๋‹ˆ๋‹ค. KJH-Judge-4B-ko๋Š” ๊ฐ™์€ ์ถœ์ฒ˜ ๋ฐ์ดํ„ฐ์˜ ํ•™์Šต ๋ถ„ํ• ๋กœ ๋ฏธ์„ธ์กฐ์ •ํ–ˆ์œผ๋ฏ€๋กœ ๊ฐ™์€ ์กฐ๊ฑด์˜ ๋น„๊ต๊ฐ€ ์•„๋‹™๋‹ˆ๋‹ค.
25
+ - ํŒ์ • ์‹œ๊ฐ„(์•ฝ 0.08์ดˆ)์€ GPU 1์žฅ์—์„œ ์„œ๋ฒ„ ์•ˆ ๊ณ„์‚ฐ ์‹œ๊ฐ„์ด๋ฉฐ ๋„คํŠธ์›Œํฌ ์™•๋ณต์€ ํฌํ•จํ•˜์ง€ ์•Š์Šต๋‹ˆ๋‹ค.
26
+
27
+ ## ์ถœ์ฒ˜
28
+
29
+ - ํ•œ๊ตญ์–ด ๋ฌธ์ œ 3๊ฐœ: [KoBEST](https://huggingface.co/datasets/skt/kobest_v1) WiCยทCOPA, [KLUE](https://huggingface.co/datasets/klue/klue) YNAT โ€” CC BY-SA 4.0. ์ด ๋•Œ๋ฌธ์— ์ด Space๋Š” CC BY-SA 4.0์œผ๋กœ ๊ณต๊ฐœํ•ฉ๋‹ˆ๋‹ค.
30
+ - ๋ฒค์น˜๋งˆํฌ: [Korean JEV Benchmark](https://huggingface.co/datasets/DaehanKim/korean-jev-benchmark)
31
+ - ๊ณ ๊ฐ ๋ฌธ์˜ยท๋‰ด์Šคยท๋Œ€ํ™” ์˜ˆ์‹œ๋Š” ์ง์ ‘ ๋งŒ๋“  ๋ฌธ์žฅ์ด๋ฉฐ, ๋‰ด์Šค์˜ ํšŒ์‚ฌ๋Š” ๊ฐ€์ƒ์ž…๋‹ˆ๋‹ค.
space/index.html ADDED
@@ -0,0 +1,801 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ <!doctype html>
2
+ <html lang="ko">
3
+ <head>
4
+ <meta charset="utf-8">
5
+ <meta name="viewport" content="width=device-width, initial-scale=1">
6
+ <title>KJH-Judge-4B-ko ์‡ผ๋ฆด</title>
7
+ <!-- ์˜์ƒ ์ดฌ์˜์šฉ ์ž๋™ ์žฌ์ƒ ํŽ˜์ด์ง€ ยท KJH-Judge-4B-ko
8
+ 1920ร—1080 ๋ฌด๋Œ€๋ฅผ ์ฐฝ ํฌ๊ธฐ์— ๋งž์ถฐ ๋Š˜๋ฆฌ๊ณ , ์žฅ๋ฉด๋งˆ๋‹ค ์ €์žฅ๋œ '์‹ค์ œ ๋ชจ๋ธ ํŒ์ • ๊ฒฐ๊ณผ'๋งŒ ์žฌ์ƒํ•œ๋‹ค (์„œ๋ฒ„ ๋ถˆํ•„์š”).
9
+ ์กฐ์ž‘: Space ์ผ์‹œ์ •์ง€ ยท โ†/โ†’ ์žฅ๋ฉด ์ด๋™ ยท 1~9,0 ์žฅ๋ฉด ๋ฐ”๋กœ๊ฐ€๊ธฐ ยท R ์ฒ˜์Œ๋ถ€ํ„ฐ ยท H ์กฐ์ž‘๋ฐ” ์ˆจ๊น€ ยท C ์ž๋ง‰ ยท F ์ „์ฒดํ™”๋ฉด
10
+ ์ฃผ์†Œ ์˜ต์…˜: ?s=3 (3๋ฒˆ ์žฅ๋ฉด๋ถ€ํ„ฐ) ยท ?loop=1 (๋ฐ˜๋ณต) ยท ?cap=0 (์ž๋ง‰ ๋”) ยท ?clean=1 (์กฐ์ž‘๋ฐ” ์ˆจ๊ธฐ๊ณ  ์‹œ์ž‘) ยท ?hold=1 (์ž๋™ ๋„˜๊น€ ๋”) ยท ?at=4000 (์žฅ๋ฉด ์•ˆ 4์ดˆ ์ง€์ ๋ถ€ํ„ฐ) -->
11
+ <link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/orioncactus/pretendard@v1.3.9/dist/web/variable/pretendardvariable-dynamic-subset.min.css">
12
+ <link rel="preconnect" href="https://fonts.googleapis.com"><link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
13
+ <link rel="stylesheet" href="https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;500;600;700&display=swap">
14
+ <style>
15
+ :root{
16
+ --bg:#04060b;--ink:#f4f6fb;--ink2:#cdd3df;--muted:#8b94a7;--faint:#566074;
17
+ --stroke:rgba(255,255,255,.085);--stroke2:rgba(255,255,255,.15);
18
+ --grad:linear-gradient(100deg,#b9a6ff 0%,#72b8ff 48%,#5ff0d2 100%);
19
+ --call:#6aa6ff;--ask:#ffb44d;--respond:#3ee0b0;--good:#4ade80;--bad:#ff6b5e;--hi:#ffd36b;
20
+ --sans:"Pretendard Variable","Pretendard",-apple-system,"Apple SD Gothic Neo","Malgun Gothic",sans-serif;
21
+ --mono:"JetBrains Mono","IBM Plex Mono",Consolas,monospace;
22
+ --ease:cubic-bezier(.2,.8,.2,1);
23
+ }
24
+ *{box-sizing:border-box}
25
+ html,body{margin:0;height:100%;background:#000;overflow:hidden}
26
+ body{color:var(--ink);font-family:var(--sans);-webkit-font-smoothing:antialiased;word-break:keep-all;font-feature-settings:"tnum" 0}
27
+ body.idle{cursor:none}
28
+
29
+ /* โ”€โ”€ ๋ฌด๋Œ€ โ”€โ”€ */
30
+ #stage{position:absolute;left:50%;top:50%;width:1920px;height:1080px;transform-origin:center;overflow:hidden;background:var(--bg);isolation:isolate}
31
+ #aurora{position:absolute;inset:0;z-index:0;overflow:hidden}
32
+ #aurora .b{position:absolute;border-radius:50%;filter:blur(150px);opacity:.42;transition:background-color 1.8s ease}
33
+ #aurora .b1{width:1100px;height:900px;left:-320px;top:-380px;animation:d1 22s ease-in-out infinite alternate}
34
+ #aurora .b2{width:1000px;height:900px;right:-360px;top:-200px;animation:d2 26s ease-in-out infinite alternate}
35
+ #aurora .b3{width:1300px;height:700px;left:320px;bottom:-560px;opacity:.3;animation:d3 30s ease-in-out infinite alternate}
36
+ @keyframes d1{to{transform:translate(180px,120px) scale(1.1)}}
37
+ @keyframes d2{to{transform:translate(-160px,160px) scale(.92)}}
38
+ @keyframes d3{to{transform:translate(-200px,-60px) scale(1.08)}}
39
+ #grid{position:absolute;inset:0;z-index:0;background-image:linear-gradient(rgba(255,255,255,.028) 1px,transparent 1px),linear-gradient(90deg,rgba(255,255,255,.028) 1px,transparent 1px);background-size:80px 80px;-webkit-mask-image:radial-gradient(ellipse 70% 60% at 50% 45%,#000 20%,transparent 75%);mask-image:radial-gradient(ellipse 70% 60% at 50% 45%,#000 20%,transparent 75%)}
40
+ #grain{position:absolute;inset:0;z-index:30;pointer-events:none;opacity:.07;mix-blend-mode:overlay;background-image:url("data:image/svg+xml;utf8,<svg xmlns='http://www.w3.org/2000/svg' width='240' height='240'><filter id='n'><feTurbulence type='fractalNoise' baseFrequency='.85' numOctaves='2' stitchTiles='stitch'/></filter><rect width='100%' height='100%' filter='url(%23n)'/></svg>")}
41
+ #vig{position:absolute;inset:0;z-index:29;pointer-events:none;background:radial-gradient(ellipse 85% 80% at 50% 48%,transparent 55%,rgba(0,0,0,.6))}
42
+ #fade{position:absolute;inset:0;z-index:40;background:#000;opacity:0;pointer-events:none}
43
+
44
+ /* โ”€โ”€ ์ƒ๋‹จยทํ•˜๋‹จ ๊ณ ์ • ์š”์†Œ โ”€โ”€ */
45
+ .chrome{position:absolute;left:80px;right:80px;top:52px;z-index:20;display:flex;align-items:center;gap:18px}
46
+ .brand{display:flex;align-items:center;gap:14px}
47
+ .brand svg{width:44px;height:44px}
48
+ .brand b{font:750 27px/1 var(--sans);letter-spacing:-.03em}
49
+ .brand .pl{padding:6px 11px;border-radius:99px;border:1px solid var(--stroke2);font:600 15px/1 var(--mono);color:var(--ink2);letter-spacing:.04em}
50
+ .chap{margin-left:auto;display:flex;align-items:center;gap:14px;font:500 17px/1 var(--mono);color:var(--muted);letter-spacing:.06em}
51
+ .chap #chapn{color:var(--ink);font-weight:700}
52
+ .chap #chapt{font-family:var(--sans);font-weight:600;letter-spacing:0;color:var(--ink2);min-width:96px}
53
+ .segs{display:flex;gap:5px}
54
+ .segs span{width:26px;height:3px;border-radius:2px;background:rgba(255,255,255,.12);overflow:hidden}
55
+ .segs span i{display:block;height:100%;width:0;background:var(--grad)}
56
+ .live{position:absolute;left:80px;bottom:44px;z-index:20;display:flex;align-items:center;gap:10px;font:500 15px/1 var(--mono);color:var(--faint);letter-spacing:.04em}
57
+ .live i{width:8px;height:8px;border-radius:50%;background:var(--good);box-shadow:0 0 0 4px rgba(74,222,128,.15),0 0 14px var(--good);animation:pulse 2s ease-in-out infinite}
58
+ @keyframes pulse{50%{opacity:.45}}
59
+
60
+ /* โ”€โ”€ ์žฅ๋ฉด ยท ๋“ฑ์žฅ โ”€โ”€ */
61
+ .scene{position:absolute;inset:0;z-index:10;animation:sIn 1s var(--ease)}
62
+ .scene.leaving{animation:sOut .55s ease forwards}
63
+ @keyframes sIn{from{opacity:0;filter:blur(16px);transform:scale(1.035)}}
64
+ @keyframes sOut{to{opacity:0;filter:blur(12px);transform:scale(.985)}}
65
+ .cam{position:absolute;inset:0;padding:156px 140px 200px;display:flex;flex-direction:column;transform-origin:50% 52%}
66
+ [data-in]{opacity:0;transform:translateY(34px);filter:blur(8px);transition:opacity .8s ease,transform .9s var(--ease),filter .8s ease}
67
+ [data-in].on{opacity:1;transform:none;filter:none}
68
+ .words[data-in]{opacity:1;transform:none;filter:none}
69
+ .words .w>span{display:inline-block;opacity:0;transform:translateY(.42em);filter:blur(12px);transition:opacity .8s ease,transform .9s var(--ease),filter .8s ease;transition-delay:calc(var(--d)*70ms)}
70
+ .words.on .w>span{opacity:1;transform:none;filter:none}
71
+ .acc{background:var(--grad);-webkit-background-clip:text;background-clip:text;color:transparent}
72
+ .draw{stroke-dasharray:1;stroke-dashoffset:1;transition:stroke-dashoffset 1.3s cubic-bezier(.6,0,.2,1)}
73
+ .on .draw,.draw.on{stroke-dashoffset:0}
74
+ .dot{transform-box:fill-box;transform-origin:center;transform:scale(0);transition:transform .7s cubic-bezier(.3,1.7,.5,1) .9s}
75
+ .on .dot{transform:none}
76
+
77
+ /* โ”€โ”€ ์ž๋ง‰ โ”€โ”€ */
78
+ .cap{position:absolute;left:50%;bottom:92px;z-index:20;transform:translate(-50%,14px);width:max-content;max-width:1500px;padding:16px 34px;border-radius:18px;
79
+ background:rgba(6,8,14,.62);border:1px solid var(--stroke);backdrop-filter:blur(18px);box-shadow:0 20px 50px -20px rgba(0,0,0,.8);
80
+ font:600 34px/1.4 var(--sans);letter-spacing:-.02em;text-align:center;color:var(--ink);opacity:0;transition:opacity .7s,transform .7s var(--ease)}
81
+ .cap.on{opacity:1;transform:translate(-50%,0)}
82
+ body.nocap .cap{display:none}
83
+
84
+ /* โ”€โ”€ ๊ณตํ†ต ๋ถ€ํ’ˆ โ”€โ”€ */
85
+ .kicker{display:flex;align-items:center;gap:16px;font:500 19px/1 var(--mono);letter-spacing:.16em;color:var(--muted)}
86
+ .kicker b{font-weight:700;background:var(--grad);-webkit-background-clip:text;background-clip:text;color:transparent}
87
+ .kicker i{width:46px;height:1px;background:var(--stroke2)}
88
+ .hl{margin:22px 0 0;font:800 80px/1.12 var(--sans);letter-spacing:-.045em}
89
+ .glass{position:relative;background:linear-gradient(180deg,rgba(255,255,255,.065),rgba(255,255,255,.018));border:1px solid var(--stroke);border-radius:28px;
90
+ box-shadow:inset 0 1px 0 rgba(255,255,255,.08),0 40px 90px -50px rgba(0,0,0,.95);backdrop-filter:blur(26px) saturate(1.25)}
91
+ .ic{width:1em;height:1em;flex:none}
92
+ .itile{flex:none;width:72px;height:72px;border-radius:20px;display:grid;place-items:center;color:var(--c);font-size:36px;
93
+ background:linear-gradient(180deg,color-mix(in srgb,var(--c) 22%,transparent),color-mix(in srgb,var(--c) 8%,transparent));border:1px solid color-mix(in srgb,var(--c) 42%,transparent);box-shadow:0 10px 30px -12px color-mix(in srgb,var(--c) 60%,transparent)}
94
+ .k-call{--c:var(--call)}.k-ask{--c:var(--ask)}.k-respond{--c:var(--respond)}.k-good{--c:var(--good)}.k-bad{--c:var(--bad)}.k-hi{--c:var(--hi)}.k-mute{--c:#7d879b}
95
+ .bar{position:relative;height:10px;border-radius:99px;background:rgba(255,255,255,.07);overflow:hidden}
96
+ .bar i{position:absolute;left:0;top:0;bottom:0;width:0;border-radius:inherit;background:linear-gradient(90deg,color-mix(in srgb,var(--c,var(--call)) 45%,transparent),var(--c,var(--call)));box-shadow:0 0 18px color-mix(in srgb,var(--c,var(--call)) 70%,transparent)}
97
+ .pct{font:600 34px/1 var(--mono);font-variant-numeric:tabular-nums;letter-spacing:-.03em}
98
+ .mono{font-family:var(--mono)}
99
+ mark{background:color-mix(in srgb,var(--hi) 18%,transparent);color:var(--hi);border-radius:8px;padding:0 8px;box-shadow:inset 0 0 0 1px color-mix(in srgb,var(--hi) 35%,transparent)}
100
+ .conn{width:96px;height:30px;color:rgba(255,255,255,.28);justify-self:center}
101
+ .conn path{stroke:currentColor;stroke-width:2;fill:none;stroke-linecap:round;stroke-linejoin:round}
102
+ .chipk{display:inline-flex;align-items:center;gap:10px;padding:10px 18px;border-radius:99px;border:1px solid var(--stroke2);background:rgba(255,255,255,.04);font:500 21px/1 var(--mono);color:var(--ink2);letter-spacing:.02em}
103
+ .chipk b{color:var(--ink);font-weight:700}
104
+ .badge{display:inline-flex;align-items:center;gap:8px;padding:9px 16px;border-radius:99px;font:700 21px/1 var(--sans);color:var(--c);background:color-mix(in srgb,var(--c) 14%,transparent);border:1px solid color-mix(in srgb,var(--c) 35%,transparent)}
105
+ .badge .ic{font-size:22px}
106
+
107
+ /* 1ยท2 ยท ํƒ์‹œ */
108
+ .s-hook .who{font:500 20px/1 var(--mono);letter-spacing:.16em;color:var(--muted)}
109
+ .bubble{align-self:flex-start;margin-top:22px;padding:28px 44px;border-radius:44px 44px 44px 14px;font:650 62px/1.2 var(--sans);letter-spacing:-.035em}
110
+ .caret{display:inline-block;width:4px;height:.9em;margin-left:8px;border-radius:2px;background:var(--ink);vertical-align:-.08em;animation:blink 1s steps(2,start) infinite}
111
+ @keyframes blink{to{visibility:hidden}}
112
+ .s-hook .hl{margin-top:44px;font-size:76px}
113
+ .stats{display:flex;gap:14px;margin-top:26px}
114
+ .opts3{display:grid;grid-template-columns:repeat(3,1fr);gap:28px;margin-top:auto}
115
+ .opt3{padding:34px 36px 32px;transition:opacity .8s ease,transform .9s var(--ease),filter .8s ease,box-shadow .8s,border-color .8s}
116
+ .opt3 .tt{margin-top:26px;font:700 42px/1.2 var(--sans);letter-spacing:-.03em}
117
+ .opt3 .ds{margin-top:8px;font:500 25px/1.4 var(--sans);color:var(--muted)}
118
+ .opt3 .meter{margin-top:28px;display:grid;grid-template-columns:1fr auto;gap:20px;align-items:center}
119
+ .opt3 .vd{position:absolute;top:30px;right:30px;padding:9px 14px;border-radius:99px;background:var(--c);color:#090b10;font:700 16px/1 var(--mono);letter-spacing:.14em;opacity:0;transform:scale(.5);transition:opacity .4s,transform .6s cubic-bezier(.3,1.7,.5,1)}
120
+ .opt3.win{border-color:color-mix(in srgb,var(--c) 75%,transparent);transform:translateY(-14px) scale(1.025);box-shadow:0 0 0 1px var(--c),0 0 90px -20px var(--c),inset 0 1px 0 rgba(255,255,255,.12)}
121
+ .opt3.win .vd{opacity:1;transform:none}
122
+ .opt3.lose{opacity:.3;filter:saturate(.15) blur(1.5px)}
123
+ .opt3::after{content:"";position:absolute;inset:0;border-radius:inherit;pointer-events:none;opacity:0;background:linear-gradient(100deg,transparent 35%,rgba(255,255,255,.1) 50%,transparent 65%);background-size:260% 100%;background-position:130% 0}
124
+ .scan .opt3::after{opacity:1;animation:scan 1.1s linear infinite}
125
+ @keyframes scan{to{background-position:-130% 0}}
126
+
127
+ /* 3 ยท ๋Œ€ํ™” */
128
+ .turns{display:flex;flex-direction:column;gap:28px;margin-top:54px}
129
+ .turn{display:grid;grid-template-columns:minmax(0,.95fr) 120px minmax(0,1.1fr);align-items:center}
130
+ .turn .ub{justify-self:start;padding:22px 34px;border-radius:32px 32px 32px 10px;font:600 36px/1.3 var(--sans);letter-spacing:-.025em}
131
+ .dec{display:grid;grid-template-columns:auto minmax(0,1fr) auto;column-gap:24px;row-gap:14px;align-items:center;padding:22px 30px 24px;border-color:color-mix(in srgb,var(--c) 38%,var(--stroke))}
132
+ .dec .itile{grid-row:1/3;width:68px;height:68px;font-size:34px}
133
+ .dec .lb{font:700 35px/1.2 var(--sans);letter-spacing:-.025em;display:flex;align-items:center;gap:14px}
134
+ .dec .lb small{padding:6px 10px;border-radius:8px;font:700 15px/1 var(--mono);letter-spacing:.12em;color:var(--c);background:color-mix(in srgb,var(--c) 16%,transparent)}
135
+ .dec .pct{font-size:31px}
136
+ .dec .bar{grid-column:2/4}
137
+ .dec .nt{grid-column:1/-1;font:500 21px/1.45 var(--sans);color:var(--muted)}
138
+
139
+ /* 4ยท11 ยท ํƒ€์ดํ‹€ */
140
+ .center{flex:1;display:flex;flex-direction:column;align-items:center;justify-content:center;text-align:center}
141
+ .markbig{width:148px;height:148px;filter:drop-shadow(0 20px 60px rgba(114,184,255,.35))}
142
+ .wm{margin-top:30px;font:820 170px/1 var(--sans);letter-spacing:-.06em;white-space:nowrap}
143
+ .wm .a{background:linear-gradient(180deg,#fff 25%,#c3ccff);-webkit-background-clip:text;background-clip:text;color:transparent}
144
+ .wm .b{font-weight:300;letter-spacing:-.04em;background:var(--grad);background-size:200% 100%;-webkit-background-clip:text;background-clip:text;color:transparent;animation:sheen 6s ease-in-out infinite alternate}
145
+ @keyframes sheen{to{background-position:100% 0}}
146
+ .tag{margin-top:26px;font:600 48px/1.3 var(--sans);letter-spacing:-.035em;color:var(--ink2)}
147
+ .facts{display:grid;grid-template-columns:repeat(3,400px);gap:24px;margin-top:58px}
148
+ .fact{display:grid;grid-template-columns:auto 1fr;column-gap:22px;align-items:center;padding:26px 30px;text-align:left}
149
+ .fact .itile{grid-row:1/3;width:64px;height:64px;font-size:31px}
150
+ .fact b{font:800 46px/1 var(--sans);letter-spacing:-.04em;font-variant-numeric:tabular-nums}
151
+ .fact span{margin-top:8px;font:500 20px/1.4 var(--sans);color:var(--muted)}
152
+ .try{margin-top:50px;display:flex;align-items:center;gap:14px;font:500 25px/1 var(--sans);color:var(--muted)}
153
+ .try b{color:var(--ink);font-weight:600}
154
+
155
+ /* 5 ยท ํ•™์Šต ์ „ํ›„ */
156
+ .vs{display:grid;grid-template-columns:1fr 130px 1fr;margin-top:44px;flex:1;min-height:0}
157
+ .side{padding:32px 38px;display:flex;flex-direction:column}
158
+ .side.after{border-color:rgba(114,184,255,.35);box-shadow:inset 0 1px 0 rgba(255,255,255,.1),0 0 120px -40px rgba(114,184,255,.5)}
159
+ .lab{align-self:flex-start;padding:9px 16px;border-radius:99px;border:1px solid var(--stroke2);font:600 21px/1 var(--sans);color:var(--ink2)}
160
+ .tiles{display:grid;grid-template-columns:repeat(15,1fr);gap:6px;margin:26px 0 22px}
161
+ .tiles span{aspect-ratio:1;display:grid;place-items:center;border-radius:9px;font:700 19px/1 var(--mono);background:rgba(255,255,255,.045);color:#5d6678;opacity:0;transform:scale(.4);transition:opacity .4s,transform .5s cubic-bezier(.3,1.5,.5,1);transition-delay:calc(var(--i)*13ms)}
162
+ .tiles.on span{opacity:1;transform:none}
163
+ .after .tiles span{background:hsla(var(--h),90%,66%,.2);color:hsl(var(--h),95%,82%);box-shadow:inset 0 0 0 1px hsla(var(--h),90%,70%,.25)}
164
+ .side .note{font:500 23px/1.4 var(--sans);color:var(--muted)}
165
+ .side .note b{color:var(--ink)}
166
+ .bign{margin-top:auto;font:820 124px/1 var(--sans);letter-spacing:-.06em;font-variant-numeric:tabular-nums}
167
+ .before .bign{color:#8f97a8}
168
+ .after .bign{background:var(--grad);-webkit-background-clip:text;background-clip:text;color:transparent}
169
+ .side .sub{margin-top:10px;font:500 23px/1.4 var(--sans);color:var(--muted)}
170
+ .mid{display:flex;flex-direction:column;align-items:center;justify-content:center;gap:14px;font:600 16px/1.3 var(--mono);color:var(--muted);text-align:center;letter-spacing:.06em}
171
+ .mid .ring{width:68px;height:68px;border-radius:50%;display:grid;place-items:center;font-size:30px;color:var(--ink);background:rgba(255,255,255,.05);border:1px solid var(--stroke2)}
172
+
173
+ /* 6 ยท ํ•œ๊ตญ์–ด ๋ฌธ์ œ */
174
+ .qs{display:grid;grid-template-columns:repeat(3,1fr);gap:28px;margin-top:46px;flex:1;min-height:0}
175
+ .qc{padding:30px 32px 26px;display:flex;flex-direction:column}
176
+ .qtag{align-self:flex-start;display:inline-flex;align-items:center;gap:10px;padding:8px 14px;border-radius:99px;font:700 19px/1 var(--sans);color:var(--hi);background:color-mix(in srgb,var(--hi) 12%,transparent);border:1px solid color-mix(in srgb,var(--hi) 30%,transparent)}
177
+ .qb{margin:22px 0 18px;font:600 30px/1.48 var(--sans);letter-spacing:-.025em}
178
+ .qb p{margin:0 0 10px}
179
+ .qb small{display:block;margin-top:6px;font:500 21px/1.45 var(--sans);color:var(--muted);letter-spacing:-.01em}
180
+ .op{display:grid;grid-template-columns:minmax(0,1fr) auto;gap:10px 16px;align-items:center;padding:14px 0;border-top:1px solid var(--stroke);transition:opacity .6s}
181
+ .op .t{font:600 26px/1.3 var(--sans);letter-spacing:-.02em}
182
+ .op .pct{font-size:25px}
183
+ .op .bar{grid-column:1/-1;height:8px}
184
+ .op.dim{opacity:.4}
185
+ .qc .foot{margin-top:auto;padding-top:16px;display:flex;justify-content:space-between;align-items:center;font:500 19px/1 var(--mono);color:var(--muted)}
186
+
187
+ /* 7 ยท ๊ณ ๊ฐ ๋ฌธ์˜ */
188
+ .rows{display:flex;flex-direction:column;gap:28px;margin-top:50px}
189
+ .row{display:grid;grid-template-columns:minmax(0,1.15fr) minmax(0,1fr) 110px minmax(0,.62fr);align-items:center;gap:0 22px}
190
+ .msg{padding:24px 32px 28px}
191
+ .msg .h{display:flex;align-items:center;gap:10px;font:500 17px/1 var(--mono);letter-spacing:.12em;color:var(--muted)}
192
+ .msg .h i{width:8px;height:8px;border-radius:50%;background:var(--ask)}
193
+ .msg .t{margin-top:14px;font:600 31px/1.45 var(--sans);letter-spacing:-.025em}
194
+ .chips{display:flex;flex-direction:column;gap:12px}
195
+ .chip{display:grid;grid-template-columns:70px minmax(0,1fr) auto;gap:14px;align-items:center;padding:16px 22px;border-radius:18px}
196
+ .chip .k{font:600 16px/1 var(--mono);letter-spacing:.1em;color:var(--muted)}
197
+ .chip .v{font:700 27px/1.25 var(--sans);letter-spacing:-.025em}
198
+ .chip .pct{font-size:24px;color:var(--ink2)}
199
+ .route{display:flex;flex-direction:column;align-items:center;gap:14px;padding:26px 22px;text-align:center;border-color:color-mix(in srgb,var(--c) 55%,transparent);box-shadow:inset 0 1px 0 rgba(255,255,255,.1),0 0 80px -30px var(--c)}
200
+ .route .itile{width:62px;height:62px;font-size:30px}
201
+ .route .d{font:750 30px/1.2 var(--sans);letter-spacing:-.03em}
202
+ .route .u{padding:7px 18px;border-radius:99px;font:800 24px/1.1 var(--sans);background:var(--c);color:#090b10}
203
+ .route .s{font:500 15px/1 var(--mono);color:var(--muted);letter-spacing:.06em}
204
+
205
+ /* 8 ยท ํ™•์‹  */
206
+ .unsure{display:grid;grid-template-columns:minmax(0,1.08fr) minmax(0,.92fr);gap:36px;margin-top:40px;flex:1;min-height:0}
207
+ .ucol{display:flex;flex-direction:column;gap:18px}
208
+ .s-unsure .msg .t{font-size:29px}
209
+ .cands{padding:6px 30px}
210
+ .cands .op:first-child{border-top:0}
211
+ .calib{display:flex;align-items:center;gap:28px;padding:20px 30px}
212
+ .calib .n{font:800 54px/1 var(--sans);letter-spacing:-.05em;font-variant-numeric:tabular-nums}
213
+ .calib .l{margin-top:8px;font:500 18px/1.3 var(--sans);color:var(--muted)}
214
+ .calib .eq{font:300 46px/1 var(--sans);color:var(--faint)}
215
+ .calib .say{margin-left:auto;font:600 22px/1.45 var(--sans);color:var(--ink2);text-align:right}
216
+ .gauge{display:flex;flex-direction:column;align-items:center;padding:28px 34px 28px}
217
+ .gauge .lab2{align-self:flex-start;font:600 22px/1 var(--sans);color:var(--muted)}
218
+ .gwrap{position:relative;width:440px;height:250px;margin-top:14px}
219
+ .gwrap svg{position:absolute;inset:0;overflow:visible}
220
+ .gwrap .gnum{position:absolute;left:0;right:0;bottom:-6px;text-align:center;font:820 96px/1 var(--sans);letter-spacing:-.06em;color:var(--ask);font-variant-numeric:tabular-nums;text-shadow:0 0 50px rgba(255,180,77,.35)}
221
+ .gth{font:600 17px var(--mono);fill:var(--ink2)}
222
+ .hold{margin-top:30px;align-self:stretch;display:flex;align-items:center;justify-content:center;gap:16px;padding:18px 22px;border-radius:18px;background:color-mix(in srgb,var(--ask) 12%,transparent);border:1px solid color-mix(in srgb,var(--ask) 55%,transparent);font:750 29px/1.2 var(--sans);letter-spacing:-.025em;color:var(--ask)}
223
+ .hold .ic{font-size:30px}
224
+ .truth{margin-top:18px;font:500 22px/1.5 var(--sans);color:var(--muted);text-align:center}
225
+ .truth b{color:var(--ink);font-weight:650}
226
+
227
+ /* 9 ยท ์ˆœ์œ„ */
228
+ .board{margin-top:24px;display:flex;flex-direction:column;gap:1px}
229
+ .lr{display:grid;grid-template-columns:46px 500px 92px minmax(0,1fr) 150px;gap:20px;align-items:center;padding:3px 20px;border-radius:14px;border:1px solid transparent}
230
+ .lr .rk{font:600 18px/1 var(--mono);color:var(--faint)}
231
+ .lr .nm{font:600 27px/1.2 var(--sans);letter-spacing:-.02em;white-space:nowrap;overflow:hidden;text-overflow:ellipsis;color:var(--ink2)}
232
+ .lr .sz{justify-self:end;padding:5px 10px;border-radius:8px;font:600 16px/1 var(--mono);color:var(--muted);background:rgba(255,255,255,.05)}
233
+ .lr.small .sz{color:var(--ink);background:rgba(255,255,255,.1)}
234
+ .lr .bar{height:20px;border-radius:6px}
235
+ .lr .bar i{border-radius:6px;background:linear-gradient(90deg,#2a3243,#4a5468);box-shadow:none}
236
+ .lr .pct{font-size:27px;text-align:right;color:var(--ink2)}
237
+ .lr.me{background:linear-gradient(90deg,rgba(185,166,255,.13),rgba(95,240,210,.07));border-color:rgba(185,166,255,.38);box-shadow:0 0 70px -20px rgba(114,184,255,.45)}
238
+ .lr.me .nm{font-weight:750;color:var(--ink)}
239
+ .lr.me .rk,.lr.me .pct{color:var(--ink)}
240
+ .lr.me .bar i{background:var(--grad);box-shadow:0 0 22px rgba(114,184,255,.6)}
241
+ .fine{margin-top:16px;font:400 17px/1.5 var(--sans);color:var(--faint);max-width:1640px}
242
+
243
+ /* 10 ยท ์†๋„ */
244
+ .speed{display:grid;grid-template-columns:minmax(0,1.3fr) minmax(0,1fr);gap:36px;margin-top:40px;flex:1;min-height:0}
245
+ .ticker{overflow:hidden;padding:6px 0}
246
+ .ticker::after{content:"";position:absolute;left:0;right:0;bottom:0;height:140px;border-radius:0 0 28px 28px;background:linear-gradient(transparent,rgba(8,10,16,.92));pointer-events:none}
247
+ .tk{display:grid;grid-template-columns:44px minmax(0,1fr) 140px 36px;gap:16px;align-items:center;padding:14px 26px;border-bottom:1px solid var(--stroke);animation:tkIn .45s var(--ease)}
248
+ @keyframes tkIn{from{opacity:0;transform:translateY(-18px);filter:blur(6px)}}
249
+ .tk .tr{width:40px;height:40px;border-radius:12px;display:grid;place-items:center;font-size:22px;color:var(--c);background:color-mix(in srgb,var(--c) 15%,transparent)}
250
+ .tk .ti{font:600 24px/1.3 var(--sans);letter-spacing:-.02em;white-space:nowrap;overflow:hidden;text-overflow:ellipsis}
251
+ .tk .tg{justify-self:start;font:700 21px/1 var(--sans);color:var(--c)}
252
+ .tk .ck{font-size:24px;display:grid;place-items:center}
253
+ .up{--c:#ff7a6b}.dn{--c:#6aa6ff}.nn{--c:#8b94a7}
254
+ .spr{display:flex;flex-direction:column;gap:24px}
255
+ .spbox{padding:32px 36px}
256
+ .spbox .big{display:flex;align-items:baseline;gap:6px;font:820 150px/1 var(--sans);letter-spacing:-.06em;font-variant-numeric:tabular-nums;background:linear-gradient(180deg,#fff,#7ff3d9);-webkit-background-clip:text;background-clip:text;color:transparent}
257
+ .spbox .big small{font-size:60px;font-weight:600;letter-spacing:-.03em}
258
+ .spbox .l{margin-top:14px;font:500 22px/1.45 var(--sans);color:var(--muted)}
259
+ .cnt{display:flex;gap:30px;padding:26px 36px}
260
+ .cnt div b{display:block;font:800 64px/1 var(--sans);letter-spacing:-.05em;font-variant-numeric:tabular-nums}
261
+ .cnt div span{display:block;margin-top:10px;font:500 19px/1.35 var(--sans);color:var(--muted)}
262
+ .cnt .g b{color:var(--good)}
263
+
264
+ /* โ”€โ”€ ์กฐ์ž‘๋ฐ” (๋ฌด๋Œ€ ๋ฐ–) โ”€โ”€ */
265
+ #hud{position:fixed;left:50%;bottom:18px;transform:translateX(-50%);display:flex;align-items:center;gap:12px;padding:10px 14px;border-radius:14px;background:rgba(18,22,32,.9);border:1px solid #2a3344;color:#cfd6e3;font:13px/1 var(--sans);z-index:50;transition:opacity .4s;backdrop-filter:blur(6px)}
266
+ #hud button{border:0;background:#222b3b;color:#e8edf5;border-radius:8px;padding:8px 12px;font:600 13px/1 var(--sans);cursor:pointer}
267
+ #hud button:hover{background:#2e3a50}
268
+ #hud .dots{display:flex;gap:6px}
269
+ #hud .dots button{width:26px;padding:7px 0;font:600 11px/1 var(--mono);background:#1b2230;color:#7d889c}
270
+ #hud .dots button.cur{background:#72b8ff;color:#0b0e14}
271
+ #hud .help{color:#7d889c;font-size:12px;white-space:nowrap}
272
+ body.clean #hud,body.idle #hud{opacity:0;pointer-events:none}
273
+ #pausebadge{position:fixed;top:16px;left:50%;transform:translateX(-50%);padding:8px 16px;border-radius:10px;background:rgba(255,180,77,.94);color:#111;font:700 14px/1 var(--sans);z-index:50}
274
+ @media (max-width:900px){#hud .help{display:none}}
275
+ </style>
276
+ </head>
277
+ <body>
278
+ <svg width="0" height="0" style="position:absolute" aria-hidden="true"><defs>
279
+ <linearGradient id="gB" gradientUnits="userSpaceOnUse" x1="0" y1="0" x2="48" y2="48"><stop offset="0" stop-color="#b9a6ff"/><stop offset=".55" stop-color="#72b8ff"/><stop offset="1" stop-color="#5ff0d2"/></linearGradient>
280
+ <linearGradient id="gA" gradientUnits="userSpaceOnUse" x1="20" y1="0" x2="420" y2="0"><stop offset="0" stop-color="#ff8a4d"/><stop offset="1" stop-color="#ffd36b"/></linearGradient>
281
+ </defs></svg>
282
+ <div id="stage" aria-live="polite">
283
+ <div id="aurora"><div class="b b1"></div><div class="b b2"></div><div class="b b3"></div></div>
284
+ <div id="grid"></div>
285
+ <header class="chrome"><div class="brand" id="brand"></div>
286
+ <div class="chap"><span id="chapn">01</span><span>/ <span id="chapall">11</span></span><span id="chapt"></span><div class="segs" id="segs"></div></div></header>
287
+ <div class="live"><i></i>์‹ค์ œ ๋ชจ๋ธ ์ถœ๋ ฅ ยท ์ €์žฅ๋œ ํŒ์ • ๊ฒฐ๊ณผ ์žฌ์ƒ</div>
288
+ <div class="cap" id="cap"></div>
289
+ <div id="vig"></div><div id="grain"></div><div id="fade"></div>
290
+ </div>
291
+ <div id="hud" role="toolbar" aria-label="์žฌ์ƒ ์กฐ์ž‘">
292
+ <button id="prev" title="์ด์ „ ์žฅ๋ฉด (โ†)">โ—€</button>
293
+ <button id="play" title="์ผ์‹œ์ •์ง€ยท์žฌ์ƒ (Space)">โšโš</button>
294
+ <button id="next" title="๋‹ค์Œ ์žฅ๋ฉด (โ†’)">โ–ถ</button>
295
+ <div class="dots" id="dots"></div>
296
+ <span class="help">Space ์ •์ง€ ยท โ†โ†’ ์žฅ๋ฉด ยท R ์ฒ˜์Œ ยท C ์ž๋ง‰ ยท H ์ˆจ๊น€ ยท F ์ „์ฒดํ™”๋ฉด</span>
297
+ </div>
298
+ <div id="pausebadge" hidden>์ผ์‹œ์ •์ง€</div>
299
+
300
+ <script>window.SHOW_TRY = "huggingface.co/coderecode95/KJH-Judge-4B-ko";</script>
301
+ <script>/* data.js */
302
+ window.JEV_DATA = {"pooled":{"n":25418,"acc":0.9037,"chance":0.2986,"mean_conf":0.8802,"ece":0.0265,"order_agree":0.9793},"base_pooled":{"n":25418,"acc":0.2956,"chance":0.2986,"mean_conf":0.9052,"ece":0.6096,"order_agree":0.0},"pred_letters":{"A":7553,"B":7618,"C":3284,"D":2113,"E":1645,"F":1529,"G":1544,"H":41,"I":34,"J":32,"K":25},"base_pred_letters":{"A":25349,"E":29,"I":40},"train":{"train_loss":0.2376677804889313,"eval_loss":0.1863497942686081,"steps":4430,"gpu_hours":3.483,"tokens":35464805.0}};
303
+ </script>
304
+ <script>/* live-example.js */
305
+ window.JEV_LIVE_EXAMPLE = {"meta":{"device":"cuda","temperature":1.7179,"made":"2026-11-09 11:31"},"state":{"enabled":["get_weather","call_taxi","create_event","send_money","track_parcel"],"log":[{"t":"user","text":"ํƒ์‹œ ์ข€ ๋ถˆ๋Ÿฌ์ค˜"},{"t":"decision","d":{"step":1,"kind":"ASK","tool":null,"text":"ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ","conf":0.9949,"ms":135,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ","RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด"],"probs":[0.001,0.0022,0.0004,0.0001,0.0004,0.9949,0.001]}},{"t":"user","text":"๊ฐ•๋‚จ์—ญ์—์„œ ํŒ๊ต์—ญ๊นŒ์ง€ ๊ฐ€ ์ค˜"},{"t":"decision","d":{"step":1,"kind":"CALL","tool":"call_taxi","text":"CALL:call_taxi","conf":0.9962,"ms":140,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ","RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด"],"probs":[0.0004,0.9962,0.0005,0.0001,0.0002,0.0019,0.0007]}},{"t":"decision","d":{"step":2,"kind":"RESPOND","tool":null,"text":"RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด","conf":0.9603,"ms":148,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ","RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด"],"probs":[0.0028,0.0314,0.0014,0.0004,0.001,0.0026,0.9603]}},{"t":"user","text":"๋‚ด์ผ ๋ถ€์‚ฐ ๋‚ ์”จ ์–ด๋•Œ?"},{"t":"decision","d":{"step":1,"kind":"CALL","tool":"get_weather","text":"CALL:get_weather","conf":0.9824,"ms":156,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ","RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด"],"probs":[0.9824,0.001,0.0007,0.0002,0.0002,0.0144,0.0011]}},{"t":"decision","d":{"step":2,"kind":"RESPOND","tool":null,"text":"RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด","conf":0.9688,"ms":163,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ","RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด"],"probs":[0.0153,0.0027,0.0015,0.0008,0.0017,0.0092,0.9688]}},{"t":"user","text":"์‚ผ์„ฑ์ „์ž ์ฃผ์‹ 10์ฃผ ์‚ฌ ์ค˜"},{"t":"decision","d":{"step":1,"kind":"RESPOND","tool":null,"text":"RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด","conf":0.9865,"ms":168,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ€์กฑํ•œ ํ•„์ˆ˜ ์ •๋ณด ์งˆ๋ฌธ","RESPOND: ์ง์ ‘ ์„ค๋ช…ยท์™„๋ฃŒยท๋ฏธ์ง€์› ์•ˆ๋‚ด"],"probs":[0.0022,0.0011,0.0013,0.0011,0.0018,0.0061,0.9865]}}]}};
306
+ </script>
307
+ <script>/* quiz-data.js */
308
+ window.JEV_QUIZ = {"meta":{"made":"2026-11-09 13:27","device":"cuda","mode":"singleร—8","seconds":18},"pool":[{"id":"kobest_wic:512","area":"kobest_wic","instruction":"๋‘ ๋ฌธ๋งฅ์—์„œ ํ‘œ์‹œ๋œ ๋‹จ์–ด์˜ ์˜๋ฏธ๊ฐ€ ๊ฐ™์€์ง€ ํŒ๋‹จํ•œ๋‹ค.","item":{"word":"์ด์ƒ","context_1":"ํ‚ค 158cm [์ด์ƒ]๋งŒ ๋†€์ด๊ธฐ๊ตฌ๋ฅผ ํƒˆ ์ˆ˜ ์žˆ๋‹ค.","context_2":"์ด๊ฒƒ์ด ๋ฐ”๋กœ ๋‚˜์˜ [์ด์ƒ]์„ ํ–ฅํ•œ ์—ด์ •์ด๋‹ค."},"choices":["์„œ๋กœ ๋‹ค๋ฅธ ์˜๋ฏธ","๊ฐ™์€ ์˜๋ฏธ"],"gold":0,"jev":{"pick":0,"conf":0.9875,"probs":[0.9875,0.0125],"ms":103}},{"id":"kobest_copa:226","area":"kobest_copa","instruction":"์š”๊ตฌ๋œ ์›์ธ ๋˜๋Š” ๊ฒฐ๊ณผ ์ค‘ ๋” ์ž์—ฐ์Šค๋Ÿฝ๊ณ  ํƒ€๋‹นํ•œ ๊ฒƒ์„ ๊ณ ๋ฅธ๋‹ค.","item":{"premise":"๋น„ํ–‰๊ธฐ๊ฐ€ ๋‚œ๊ธฐ๋ฅ˜๋ฅผ ๋งŒ๋‚ฌ๋‹ค.","relation_to_select":"๊ฒฐ๊ณผ"},"choices":["๋น„ํ–‰๊ธฐ๊ฐ€ ํ”๋“ค๋ ธ๋‹ค.","๋น„ํ–‰๊ธฐ๊ฐ€ ์ˆœํ•ญํ–ˆ๋‹ค."],"gold":0,"jev":{"pick":0,"conf":0.9725,"probs":[0.9725,0.0275],"ms":104}},{"id":"klue_ynat:1810","area":"klue_ynat","instruction":"ํ•œ๊ตญ์–ด ๋‰ด์Šค ์ œ๋ชฉ์˜ ์ค‘์‹ฌ ์ฃผ์ œ๋ฅผ ๊ณ ๋ฅธ๋‹ค. ์—ฌ๋Ÿฌ ๋ถ„์•ผ๊ฐ€ ์–ธ๊ธ‰๋˜์–ด๋„ ๊ธฐ์‚ฌ์˜ ์ฃผ๋œ ์‚ฌ๊ฑด์„ ์šฐ์„ ํ•œ๋‹ค.","item":{"headline":"K๋ฆฌ๊ทธ ๋ ˆ๋“œ์นด๋“œ ์†์ถœโ€ฆVAR์€ ๋ชป์†์—ฌ"},"choices":["๊ฒฝ์ œ","IT๊ณผํ•™","์Šคํฌ์ธ ","์ƒํ™œ๋ฌธํ™”","์„ธ๊ณ„","์‚ฌํšŒ","์ •์น˜"],"gold":2,"jev":{"pick":2,"conf":0.9714,"probs":[0.002,0.0023,0.9714,0.0014,0.0023,0.0191,0.0015],"ms":107}}]};
309
+ </script>
310
+ <script>/* examples.js */
311
+ window.JEV_EXAMPLES = {"meta":{"device":"cuda","made":"2026-11-09 12:23"},"inbox":[{"text":"์ œ ๊ณ„์ •์— ์ œ๊ฐ€ ํ•˜์ง€ ์•Š์€ ์ฃผ๋ฌธ์ด 3๊ฑด ์žˆ์–ด์š”!! ํ•ดํ‚น๋‹นํ•œ ๊ฒƒ ๊ฐ™์•„์š” ๋นจ๋ฆฌ ํ™•์ธํ•ด์ฃผ์„ธ์š”","axes":{"case":{"pick":0,"conf":0.8839,"ms":89,"probs":[0.8839,0.013,0.005,0.005,0.036,0.0044,0.0054,0.0021,0.025,0.0028,0.013,0.002,0.0012,0.0006,0.0006]},"mood":{"pick":0,"conf":0.9617,"ms":78,"probs":[0.9617,0.0338,0.0044]},"info":{"pick":1,"conf":0.7203,"ms":91,"probs":[0.2797,0.7203]}},"wall":2143},{"text":"์ฃผ๋ฌธ๋ฒˆํ˜ธ 20261102-5531 ์•„์ง๋„ ๋ฐฐ์†ก ์ค€๋น„์ค‘์ด๋„ค์š”. ๋‹ค์Œ ์ฃผ ์ด์‚ฌ๋ผ ๊ทธ ์ „์— ๊ผญ ๋ฐ›์•„์•ผ ํ•ด์š”.","axes":{"case":{"pick":5,"conf":0.8972,"ms":91,"probs":[0.0051,0.0023,0.0029,0.0031,0.0018,0.8972,0.0236,0.0041,0.0009,0.0038,0.0422,0.0025,0.0068,0.0011,0.0025]},"mood":{"pick":0,"conf":0.8983,"ms":103,"probs":[0.8983,0.0875,0.0142]},"info":{"pick":0,"conf":0.9807,"ms":105,"probs":[0.9807,0.0193]}},"wall":319},{"text":"๋ฐฐ์†ก ์ฐธ ๋น ๋ฅด๋„ค์š”. ์ฃผ๋ฌธํ•˜๊ณ  2์ฃผ ๋งŒ์— ์™”์–ด์š”.","axes":{"case":{"pick":13,"conf":0.9321,"ms":85,"probs":[0.004,0.0022,0.0017,0.0014,0.0011,0.0147,0.0046,0.0037,0.0006,0.0007,0.0032,0.0013,0.0127,0.9321,0.0158]},"mood":{"pick":2,"conf":0.9636,"ms":90,"probs":[0.0092,0.0273,0.9636]},"info":{"pick":0,"conf":0.9274,"ms":93,"probs":[0.9274,0.0726]}},"wall":286},{"text":"์นด๋“œ์—์„œ 39,800์›์ด ๋‘ ๋ฒˆ ๊ฒฐ์ œ๋์–ด์š”. 11์›” 7์ผ ์˜คํ›„ 9์‹œ์ฏค์ด์—์š”.","axes":{"case":{"pick":1,"conf":0.8685,"ms":117,"probs":[0.0212,0.8685,0.0066,0.0024,0.0032,0.0034,0.044,0.003,0.0018,0.0184,0.005,0.0197,0.0013,0.0009,0.0006]},"mood":{"pick":1,"conf":0.6906,"ms":73,"probs":[0.2884,0.6906,0.021]},"info":{"pick":0,"conf":0.59,"ms":91,"probs":[0.59,0.41]}},"wall":812},{"text":"ํ™˜๋ถˆํ•ด ์ฃผ์„ธ์š”.","axes":{"case":{"pick":6,"conf":0.9599,"ms":88,"probs":[0.0059,0.0063,0.002,0.0025,0.001,0.0023,0.9599,0.0113,0.0007,0.0008,0.0028,0.0025,0.001,0.0005,0.0005]},"mood":{"pick":0,"conf":0.9095,"ms":77,"probs":[0.9095,0.0713,0.0192]},"info":{"pick":1,"conf":0.7994,"ms":75,"probs":[0.2006,0.7994]}},"wall":8234},{"text":"์ƒ๋‹ด์‚ฌ ๊น€์ง€์€๋‹˜ ๋•๋ถ„์— ๋ฌธ์ œ ์ž˜ ํ•ด๊ฒฐํ–ˆ์–ด์š”. ์ •๋ง ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค!","axes":{"case":{"pick":13,"conf":0.9845,"ms":83,"probs":[0.0018,0.0008,0.0011,0.0004,0.0005,0.0008,0.0014,0.0008,0.0002,0.0004,0.0027,0.0007,0.0018,0.9845,0.0019]},"mood":{"pick":2,"conf":0.9913,"ms":72,"probs":[0.0034,0.0053,0.9913]},"info":{"pick":0,"conf":0.9683,"ms":94,"probs":[0.9683,0.0317]}},"wall":608},{"text":"์ด ์—์–ดํ”„๋ผ์ด์–ด ๋ฐ”์Šค์ผ“ ์‹๊ธฐ์„ธ์ฒ™๊ธฐ์— ๋„ฃ์–ด๋„ ๋˜๋‚˜์š”?","axes":{"case":{"pick":12,"conf":0.9481,"ms":85,"probs":[0.0035,0.0017,0.0017,0.0009,0.001,0.002,0.0173,0.0084,0.0012,0.0021,0.0043,0.0017,0.9481,0.0028,0.0033]},"mood":{"pick":1,"conf":0.9245,"ms":68,"probs":[0.035,0.9245,0.0405]},"info":{"pick":0,"conf":0.9635,"ms":97,"probs":[0.9635,0.0365]}},"wall":611},{"text":"์•ฑ ์—…๋ฐ์ดํŠธ ํ›„๋กœ ์žฅ๋ฐ”๊ตฌ๋‹ˆ๊ฐ€ ๊ณ„์† ๋น„์–ด ์žˆ์–ด์š”. ๋ช‡ ๋ฒˆ์„ ๋‹ด์•„๋„ ์‚ฌ๋ผ์ ธ์š”.","axes":{"case":{"pick":9,"conf":0.9538,"ms":84,"probs":[0.0035,0.0018,0.0073,0.0015,0.0013,0.002,0.0035,0.0014,0.0028,0.9538,0.0113,0.0015,0.002,0.0006,0.0059]},"mood":{"pick":0,"conf":0.9773,"ms":70,"probs":[0.9773,0.0207,0.002]},"info":{"pick":0,"conf":0.9169,"ms":94,"probs":[0.9169,0.0831]}},"wall":700},{"text":"์–ด์ œ ๋ฐ›์€ ๋‹ˆํŠธ์— ๊ตฌ๋ฉ์ด ๋‚˜ ์žˆ์–ด์š”. ๊ตํ™˜ ๋ง๊ณ  ํ™˜๋ถˆ๋กœ ํ•ด์ฃผ์„ธ์š”. ์ฃผ๋ฌธ๋ฒˆํ˜ธ 20261105-2210","axes":{"case":{"pick":6,"conf":0.664,"ms":90,"probs":[0.0021,0.0013,0.001,0.0006,0.0008,0.0023,0.664,0.3208,0.0006,0.0008,0.003,0.0007,0.0012,0.0004,0.0005]},"mood":{"pick":0,"conf":0.9697,"ms":88,"probs":[0.9697,0.0274,0.0029]},"info":{"pick":0,"conf":0.9744,"ms":91,"probs":[0.9744,0.0256]}},"wall":1657},{"text":"๋น„๋ฐ€๋ฒˆํ˜ธ ์žฌ์„ค์ • ๋ฉ”์ผ์ด ์•ˆ ์™€์š”. ์ŠคํŒธํ•จ๋„ ํ™•์ธํ–ˆ์–ด์š”.","axes":{"case":{"pick":8,"conf":0.8605,"ms":83,"probs":[0.0088,0.0022,0.0262,0.0012,0.0026,0.0019,0.0027,0.0018,0.8605,0.0405,0.0469,0.0015,0.0014,0.0008,0.001]},"mood":{"pick":0,"conf":0.9527,"ms":71,"probs":[0.9527,0.0448,0.0024]},"info":{"pick":0,"conf":0.7203,"ms":99,"probs":[0.7203,0.2797]}},"wall":610},{"text":"๋ฐ˜ํ’ˆ ์ ‘์ˆ˜ํ–ˆ๋Š”๋ฐ ํƒ๋ฐฐ ๊ธฐ์‚ฌ๋‹˜์ด ์ˆ˜๊ฑฐ๋ฅผ ์•ˆ ์˜ค์…จ์–ด์š”. 3์ผ์งธ ๋ฌธ ์•ž์— ๋‘๊ณ  ์žˆ์–ด์š”.","axes":{"case":{"pick":6,"conf":0.6592,"ms":85,"probs":[0.0063,0.0035,0.0024,0.0018,0.0016,0.0359,0.6592,0.0232,0.0012,0.0023,0.256,0.0021,0.0026,0.0008,0.0011]},"mood":{"pick":0,"conf":0.9445,"ms":96,"probs":[0.9445,0.0514,0.004]},"info":{"pick":1,"conf":0.5182,"ms":105,"probs":[0.4818,0.5182]}},"wall":307},{"text":"์˜ค๋Š˜ ๊ฒฐ์ œ๊ฐ€ ์•ˆ ๋˜๊ณ  '์ผ์‹œ์  ์˜ค๋ฅ˜'๋งŒ ๋– ์š”. ๏ฟฝ๏ฟฝ๋ฅธ ์นด๋“œ๋„ ๋งˆ์ฐฌ๊ฐ€์ง€์˜ˆ์š”.","axes":{"case":{"pick":11,"conf":0.4996,"ms":92,"probs":[0.0073,0.0055,0.0203,0.0031,0.0023,0.0047,0.0059,0.0019,0.0055,0.4016,0.0364,0.4996,0.0025,0.0011,0.0023]},"mood":{"pick":0,"conf":0.7949,"ms":70,"probs":[0.7949,0.1995,0.0056]},"info":{"pick":0,"conf":0.877,"ms":92,"probs":[0.877,0.123]}},"wall":1131}],"news":[{"pick":0,"conf":0.9867,"ms":84,"probs":[0.9867,0.0081,0.0052]},{"pick":1,"conf":0.9616,"ms":80,"probs":[0.0091,0.9616,0.0293]},{"pick":2,"conf":0.8396,"ms":76,"probs":[0.0658,0.0946,0.8396]},{"pick":1,"conf":0.4258,"ms":79,"probs":[0.3183,0.4258,0.2559]},{"pick":0,"conf":0.3664,"ms":76,"probs":[0.3664,0.3168,0.3168]},{"pick":1,"conf":0.9515,"ms":79,"probs":[0.0174,0.9515,0.0311]},{"pick":1,"conf":0.9418,"ms":77,"probs":[0.0199,0.9418,0.0383]},{"pick":2,"conf":0.9502,"ms":77,"probs":[0.0311,0.0187,0.9502]},{"pick":0,"conf":0.9804,"ms":79,"probs":[0.9804,0.008,0.0116]},{"pick":1,"conf":0.8716,"ms":76,"probs":[0.0148,0.8716,0.1136]},{"pick":1,"conf":0.9736,"ms":76,"probs":[0.0086,0.9736,0.0178]},{"pick":0,"conf":0.9776,"ms":75,"probs":[0.9776,0.0124,0.01]},{"pick":2,"conf":0.8414,"ms":75,"probs":[0.1365,0.0221,0.8414]},{"pick":1,"conf":0.8097,"ms":77,"probs":[0.0682,0.8097,0.1221]},{"pick":0,"conf":0.6767,"ms":83,"probs":[0.6767,0.1964,0.1269]},{"pick":0,"conf":0.9565,"ms":81,"probs":[0.9565,0.0217,0.0217]},{"pick":1,"conf":0.9347,"ms":83,"probs":[0.0213,0.9347,0.044]},{"pick":2,"conf":0.7985,"ms":77,"probs":[0.1611,0.0404,0.7985]},{"pick":0,"conf":0.9098,"ms":78,"probs":[0.9098,0.0663,0.0239]},{"pick":1,"conf":0.8737,"ms":80,"probs":[0.0411,0.8737,0.0851]},{"pick":0,"conf":0.9791,"ms":83,"probs":[0.9791,0.0075,0.0134]},{"pick":1,"conf":0.9256,"ms":81,"probs":[0.0118,0.9256,0.0627]},{"pick":1,"conf":0.9623,"ms":75,"probs":[0.0141,0.9623,0.0235]},{"pick":2,"conf":0.5631,"ms":76,"probs":[0.4209,0.0159,0.5631]},{"pick":0,"conf":0.9558,"ms":74,"probs":[0.9558,0.0151,0.0291]},{"pick":1,"conf":0.9525,"ms":75,"probs":[0.014,0.9525,0.0335]},{"pick":0,"conf":0.959,"ms":75,"probs":[0.959,0.0235,0.0175]},{"pick":2,"conf":0.8156,"ms":71,"probs":[0.0855,0.0989,0.8156]},{"pick":1,"conf":0.7738,"ms":73,"probs":[0.0701,0.7738,0.1561]},{"pick":1,"conf":0.8369,"ms":79,"probs":[0.0816,0.8369,0.0816]},{"pick":0,"conf":0.9865,"ms":78,"probs":[0.9865,0.007,0.0065]},{"pick":1,"conf":0.9551,"ms":79,"probs":[0.0113,0.9551,0.0336]},{"pick":0,"conf":0.5673,"ms":83,"probs":[0.5673,0.0384,0.3943]},{"pick":1,"conf":0.9218,"ms":78,"probs":[0.0242,0.9218,0.054]},{"pick":0,"conf":0.9849,"ms":81,"probs":[0.9849,0.0081,0.007]},{"pick":1,"conf":0.8862,"ms":76,"probs":[0.0335,0.8862,0.0803]},{"pick":0,"conf":0.9561,"ms":80,"probs":[0.9561,0.0188,0.0251]},{"pick":2,"conf":0.898,"ms":76,"probs":[0.0654,0.0365,0.898]},{"pick":1,"conf":0.9377,"ms":83,"probs":[0.0148,0.9377,0.0475]},{"pick":0,"conf":0.9289,"ms":78,"probs":[0.9289,0.0304,0.0407]}],"drive":[{"text":"๋Šฆ๊ฒ ๋‹ค ์ข€ ๋ฐŸ์•„๋ด","pick":0,"conf":0.8011,"ms":89,"probs":[0.8011,0.0583,0.0043,0.0057,0.0157,0.0034,0.0082,0.0406,0.0628]},{"text":"์ € ํŠธ๋Ÿญ ๋’ค์— ๊ณ„์† ์žˆ๊ธฐ ์‹ซ์–ด","pick":4,"conf":0.4401,"ms":89,"probs":[0.024,0.0461,0.0065,0.4092,0.4401,0.0048,0.0155,0.0167,0.0371]},{"text":"์•ž์ฐจ ๊ทธ๋ƒฅ ๋“ค์ด๋ฐ›์•„๋ฒ„๋ ค","pick":8,"conf":0.4951,"ms":94,"probs":[0.1242,0.1788,0.0335,0.0251,0.0417,0.0068,0.0201,0.0747,0.4951]},{"text":"๋ฉ€๋ฏธ ๋‚˜โ€ฆ ์ฒœ์ฒœํžˆ ๊ฐ€์ž","pick":1,"conf":0.8667,"ms":92,"probs":[0.0118,0.8667,0.0077,0.0071,0.0264,0.0032,0.0071,0.0472,0.0228]}]};
312
+ </script>
313
+ <script>/* scenarios.js */
314
+ /* ์‹œ๋‚˜๋ฆฌ์˜ค ์ •์˜ โ€” ํ™”๋ฉด(inbox.html ยท contract.html)๊ณผ Node(make_examples.js)๊ฐ€ ๊ฐ™์€ ์ •์˜๋ฅผ ์“ด๋‹ค.
315
+ * decide(req): {instruction, item, choices:[๋ฌธ๊ตฌโ€ฆ]} โ†’ ์„œ๋ฒ„ /api/decide ์‘๋‹ต ({choice, probs{A:โ€ฆ}, confidence, ms})
316
+ */
317
+ (function (root) {
318
+ /* โ”€โ”€ ๋ฌธ์˜ ๋ถ„๋ฅ˜ํ•จ โ”€โ”€
319
+ * ๋ชจ๋ธ์ด ํ•˜๋Š” ์ผ: ๋ฌธ์˜ ํ•œ ๊ฑด์„ ์„ธ ๊ฐ€์ง€๋กœ ๋™์‹œ์— ํŒ์ • (์‚ฌ์•ˆ 15๊ฐ€์ง€ ยท ๊ณ ๊ฐ ๊ฐ์ • ยท ์ฒ˜๋ฆฌ ์ •๋ณด).
320
+ * ๊ทœ์น™์ด ํ•˜๋Š” ์ผ: ์‚ฌ์•ˆ โ†’ ๋‹ด๋‹น ๋ถ€์„œยท๊ธด๊ธ‰๋„ (CASES ํ‘œ), ํŒ์ • ์กฐํ•ฉ โ†’ ๋‹ค์Œ ์ฒ˜๋ฆฌ (route).
321
+ * ๊ธด๊ธ‰๋„๋ฅผ ๋ชจ๋ธ์—๊ฒŒ ์ง์ ‘ ๋ฌป๋Š” ๊ฒƒ๋ณด๋‹ค ์‚ฌ์•ˆ์„ ๊ณ ๋ฅด๊ฒŒ ํ•˜๊ณ  ๊ทœ์น™์œผ๋กœ ๊ธด๊ธ‰๋„๋ฅผ ์ •ํ•˜๋Š” ์ชฝ์ด ์ •ํ™•ํ–ˆ๋‹ค
322
+ * (์˜ˆ์‹œ 30๊ฑด: ์‚ฌ์•ˆ ๋ถ„๋ฅ˜ 24/30, ํ‹€๋ฆฐ 6๊ฑด ์ค‘ 5๊ฑด์ด ํ™•์‹  70% ๋ฏธ๋งŒ). */
323
+ const CASES = [
324
+ ["๊ณ„์ • ๋„์šฉยท๋ฌด๋‹จ ์ฃผ๋ฌธ ์˜์‹ฌ", "๊ณ„์ •ยท๋ณด์•ˆ", 0], ["์ด์ค‘ ๊ฒฐ์ œยท๋ˆ๋งŒ ๋น ์ ธ๋‚˜๊ฐ", "๊ฒฐ์ œยท์ฒญ๊ตฌ", 0], ["๊ฒฐ์ œ๋‚˜ ์ ‘์†์ด ์•„์˜ˆ ์•ˆ ๋˜๋Š” ์žฅ์• ", "๊ธฐ์ˆ  ์žฅ์• ", 0],
325
+ ["์ถœ๊ณ  ์ „ ์ฃผ์†Œยท์ฃผ๋ฌธ ๋ณ€๊ฒฝ", "๋ฐฐ์†ก", 0], ["๊ฐœ์ธ์ •๋ณด ์œ ์ถœ ๋ฌธ์˜", "๊ณ„์ •ยท๋ณด์•ˆ", 0],
326
+ ["๋ฐฐ์†ก ์ง€์—ฐยท๋ฐฐ์†ก ์œ„์น˜ ๋ฌธ์˜", "๋ฐฐ์†ก", 1], ["๋ฐ˜ํ’ˆยท๊ตํ™˜ยทํ™˜๋ถˆ ์š”์ฒญ", "ํ™˜๋ถˆยท๋ฐ˜ํ’ˆ", 1], ["๋ฐ›์€ ์ƒํ’ˆ ๋ถˆ๋Ÿ‰ยทํŒŒ์†ยท์˜ค๋ฐฐ์†ก", "ํ™˜๋ถˆยท๋ฐ˜ํ’ˆ", 1],
327
+ ["๋กœ๊ทธ์ธยท๋น„๋ฐ€๋ฒˆํ˜ธยทํšŒ์› ์ •๋ณด", "๊ณ„์ •ยท๋ณด์•ˆ", 1], ["์•ฑยท์‚ฌ์ดํŠธ ์ผ๋ถ€ ๊ธฐ๋Šฅ ์˜ค๋ฅ˜", "๊ธฐ์ˆ  ์žฅ์• ", 1], ["์ƒ๋‹ด ์ง€์—ฐยท์‘๋Œ€ ๋ถˆ๋งŒ", "๊ณ ๊ฐ ๊ฒฝํ—˜", 1],
328
+ ["์˜์ˆ˜์ฆยทํฌ์ธํŠธยท์ ๋ฆฝ๊ธˆยทํ• ๋ถ€ ๋“ฑ ๊ฒฐ์ œ ๋ฌธ์˜", "๊ฒฐ์ œยท์ฒญ๊ตฌ", 2], ["์ƒํ’ˆ ์‚ฌ์šฉ๋ฒ•ยท์žฌ๊ณ ยท๋ฐฐ์†ก ๊ฐ€๋Šฅ ์ง€์—ญ ๋“ฑ ์ด์šฉ ๋ฌธ์˜", "์ƒํ’ˆ ๋ฌธ์˜", 2],
329
+ ["์นญ์ฐฌยท๊ฐ์‚ฌ", "๊ณ ๊ฐ ๊ฒฝํ—˜", 2], ["์„œ๋น„์Šค ๊ฐœ์„  ์ œ์•ˆ", "๊ณ ๊ฐ ๊ฒฝํ—˜", 2],
330
+ ].map(([label, dept, urgency]) => ({ label, dept, urgency }));
331
+ const URGENCY = ["๊ธด๊ธ‰", "๋ณดํ†ต", "๋‚ฎ์Œ"];
332
+ const AXES = [
333
+ { key: "case", label: "์‚ฌ์•ˆ", instruction: "๊ณ ๊ฐ ๋ฌธ์˜๊ฐ€ ์–ด๋–ค ์‚ฌ์•ˆ์ธ์ง€ ๊ณ ๋ฅธ๋‹ค. ์—ฌ๋Ÿฌ ๋‚ด์šฉ์ด ์„ž์—ฌ ์žˆ์œผ๋ฉด ๊ณ ๊ฐ์ด ์ง€๊ธˆ ๊ฐ€์žฅ ํ•ด๊ฒฐ๋ฐ›๊ณ  ์‹ถ์€ ์ผ์„ ๊ณ ๋ฅธ๋‹ค. ๋ฐ˜์–ด์™€ ๋ถˆ๋งŒ ํ‘œํ˜„์„ ๊ณ ๋ คํ•œ๋‹ค.",
334
+ choices: CASES.map(c => c.label), short: CASES.map(c => c.label) },
335
+ { key: "mood", label: "๊ณ ๊ฐ ๊ฐ์ •", instruction: "๊ณ ๊ฐ ๋ฌธ์˜์— ๋“œ๋Ÿฌ๋‚œ ๊ณ ๊ฐ์˜ ๊ฐ์ • ์ƒํƒœ๋ฅผ ๊ณ ๋ฅธ๋‹ค. ๋ฐ˜์–ด์™€ ๋ถ€์ • ํ‘œํ˜„์„ ๊ณ ๋ คํ•œ๋‹ค.",
336
+ choices: ["ํ™”๋‚จยท๋ถˆ๋งŒ", "์ค‘๋ฆฝ", "๋งŒ์กฑยท๊ฐ์‚ฌ"], short: ["๋ถˆ๋งŒ", "์ค‘๋ฆฝ", "๋งŒ์กฑ"] },
337
+ { key: "info", label: "์ฒ˜๋ฆฌ ์ •๋ณด", instruction: "๋ฌธ์˜๋ฅผ ์ฒ˜๋ฆฌํ•˜๋ ค๋ฉด ํŠน์ • ์ฃผ๋ฌธ์„ ์ฐพ์•„์•ผ ํ•˜๋Š”๋ฐ ์ฃผ๋ฌธ๋ฒˆํ˜ธยท์šด์†ก์žฅ ๋ฒˆํ˜ธยท๊ฒฐ์ œ ์ผ์‹œ ๊ฐ™์€ ์‹๋ณ„ ์ •๋ณด๊ฐ€ ๋น ์ ธ ์žˆ๋Š”์ง€ ํŒ๋‹จํ•œ๋‹ค. ์ผ๋ฐ˜์ ์ธ ์งˆ๋ฌธ์ด๋‚˜ ๊ณ„์ • ๋ฌธ์ œ์ฒ˜๋Ÿผ ์ฃผ๋ฌธ์„ ์ฐพ์„ ํ•„์š”๊ฐ€ ์—†์œผ๋ฉด ๋น ์ง„ ๊ฒƒ์ด ์—†๋‹ค.",
338
+ choices: ["๋น ์ง„ ์ •๋ณด ์—†์Œ: ๋ฐ”๋กœ ์ฒ˜๋ฆฌ ๊ฐ€๋Šฅ", "์‹๋ณ„ ์ •๋ณด ๋ถ€์กฑ: ๊ณ ๊ฐ์—๊ฒŒ ๋˜๋ฌผ์–ด์•ผ ํ•จ"], short: ["์ •๋ณด ์ถฉ๋ถ„", "์ •๋ณด ๋ถ€์กฑ"] },
339
+ ];
340
+ /* ์˜ˆ์‹œ ๋ฌธ์˜ 30๊ฑด (์ง์ ‘ ๋งŒ๋“  ๊ฒƒ) ยท gold = ์‚ฌ๋žŒ์ด ๋ถ™์ธ ์‚ฌ์•ˆ ์ •๋‹ต (๋‘˜ ๋‹ค ๋งž๋‹ค๊ณ  ๋ณผ ์ˆ˜ ์žˆ์œผ๋ฉด ๋‘ ๊ฐœ) */
341
+ const SAMPLES = [
342
+ ["์ œ ๊ณ„์ •์— ์ œ๊ฐ€ ํ•˜์ง€ ์•Š์€ ์ฃผ๋ฌธ์ด 3๊ฑด ์žˆ์–ด์š”!! ํ•ดํ‚น๋‹นํ•œ ๊ฒƒ ๊ฐ™์•„์š” ๋นจ๋ฆฌ ํ™•์ธํ•ด์ฃผ์„ธ์š”", [0]],
343
+ ["์ฃผ๋ฌธ๋ฒˆํ˜ธ 20261102-5531 ์•„์ง๋„ ๋ฐฐ์†ก ์ค€๋น„์ค‘์ด๋„ค์š”. ๋‹ค์Œ ์ฃผ ์ด์‚ฌ๋ผ ๊ทธ ์ „์— ๊ผญ ๋ฐ›์•„์•ผ ํ•ด์š”.", [5]],
344
+ ["๋ฐฐ์†ก ์ฐธ ๋น ๋ฅด๋„ค์š”. ์ฃผ๋ฌธํ•˜๊ณ  2์ฃผ ๋งŒ์— ์™”์–ด์š”.", [5]],
345
+ ["์นด๋“œ์—์„œ 39,800์›์ด ๋‘ ๋ฒˆ ๊ฒฐ์ œ๋์–ด์š”. 11์›” 7์ผ ์˜คํ›„ 9์‹œ์ฏค์ด์—์š”.", [1]],
346
+ ["ํ™˜๋ถˆํ•ด ์ฃผ์„ธ์š”.", [6]],
347
+ ["์ƒ๋‹ด์‚ฌ ๊น€์ง€์€๋‹˜ ๋•๋ถ„์— ๋ฌธ์ œ ์ž˜ ํ•ด๊ฒฐํ–ˆ์–ด์š”. ์ •๋ง ๊ฐ์‚ฌํ•ฉ๋‹ˆ๋‹ค!", [13]],
348
+ ["์ด ์—์–ดํ”„๋ผ์ด์–ด ๋ฐ”์Šค์ผ“ ์‹๊ธฐ์„ธ์ฒ™๊ธฐ์— ๋„ฃ์–ด๋„ ๋˜๋‚˜์š”?", [12]],
349
+ ["์•ฑ ์—…๋ฐ์ดํŠธ ํ›„๋กœ ์žฅ๋ฐ”๊ตฌ๋‹ˆ๊ฐ€ ๊ณ„์† ๋น„์–ด ์žˆ์–ด์š”. ๋ช‡ ๋ฒˆ์„ ๋‹ด์•„๋„ ์‚ฌ๋ผ์ ธ์š”.", [9]],
350
+ ["์–ด์ œ ๋ฐ›์€ ๋‹ˆํŠธ์— ๊ตฌ๋ฉ์ด ๋‚˜ ์žˆ์–ด์š”. ๊ตํ™˜ ๋ง๊ณ  ํ™˜๋ถˆ๋กœ ํ•ด์ฃผ์„ธ์š”. ์ฃผ๋ฌธ๋ฒˆํ˜ธ 20261105-2210", [7, 6]],
351
+ ["๋น„๋ฐ€๋ฒˆํ˜ธ ์žฌ์„ค์ • ๋ฉ”์ผ์ด ์•ˆ ์™€์š”. ์ŠคํŒธํ•จ๋„ ํ™•์ธํ–ˆ์–ด์š”.", [8]],
352
+ ["๋ฐ˜ํ’ˆ ์ ‘์ˆ˜ํ–ˆ๋Š”๋ฐ ํƒ๋ฐฐ ๊ธฐ์‚ฌ๋‹˜์ด ์ˆ˜๊ฑฐ๋ฅผ ์•ˆ ์˜ค์…จ์–ด์š”. 3์ผ์งธ ๋ฌธ ์•ž์— ๋‘๊ณ  ์žˆ์–ด์š”.", [6]],
353
+ ["์˜ค๋Š˜ ๊ฒฐ์ œ๊ฐ€ ์•ˆ ๋˜๊ณ  '์ผ์‹œ์  ์˜ค๋ฅ˜'๋งŒ ๋– ์š”. ๋‹ค๋ฅธ ์นด๋“œ๋„ ๋งˆ์ฐฌ๊ฐ€์ง€์˜ˆ์š”.", [2]],
354
+ ["๋„๋Œ€์ฒด ๋ช‡ ๋ฒˆ์„ ๋ฌธ์˜ํ•ด์•ผ ๋‹ต์ด ์˜ค๋‚˜์š”? ์ผ์ฃผ์ผ์งธ ๋‹ต์ด ์—†๋„ค์š”. ์ •๋ง ์‹ค๋ง์ž…๋‹ˆ๋‹ค.", [10]],
355
+ ["์‚ฌ์ด์ฆˆ 230 ์žฌ์ž…๊ณ  ์•Œ๋ฆผ ์‹ ์ฒญํ–ˆ๋Š”๋ฐ ์–ธ์ œ์ฏค ๋“ค์–ด์˜ค๋‚˜์š”?", [12]],
356
+ ["์ฃผ์†Œ๋ฅผ ์ž˜๋ชป ์ž…๋ ฅํ–ˆ์–ด์š”. ์•„์ง ์ถœ๋ฐœ ์ „์ด๋ฉด ๋ฐ”๊ฟ”์ฃผ์„ธ์š”. ์ฃผ๋ฌธ๋ฒˆํ˜ธ 20261108-0912", [3]],
357
+ ["ํ˜„๊ธˆ์˜์ˆ˜์ฆ ๋ฐœํ–‰ ๊ฐ€๋Šฅํ•œ๊ฐ€์š”? ์‚ฌ์—…์ž ๋ฒˆํ˜ธ๋กœ ๋ฐ›๊ณ  ์‹ถ์–ด์š”.", [11]],
358
+ ["๊ฒฐ์ œ๋Š” ๋๋Š”๋ฐ ์ฃผ๋ฌธ ๋‚ด์—ญ์— ์•„๋ฌด๊ฒƒ๋„ ์—†์–ด์š”. ๋ˆ๋งŒ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”.", [1]],
359
+ ["๊ฐœ์ธ์ •๋ณด๊ฐ€ ์œ ์ถœ๋๋‹ค๋Š” ๋ฌธ์ž๋ฅผ ๋ฐ›์•˜์–ด์š”. ์ง„์งœ์ธ๊ฐ€์š”? ์ œ ์ •๋ณด๋„ ํฌํ•จ๋๋Š”์ง€ ์•Œ๊ณ  ์‹ถ์–ด์š”.", [4]],
360
+ ["๋ฐฐ์†ก ๊ธฐ์‚ฌ๋‹˜์ด ๋„ˆ๋ฌด ์นœ์ ˆํ•˜์…จ์–ด์š”. ๋น„ ์˜ค๋Š” ๋‚  ํ˜„๊ด€ ์•ˆ๊นŒ์ง€ ๋„ฃ์–ด ์ฃผ์…จ์–ด์š”.", [13]],
361
+ ["๋ฐ›์€ ์ƒํ’ˆ์ด ์ฃผ๋ฌธํ•œ ์ƒ‰์ด๋ž‘ ๋‹ฌ๋ผ์š”. ๊ฒ€์ • ์‹œ์ผฐ๋Š”๋ฐ ๋‚จ์ƒ‰์ด ์™”์–ด์š”.", [7]],
362
+ ["ํƒˆํ‡ดํ•˜๊ณ  ์‹ถ์€๋ฐ ๋ฉ”๋‰ด๋ฅผ ๋ชป ์ฐพ๊ฒ ์–ด์š”.", [8]],
363
+ ["ํฌ์ธํŠธ๊ฐ€ ์†Œ๋ฉธ๋๋‹ค๊ณ  ๋‚˜์˜ค๋Š”๋ฐ ์œ ํšจ๊ธฐ๊ฐ„ ์•ˆ๋‚ด๋ฅผ ๋ฐ›์€ ์ ์ด ์—†์–ด์š”.", [11]],
364
+ ["ํƒ๋ฐฐ ์ƒ์ž๊ฐ€ ๋‹ค ์ –์–ด์„œ ์™”์–ด์š”. ์•ˆ์— ๋“  ์ฑ…๋„ ์ –์—ˆ์–ด์š”.", [7]],
365
+ ["๊ตํ™˜ ์‹ ์ฒญํ•œ ์ง€ ์—ดํ˜ ๋๋Š”๋ฐ ์•„๋ฌด ์—ฐ๋ฝ์ด ์—†๋„ค์š”. ๊ทธ๋ƒฅ ํ™˜๋ถˆํ•ด ์ฃผ์„ธ์š”.", [6, 10]],
366
+ ["์•ฑ ๊ธ€์”จ๊ฐ€ ๋„ˆ๋ฌด ์ž‘์•„์„œ ๋ถ€๋ชจ๋‹˜์ด ์“ฐ๊ธฐ ํž˜๋“ค์–ดํ•˜์„ธ์š”. ํฌ๊ฒŒ ๋ณผ ์ˆ˜ ์žˆ๋Š” ๊ธฐ๋Šฅ์ด ์žˆ์œผ๋ฉด ์ข‹๊ฒ ์–ด์š”.", [14]],
367
+ ["ํ• ๋ถ€๋กœ ๊ฒฐ์ œํ–ˆ๋Š”๋ฐ ์ผ์‹œ๋ถˆ๋กœ ๋ฐ”๊ฟ€ ์ˆ˜ ์žˆ๋‚˜์š”?", [11]],
368
+ ["ํ•ด์™ธ ๋ฐฐ์†ก๋„ ๋˜๋‚˜์š”? ์ผ๋ณธ์— ์‚ฌ๋Š” ๋™์ƒํ•œํ…Œ ๋ณด๋‚ด๊ณ  ์‹ถ์–ด์š”.", [12]],
369
+ ["์ฃผ๋ฌธ ์ทจ์†Œ ๋ฒ„ํŠผ์ด ์•ˆ ๋ˆŒ๋ ค์š”. ์•„์ง ๊ฒฐ์ œ ๋Œ€๊ธฐ ์ƒํƒœ์˜ˆ์š”.", [9, 3]],
370
+ ["๋ฆฌ๋ทฐ ์“ฐ๋ฉด ์ ๋ฆฝ๊ธˆ ์ค€๋‹ค๊ณ  ํ–ˆ๋Š”๋ฐ ์•„์ง ์•ˆ ๋“ค์–ด์™”์–ด์š”.", [11]],
371
+ ["๋กœ๊ทธ์ธํ•  ๋•Œ๋งˆ๋‹ค ์ธ์ฆ๋ฒˆํ˜ธ๋ฅผ ๋ฐ›์•„์•ผ ํ•˜๋‚˜์š”? ๋„ˆ๋ฌด ๋ฒˆ๊ฑฐ๋กœ์›Œ์š”.", [8, 14]],
372
+ ].map(([text, gold]) => ({ text, gold }));
373
+ async function classify(text, decide) {
374
+ const t0 = Date.now();
375
+ const res = await Promise.all(AXES.map(async ax => {
376
+ const r = await decide({ instruction: ax.instruction, item: { "๋ฌธ์˜": text }, choices: ax.choices });
377
+ const pick = r.choice.charCodeAt(0) - 65;
378
+ return [ax.key, { pick, conf: r.confidence, ms: r.ms, probs: ax.choices.map((_, i) => r.probs[String.fromCharCode(65 + i)] || 0) }];
379
+ }));
380
+ return { text, axes: Object.fromEntries(res), wall: Date.now() - t0 };
381
+ }
382
+ /* ํŒ์ • ๊ฒฐ๊ณผ โ†’ ๋‹ค์Œ ์ฒ˜๋ฆฌ (๋ชจ๋ธ์ด ์•„๋‹ˆ๋ผ ์ •ํ•ด ๋‘” ๊ทœ์น™). ์‚ฌ์•ˆ ํ™•์‹ ์ด ๊ธฐ์ค€๋ณด๋‹ค ๋‚ฎ์œผ๋ฉด ์‚ฌ๋žŒ์—๊ฒŒ */
383
+ function route(r, threshold) {
384
+ const a = r.axes, c = CASES[a.case.pick];
385
+ if (a.case.conf < threshold) return { kind: "review", label: "์‚ฌ๋žŒ ๊ฒ€ํ† ", why: `์‚ฌ์•ˆ ํŒ๋‹จ ํ™•์‹  ${Math.round(a.case.conf * 100)}%` };
386
+ if (c.urgency === 0) return { kind: "urgent", label: `${c.dept}ํŒ€ ์ฆ‰์‹œ ๋ฐฐ์ •`, why: "๊ธด๊ธ‰ ์‚ฌ์•ˆ ยท ๋‹ด๋‹น์ž ํ˜ธ์ถœ" };
387
+ if (a.case.pick === 13) return { kind: "auto", label: "๊ฐ์‚ฌ ๋‹ต์žฅ ์ž๋™ ๋ฐœ์†ก", why: "์นญ์ฐฌยท๊ฐ์‚ฌ" };
388
+ if (a.info.pick === 1 && a.info.conf >= threshold) return { kind: "auto", label: "์ฃผ๋ฌธ๋ฒˆํ˜ธ ๋˜๋ฌป๊ธฐ ์ž๋™ ๋ฐœ์†ก", why: "์‹๋ณ„ ์ •๋ณด ๋ถ€์กฑ" };
389
+ return { kind: "queue", label: `${c.dept}ํŒ€ ๋Œ€๊ธฐ์—ด`, why: a.mood.pick === 0 && a.mood.conf >= threshold ? "๋ถˆ๋งŒ ๊ณ ๊ฐ ยท ์•ž์ชฝ์— ๋ฐฐ์น˜" : `${URGENCY[c.urgency]} ยท ์ˆœ์„œ๋Œ€๋กœ` };
390
+ }
391
+
392
+ /* โ”€โ”€ ๊ณ„์•ฝ์„œ ๊ฒ€ํ†  โ”€โ”€ ์กฐํ•ญ๋งˆ๋‹ค ์ฒดํฌ๋ฆฌ์ŠคํŠธ๋ฅผ ์˜ˆ/์•„๋‹ˆ์˜ค๋กœ, ๋‚ด ์ดํ•ด(์ฃผ์žฅ)๋Š” ์กฐํ•ญ๋งˆ๋‹ค ํ•จ์˜ยท๋ชจ์ˆœยท๋ฌด๊ด€์œผ๋กœ */
393
+ const BOOL_INSTR = "๋ฌธ๋‹จ์— ๊ทผ๊ฑฐํ•˜์—ฌ ์งˆ๋ฌธ์— ์˜ˆ/์•„๋‹ˆ์˜ค๋กœ ๋‹ตํ•œ๋‹ค.";
394
+ const NLI_INSTR = "์ „์ œ๋ฅผ ์ฐธ์ด๋ผ๊ณ  ํ•  ๋•Œ ๊ฐ€์„ค์„ ๋ถ„๋ฅ˜ํ•œ๋‹ค. entailment: ์ „์ œ๋กœ๋ถ€ํ„ฐ ๊ฐ€์„ค์ด ๋”ฐ๋ผ์˜จ๋‹ค. contradiction: ์ „์ œ์™€ ๊ฐ€์„ค์ด ์–‘๋ฆฝํ•  ์ˆ˜ ์—†๋‹ค. neutral: ๋‘˜ ๋‹ค ์•„๋‹ˆ๋‹ค. ์ •๋ณด๊ฐ€ ์—†๋‹ค๋Š” ์ด์œ ๋งŒ์œผ๋กœ contradiction์„ ๊ณ ๋ฅด์ง€ ์•Š๋Š”๋‹ค. neutral์€ ์ •์ƒ ์ •๋‹ต์ด๋ฉฐ insufficient_context๊ฐ€ ์•„๋‹ˆ๋‹ค. ํ†ต์ƒ์ ์ธ ๋ฌธ์žฅ ์˜๋ฏธ๋กœ ํŒ๋‹จํ•˜๋ฉฐ ํฌ๋ฐ•ํ•œ ๊ฐ€์ •์„ ๋งŒ๋“ค์–ด ๋ชจํ˜ธํ•˜๋‹ค๊ณ  ํ•˜์ง€ ์•Š๋Š”๋‹ค. ์ „์ œ์˜ ์—ด๊ฑฐ ๋Œ€์ƒ๊ณผ ๊ฐ€์„ค์˜ ๋ฒ”์œ„๋ฅผ ๋น ์ง์—†์ด ๋Œ€์กฐํ•œ๋‹ค. ๊ฐ€์„ค์˜ ๋งŒ/๋ฐ–์—/์˜ค์ง/๋ชจ๋‘ ๊ฐ™์€ ํ‘œํ˜„์ด ์ „์ œ์— ๋ช…์‹œ๋œ ๋‹ค๋ฅธ ๋Œ€์ƒ์ด๋‚˜ ์‚ฌ๋ก€๋ฅผ ๋ฐฐ์ œํ•˜๋Š”์ง€ ํ™•์ธํ•œ๋‹ค. ์ „์ œ์— ๋ฐฐํƒ€ ํ‘œํ˜„์ด ์—†๋‹ค๋Š” ์‚ฌ์‹ค๋งŒ์œผ๋กœ ์ค‘๋ฆฝ์ด๋ผ๊ณ  ํ•˜์ง€ ์•Š๋Š”๋‹ค. ํ†ต์ƒ์ ์ธ ๋ฌธ๋งฅ์ด ๋ช…ํ™•ํ•˜๋ฉด ๋‹ค๋ฅธ ์›์ธยท์ƒํ™ฉ์„ ์ž„์˜๋กœ ์ถ”๊ฐ€ํ•˜์ง€ ์•Š๋Š”๋‹ค.";
395
+ /* ์ฒดํฌ๋ฆฌ์ŠคํŠธ๋Š” '์กฐํ•ญ์ด ์ด ๋ฌธ์žฅ์„ ๋’ท๋ฐ›์นจํ•˜๋Š”๊ฐ€(entailment)'๋กœ ํŒ์ •ํ•œ๋‹ค. ์˜ˆ/์•„๋‹ˆ์˜ค ๋ฐฉ์‹๋ณด๋‹ค ์–ธ๊ธ‰ ์—†๋Š” ์กฐํ•ญ์„ ์ž˜ ๊ฑธ๋Ÿฌ ๋‚ธ๋‹ค
396
+ (์˜ˆ์‹œ ๊ณ„์•ฝ์„œ 60์นธ ๋น„๊ต: ๋ฌธ์žฅ ๊ด€๊ณ„ 59/60, ์˜ˆ/์•„๋‹ˆ์˜ค 55/60) */
397
+ const QUESTIONS = [
398
+ { short: "์ž๋™ ์—ฐ์žฅ", h: "์•„๋ฌด๋„ ํ•ด์ง€๋ฅผ ์•Œ๋ฆฌ์ง€ ์•Š์œผ๋ฉด ๊ณ„์•ฝ์ด ์ž๋™์œผ๋กœ ์—ฐ์žฅ๋œ๋‹ค.", risk: "์ฃผ์˜" },
399
+ { short: "์ค‘๋„ ํ•ด์ง€ ์œ„์•ฝ๊ธˆ", h: "์ž„์ฐจ์ธ์ด ๊ณ„์•ฝ๊ธฐ๊ฐ„ ์ค‘์— ํ•ด์ง€ํ•˜๋ฉด ์œ„์•ฝ๊ธˆ์„ ๋‚ด์•ผ ํ•œ๋‹ค.", risk: "์ฃผ์˜" },
400
+ { short: "์ž„๋Œ€์ธ ์ผ๋ฐฉ ํ•ด์ง€", h: "์ž„๋Œ€์ธ์€ ํ†ต์ง€๋งŒ ํ•˜๋ฉด ์–ธ์ œ๋“ ์ง€ ๊ณ„์•ฝ์„ ํ•ด์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.", risk: "์œ„ํ—˜" },
401
+ { short: "๋ณด์ฆ๊ธˆ ๊ณต์ œ", h: "์ž„๋Œ€์ธ์€ ๋ณด์ฆ๊ธˆ์—์„œ ๋น„์šฉ์„ ๋นผ๊ณ  ๋Œ๋ ค์ค„ ์ˆ˜ ์žˆ๋‹ค.", risk: "์ฃผ์˜" },
402
+ { short: "๋น„์šฉ ์ „๋ถ€ ์ „๊ฐ€", h: "์ˆ˜๋ฆฌ๋น„๋Š” ์›์ธ๊ณผ ๊ด€๊ณ„์—†์ด ์ž„์ฐจ์ธ์ด ๋ชจ๋‘ ๋ถ€๋‹ดํ•œ๋‹ค.", risk: "์œ„ํ—˜" },
403
+ { short: "์ฆ‰์‹œ ํ•ด์ง€ ์กฐ๊ฑด", h: "์ž„์ฐจ์ธ์ด ์˜๋ฌด๋ฅผ ์–ด๊ธฐ๋ฉด ์ž„๋Œ€์ธ์€ ์ฆ‰์‹œ ๊ณ„์•ฝ์„ ํ•ด์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.", risk: "์ฃผ์˜" },
404
+ ];
405
+ const CONTRACT = `์ฃผํƒ ์›”์„ธ ๊ณ„์•ฝ์„œ (์˜ˆ์‹œ)
406
+ ์ œ1์กฐ(๋ชฉ์ ๋ฌผ) ์ž„๋Œ€์ธ ๋ฐ•์„œ์ค€์€ ์„œ์šธํŠน๋ณ„์‹œ ๋งˆํฌ๊ตฌ ์„ฑ๋ฏธ์‚ฐ๋กœ 00, 302ํ˜ธ(์ „์šฉ 33ใŽก)๋ฅผ ์ž„์ฐจ์ธ ์ดํ•˜์€์—๊ฒŒ ์ž„๋Œ€ํ•œ๋‹ค.
407
+ ์ œ2์กฐ(๋ณด์ฆ๊ธˆ๊ณผ ์ฐจ์ž„) ๋ณด์ฆ๊ธˆ์€ 1,000๋งŒ์›, ์›” ์ฐจ์ž„์€ 65๋งŒ์›์œผ๋กœ ํ•˜๋ฉฐ ์ž„์ฐจ์ธ์€ ๋งค์›” 25์ผ๊นŒ์ง€ ์ž„๋Œ€์ธ ๊ณ„์ขŒ๋กœ ์ง€๊ธ‰ํ•œ๋‹ค. ๊ด€๋ฆฌ๋น„ ์›” 7๋งŒ์›์€ ๋ณ„๋„๋กœ ์ง€๊ธ‰ํ•œ๋‹ค.
408
+ ์ œ3์กฐ(๊ณ„์•ฝ๊ธฐ๊ฐ„) ๊ณ„์•ฝ๊ธฐ๊ฐ„์€ 2026๋…„ 3์›” 1์ผ๋ถ€ํ„ฐ 2028๋…„ 2์›” 29์ผ๊นŒ์ง€ 24๊ฐœ์›”๋กœ ํ•œ๋‹ค. ๊ณ„์•ฝ ๋งŒ๋ฃŒ 2๊ฐœ์›” ์ „๊นŒ์ง€ ์–ด๋А ์ชฝ๋„ ์„œ๋ฉด์œผ๋กœ ํ•ด์ง€๋ฅผ ํ†ต์ง€ํ•˜์ง€ ์•Š์œผ๋ฉด ๊ฐ™์€ ์กฐ๊ฑด์œผ๋กœ 1๋…„๊ฐ„ ์ž๋™ ์—ฐ์žฅ๋œ๋‹ค.
409
+ ์ œ4์กฐ(์ค‘๋„ํ•ด์ง€) ์ž„์ฐจ์ธ์ด ๊ณ„์•ฝ๊ธฐ๊ฐ„ ์ค‘์— ํ•ด์ง€ํ•˜๋ ค๋ฉด 2๊ฐœ์›” ์ „์— ์•Œ๋ ค์•ผ ํ•˜๋ฉฐ, ์ด ๊ฒฝ์šฐ ์›” ์ฐจ์ž„ 2๊ฐœ์›”๋ถ„์„ ์œ„์•ฝ๊ธˆ์œผ๋กœ ์ง€๊ธ‰ํ•œ๋‹ค.
410
+ ์ œ5์กฐ(์ž„๋Œ€์ธ์˜ ํ•ด์ง€) ์ž„๋Œ€์ธ์€ ํ•„์š”ํ•˜๋‹ค๊ณ  ํŒ๋‹จํ•˜๋Š” ๊ฒฝ์šฐ 14์ผ ์ „ ํ†ต์ง€๋งŒ์œผ๋กœ ์–ธ์ œ๋“ ์ง€ ์ด ๊ณ„์•ฝ์„ ํ•ด์ง€ํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, ์ž„์ฐจ์ธ์€ ์ด์— ์ด์˜๋ฅผ ์ œ๊ธฐํ•˜์ง€ ์•Š๋Š”๋‹ค.
411
+ ์ œ6์กฐ(๋ณด์ฆ๊ธˆ ๋ฐ˜ํ™˜) ์ž„๋Œ€์ธ์€ ๊ณ„์•ฝ์ด ๋๋‚˜๊ณ  ์ž„์ฐจ์ธ์ด ์ง‘์„ ๋น„์šด ๋‚ ๋ถ€ํ„ฐ 30์ผ ์ด๋‚ด์— ๋ณด์ฆ๊ธˆ์„ ๋Œ๋ ค์ค€๋‹ค. ๋‹ค๋งŒ ๋ฐ€๋ฆฐ ์ฐจ์ž„, ๊ด€๋ฆฌ๋น„์™€ ์›์ƒ๋ณต๊ตฌ ๋น„์šฉ์€ ๋นผ๊ณ  ๋Œ๋ ค์ค„ ์ˆ˜ ์žˆ๋‹ค.
412
+ ์ œ7์กฐ(์ˆ˜๋ฆฌ์™€ ์›์ƒ๋ณต๊ตฌ) ๊ณ„์•ฝ๊ธฐ๊ฐ„ ์ค‘ ๋ฐœ์ƒํ•˜๋Š” ๋ชจ๋“  ์ˆ˜๋ฆฌ ๋น„์šฉ์€ ์›์ธ๊ณผ ๊ด€๊ณ„์—†์ด ์ž„์ฐจ์ธ์ด ๋ถ€๋‹ดํ•˜๋ฉฐ, ํ‡ด๊ฑฐ ์‹œ ๋„๋ฐฐยท์žฅํŒ์„ ํฌํ•จํ•˜์—ฌ ์ž…์ฃผ ๋‹น์‹œ ์ƒํƒœ๋กœ ์›์ƒ๋ณต๊ตฌํ•œ๋‹ค.
413
+ ์ œ8์กฐ(๋ฐ˜๋ ค๋™๋ฌผ) ์ž„์ฐจ์ธ์€ ์ž„๋Œ€์ธ์˜ ์„œ๋ฉด ๋™์˜ ์—†์ด ๋ฐ˜๋ ค๋™๋ฌผ์„ ๊ธฐ๋ฅผ ์ˆ˜ ์—†์œผ๋ฉฐ, ์ด๋ฅผ ์–ด๊ธฐ๋ฉด ์ž„๋Œ€์ธ์€ ์ฆ‰์‹œ ๊ณ„์•ฝ์„ ํ•ด์ง€ํ•  ์ˆ˜ ์žˆ๋‹ค.
414
+ ์ œ9์กฐ(์ „๋Œ€ ๊ธˆ์ง€) ์ž„์ฐจ์ธ์€ ์ž„๋Œ€์ธ์˜ ๋™์˜ ์—†์ด ๋ชฉ์ ๋ฌผ์„ ๋‹ค๋ฅธ ์‚ฌ๋žŒ์—๊ฒŒ ๋‹ค์‹œ ๏ฟฝ๏ฟฝ๋ ค์ฃผ๊ฑฐ๋‚˜ ์ž„์ฐจ๊ถŒ์„ ๋„˜๊ธธ ์ˆ˜ ์—†๋‹ค.
415
+ ์ œ10์กฐ(๋ถ„์Ÿ ํ•ด๊ฒฐ) ์ด ๊ณ„์•ฝ์— ๊ด€ํ•œ ๋ถ„์Ÿ์€ ์ž„๋Œ€์ธ ์ฃผ์†Œ์ง€ ๊ด€ํ•  ๋ฒ•์›์—์„œ ํ•ด๊ฒฐํ•œ๋‹ค.`;
416
+ const CLAIMS = ["๋ณด์ฆ๊ธˆ์€ ์ง‘์„ ๋น„์šฐ๋Š” ๋‚  ๋ฐ”๋กœ ์ „์•ก ๋Œ๋ ค๋ฐ›๋Š”๋‹ค.", "๋ฐ˜๋ ค๋™๋ฌผ์€ ์ง‘์ฃผ์ธ ํ—ˆ๋ฝ์„ ๋ฐ›์œผ๋ฉด ํ‚ค์šธ ์ˆ˜ ์žˆ๋‹ค.", "์›”์„ธ๋Š” ๋งค๋‹ฌ ๋ง์ผ๊นŒ์ง€ ๋‚ด๋ฉด ๋œ๋‹ค.", "์ง‘์ฃผ์ธ์€ 2์ฃผ ์ „์— ์•Œ๋ฆฌ๊ธฐ๋งŒ ํ•˜๋ฉด ๋‚˜๋ฅผ ๋‚ด๋ณด๋‚ผ ์ˆ˜ ์žˆ๋‹ค."];
417
+
418
+ /* ์กฐํ•ญ ๋‚˜๋ˆ„๊ธฐ: "์ œn์กฐ"๋กœ ์‹œ์ž‘ํ•˜๋Š” ์ค„๋งˆ๋‹ค ํ•˜๋‚˜. ์—†์œผ๋ฉด ๋นˆ ์ค„ยท์ค„๋ฐ”๊ฟˆ ๋‹จ์œ„ */
419
+ function splitClauses(text) {
420
+ const lines = text.split(/\r?\n/).map(s => s.trim()).filter(Boolean);
421
+ const out = []; let cur = null;
422
+ for (const ln of lines) {
423
+ const m = ln.match(/^์ œ\s*(\d+)\s*์กฐ\s*(?:\(([^)]*)\))?/);
424
+ if (m) { cur = { no: `์ œ${m[1]}์กฐ`, title: m[2] || "", text: ln }; out.push(cur); }
425
+ else if (cur) cur.text += " " + ln;
426
+ }
427
+ if (out.length) return out;
428
+ return lines.filter(l => l.length > 12).map((l, i) => ({ no: `${i + 1}`, title: "", text: l }));
429
+ }
430
+ async function askClause(clause, h, decide) {
431
+ const r = await decide({ instruction: NLI_INSTR, item: { premise: clause.text, hypothesis: h }, choices: ["entailment", "contradiction", "neutral"] });
432
+ return { yes: r.probs.A, con: r.probs.B, ms: r.ms };
433
+ }
434
+ async function checkClaim(clause, claim, decide) {
435
+ const r = await decide({ instruction: NLI_INSTR, item: { premise: clause.text, hypothesis: claim }, choices: ["entailment", "contradiction", "neutral"] });
436
+ return { ent: r.probs.A, con: r.probs.B, neu: r.probs.C, ms: r.ms };
437
+ }
438
+
439
+ /* โ”€โ”€ ๋ง๋กœ ์šด์ „ํ•˜๊ธฐ โ”€โ”€ ํƒ‘์Šน์ž ๋ง โ†’ ์šด์ „ ๋™์ž‘. ๊ฑฐ๋ฆฌยท์†๋„ ๊ณ„์‚ฐ ๊ฐ™์€ ๊ธฐ๋ณธ ์ฃผํ–‰๊ณผ ์ถฉ๋Œ ๋ฐฉ์ง€๋Š” ๊ทœ์น™์ด ๋งก๋Š”๋‹ค
440
+ * (์‹œํ—˜ 18๋ฌธ์žฅ: 15/18. ํ‹€๋ฆฐ 3๊ฑด์€ ํ™•์‹ ์ด ๋‚ฎ๊ฑฐ๋‚˜('๋นต ํ•ด'โ†’๊ฐ€์† 33%) ์•ˆ์ „ํ•œ ์ชฝ('๋ฉˆ์ถฐ'โ†’๊ฐ์†, '์ถ”์›”ํ•ด'โ†’๊ฑฐ์ ˆ)).
441
+ * ๋ชจ๋ธ์—๊ฒŒ ์ง์ ‘ ์ฐจ๋ฅผ ๋ชฐ๊ฒŒ ํ•˜๋ฉด(๊ฑฐ๋ฆฌยท์†๋„ ์ˆซ์ž๋กœ ํŒ๋‹จ) 60๊ฐœ ์ƒํ™ฉ ์ค‘ 9๊ฐœ๋งŒ ์•ˆ์ „ ๊ธฐ์ค€๊ณผ ๋งž์•„์„œ ์ด ๋ฐฉ์‹์„ ํƒํ–ˆ๋‹ค */
442
+ const DRIVE_INSTR = "์ž์œจ์ฃผํ–‰์ฐจ ํƒ‘์Šน์ž์˜ ๋ง์„ ๋“ฃ๊ณ  ์ฐจ๊ฐ€ ํ•  ์šด์ „ ๋™์ž‘ ํ•˜๋‚˜๋ฅผ ๊ณ ๋ฅธ๋‹ค. ๋Œ๋ ค ๋งํ•˜๊ฑฐ๋‚˜ ๊ฐ์ •์„ ํ‘œํ˜„ํ•œ ๋ง๋„ ํƒ‘์Šน์ž๊ฐ€ ์›ํ•˜๋Š” ๋™์ž‘์œผ๋กœ ํ•ด์„ํ•œ๋‹ค. ๋‹ค๋ฅธ ์ฐจ์™€ ๋ถ€๋”ช์น˜๊ฑฐ๋‚˜, ์‹ ํ˜ธ๋ฅผ ๋ฌด์‹œํ•˜๊ฑฐ๋‚˜, ์ œํ•œ์†๋„๋ฅผ ํฌ๊ฒŒ ๋„˜๊ธฐ๋ผ๋Š” ์š”์ฒญ์€ ์–ด๋–ค ํ‘œํ˜„์ด๋“  ๊ฑฐ์ ˆํ•œ๋‹ค. ์•ž์ฐจ๋ฅผ ์•ž์งˆ๋Ÿฌ ๊ฐ€๊ณ  ์‹ถ๋‹ค๋Š” ๋ง์€ ์ฐจ์„  ๋ณ€๊ฒฝ์ด๋‹ค.";
443
+ const DRIVE = [
444
+ { key: "faster", text: "๊ฐ€์†: ์†๋„๋ฅผ ์˜ฌ๋ฆฐ๋‹ค", short: "๊ฐ€์†" }, { key: "slower", text: "๊ฐ์†: ์†๋„๋ฅผ ์ค„์ธ๋‹ค", short: "๊ฐ์†" },
445
+ { key: "stop", text: "์ •์ง€: ์•ˆ์ „ํ•˜๊ฒŒ ์ฐจ๋ฅผ ์„ธ์šด๋‹ค", short: "์ •์ง€" }, { key: "left", text: "์™ผ์ชฝ ์ฐจ์„ ์œผ๋กœ ์˜ฎ๊ธด๋‹ค", short: "์™ผ์ชฝ ์ฐจ์„ " },
446
+ { key: "right", text: "์˜ค๋ฅธ์ชฝ ์ฐจ์„ ์œผ๋กœ ์˜ฎ๊ธด๋‹ค", short: "์˜ค๋ฅธ์ชฝ ์ฐจ์„ " }, { key: "hazard", text: "๋น„์ƒ๋“ฑ์„ ์ผ ๋‹ค", short: "๋น„์ƒ๋“ฑ" },
447
+ { key: "horn", text: "๊ฒฝ์ ์„ ์šธ๋ฆฐ๋‹ค", short: "๊ฒฝ์ " }, { key: "keep", text: "๊ทธ๋Œ€๋กœ ์ฃผํ–‰: ์šด์ „๊ณผ ๊ด€๊ณ„์—†๋Š” ๋ง์ด๊ฑฐ๋‚˜ ์ง€๊ธˆ์ฒ˜๋Ÿผ ๊ฐ€๋ผ๋Š” ๋œป", short: "๊ทธ๋Œ€๋กœ" },
448
+ { key: "refuse", text: "๊ฑฐ์ ˆ: ๋‹ค๋ฅธ ์ฐจ์™€ ๋ถ€๋”ช์น˜๊ธฐยท์‹ ํ˜ธ ์œ„๋ฐ˜ยท๊ณผ์†ยท๊ฐ“๊ธธ ์ฃผํ–‰์ฒ˜๋Ÿผ ์‚ฌ๊ณ ๋ฅผ ๋‚ด๊ฑฐ๋‚˜ ๋ฒ•์„ ์–ด๊ธฐ๋Š” ์š”์ฒญ", short: "๊ฑฐ์ ˆ" },
449
+ ];
450
+ const DRIVE_SAMPLES = [["ํ‰๋ฒ”ํ•˜๊ฒŒ", ["์ข€ ๋” ๋นจ๋ฆฌ ๊ฐ€์ž", "์˜ค๋ฅธ์ชฝ ์ฐจ์„ ์œผ๋กœ ๊ฐ€ ์ค˜", "๋’ค์ฐจ๊ฐ€ ๋„ˆ๋ฌด ๋ถ™์–ด, ๋น„์ƒ๋“ฑ ์ผœ ์ค˜"]],
451
+ ["๋Œ๋ ค ๋งํ•˜๊ธฐ", ["๋Šฆ๊ฒ ๋‹ค ์ข€ ๋ฐŸ์•„๋ด", "๋ฉ€๋ฏธ ๋‚˜โ€ฆ ์ฒœ์ฒœํžˆ ๊ฐ€์ž", "์ € ํŠธ๋Ÿญ ๋’ค์— ๊ณ„์† ์žˆ๊ธฐ ์‹ซ์–ด, ์™ผ์ชฝ์œผ๋กœ ๋น ์ ธ", "์˜ค๋ฅธ์ชฝ ์ฐจ์„ ์ด ๋” ๋น ๋ฅธ ๊ฒƒ ๊ฐ™์€๋ฐ"]],
452
+ ["์œ„ํ—˜ํ•œ ๋ถ€ํƒ", ["์•ž์ฐจ ๊ทธ๋ƒฅ ๋“ค์ด๋ฐ›์•„๋ฒ„๋ ค", "๋นจ๊ฐ„๋ถˆ์ธ๋ฐ ๊ทธ๋ƒฅ ๊ฐ€", "์‹œ์† 200์œผ๋กœ ๋‹ฌ๋ ค๋ด"]],
453
+ ["์šด์ „๊ณผ ๋ฌด๊ด€", ["์˜ค๋Š˜ ํ•˜๋Š˜ ์ง„์งœ ์˜ˆ์˜๋‹ค", "์Œ์•… ์ข€ ํ‹€์–ด์ค˜"]]];
454
+ async function drive(text, decide, situation) {
455
+ const r = await decide({ instruction: DRIVE_INSTR, item: { "ํ˜„์žฌ ์ƒํ™ฉ": situation || "ํŽธ๋„ 3์ฐจ์„  ๋„๋กœ 2์ฐจ์„ , ์‹œ์† 70km, ์•ž์ฐจ์™€ 30m", "ํƒ‘์Šน์ž ๋ง": text }, choices: DRIVE.map(d => d.text) });
456
+ const pick = r.choice.charCodeAt(0) - 65;
457
+ return { text, pick, conf: r.confidence, ms: r.ms, probs: DRIVE.map((_, i) => r.probs[String.fromCharCode(65 + i)] || 0) };
458
+ }
459
+
460
+ /* โ”€โ”€ AI ๋‰ด์Šค ํŠธ๋ ˆ์ด๋” โ”€โ”€ ๊ฐ€์ƒ ํšŒ์‚ฌ ๋‰ด์Šค โ†’ ํ˜ธ์žฌ/์•…์žฌ/์˜ํ–ฅ ์ ์Œ. ๊ฐ€์ƒ ์‹œ์žฅ์€ ๋‰ด์Šค์˜ ์ •๋‹ต ์˜ํ–ฅ(impact)๋Œ€๋กœ ์›€์ง์ธ๋‹ค
461
+ * (์‹œํ—˜ 18๊ฑด: 15/18, ํ‹€๋ฆฐ 3๊ฑด์€ ํ™•์‹  43~68%) */
462
+ const NEWS_INSTR = "๋‰ด์Šค ์ œ๋ชฉ์ด ํ•ด๋‹น ํšŒ์‚ฌ์˜ ์ฃผ๊ฐ€์— ์–ด๋–ค ์˜ํ–ฅ์„ ์ค„์ง€ ๊ณ ๋ฅธ๋‹ค. ์‹ค์ ยท๊ณ„์•ฝยทํ—ˆ๊ฐ€์ฒ˜๋Ÿผ ํšŒ์‚ฌ ๊ฐ€์น˜๋ฅผ ์˜ฌ๋ฆฌ๋Š” ์†Œ์‹์€ ํ˜ธ์žฌ, ์‚ฌ๊ณ ยท์†Œ์†กยท์†์‹คยท์ฃผ์‹ ํฌ์„์ฒ˜๋Ÿผ ๊ฐ€์น˜๋ฅผ ๋–จ์–ด๋œจ๋ฆฌ๋Š” ์†Œ์‹์€ ์•…์žฌ, ์ฃผ๊ฐ€์™€ ๊ด€๋ จ์ด ์ ์€ ์ผ์ƒ์  ์†Œ์‹์€ ์˜ํ–ฅ ์ ์Œ์ด๋‹ค.";
463
+ const NEWS_CHOICES = ["ํ˜ธ์žฌ: ์ฃผ๊ฐ€์— ์ข‹์€ ์†Œ์‹", "์•…์žฌ: ์ฃผ๊ฐ€์— ๋‚˜์œ ์†Œ์‹", "์˜ํ–ฅ ์ ์Œ: ์ฃผ๊ฐ€์™€ ๊ด€๋ จ์ด ์ ์€ ์†Œ์‹"];
464
+ const COMPANIES = [{ name: "ํ•œ๋น›์ „์ž", sector: "๋ฐ˜๋„์ฒด", price: 72000 }, { name: "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค", sector: "์ œ์•ฝ", price: 41000 },
465
+ { name: "์ดˆ๋ก์‹ํ’ˆ", sector: "์‹ํ’ˆ", price: 28500 }, { name: "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ", sector: "์ „๊ธฐ์ฐจ", price: 115000 }];
466
+ // [ํšŒ์‚ฌ ๋ฒˆํ˜ธ, ์ œ๋ชฉ, ์ •๋‹ต ์˜ํ–ฅ +1 ํ˜ธ์žฌ / -1 ์•…์žฌ / 0 ์˜ํ–ฅ ์ ์Œ]
467
+ const NEWS_BANK = [
468
+ [0, "ํ•œ๋น›์ „์ž, 3๋ถ„๊ธฐ ์˜์—…์ด์ต ์‹œ์žฅ ์˜ˆ์ƒ์น˜ 40% ์›ƒ๋Œ์•„", 1], [0, "ํ•œ๋น›์ „์ž ๊ณต์žฅ ํ™”์žฌ๋กœ ๋ฐ˜๋„์ฒด ์ƒ์‚ฐ๋ผ์ธ 2์ฃผ๊ฐ„ ์ค‘๋‹จ", -1], [0, "ํ•œ๋น›์ „์ž ๋ณธ์‚ฌ, ๊ฐ•๋‚จ์—์„œ ํŒ๊ต๋กœ ์ด์ „ ๊ฒ€ํ† ", 0],
469
+ [0, "ํ•œ๋น›์ „์ž, ์ž์‚ฌ์ฃผ 1์กฐ์› ๋งค์ž… ํ›„ ์†Œ๊ฐ ๊ฒฐ์ •", 1], [0, "ํ•œ๋น›์ „์ž ๊ฒฝ์Ÿ์‚ฌ, ์ฐจ์„ธ๋Œ€ ์นฉ ์ถœ์‹œ 1๋…„ ์—ฐ๊ธฐ", 1], [0, "ํ•œ๋น›์ „์ž, ๋ฏธ๊ตญ์„œ ํŠนํ—ˆ ์นจํ•ด ์†Œ์†ก ํŒจ์†Œโ€ฆ๋ฐฐ์ƒ๊ธˆ 8์ฒœ์–ต์›", -1],
470
+ [0, "ํ•œ๋น›์ „์ž ์ฃผ์š” ๊ณ ๊ฐ์‚ฌ, ๋‚ด๋…„ ์ฃผ๋ฌธ 30% ์ถ•์†Œ ํ†ต๋ณด", -1], [0, "ํ•œ๋น›์ „์ž, ์‚ฌ๋‚ด ๋งˆ๋ผํ†ค ๋Œ€ํšŒ ๊ฐœ์ตœ", 0], [0, "ํ•œ๋น›์ „์ž, AI ์„œ๋ฒ„์šฉ ๋ฉ”๋ชจ๋ฆฌ ๋…์  ๊ณต๊ธ‰ ๊ณ„์•ฝ ์ฒด๊ฒฐ", 1], [0, "ํ•œ๋น›์ „์ž ๋…ธ์กฐ, ๋‹ค์Œ ์ฃผ ์ „๋ฉด ํŒŒ์—… ์˜ˆ๊ณ ", -1],
471
+ [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค ์‹ ์•ฝ, ์ž„์ƒ 3์ƒ์—์„œ ํšจ๊ณผ ์ž…์ฆ ์‹คํŒจ", -1], [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค, ๋ฏธ๊ตญ FDA ์‹ ์•ฝ ํ’ˆ๋ชฉํ—ˆ๊ฐ€ ํš๋“", 1], [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค, ์ฐฝ๋ฆฝ 20์ฃผ๋…„ ๊ธฐ๋…ํ–‰์‚ฌ ๊ฐœ์ตœ", 0],
472
+ [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค ์ตœ๋Œ€์ฃผ์ฃผ, ๋ณด์œ  ์ง€๋ถ„ 30% ์žฅ๋‚ด ๋งค๋„", -1], [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค, ์œ ์ƒ์ฆ์ž๋กœ 2์ฒœ์–ต์› ์กฐ๋‹ฌโ€ฆ์ฃผ์‹ ์ˆ˜ 25% ๋Š˜์–ด", -1], [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค, ๊ธ€๋กœ๋ฒŒ ์ œ์•ฝ์‚ฌ์— 1์กฐ์› ๊ทœ๋ชจ ๊ธฐ์ˆ  ์ˆ˜์ถœ", 1],
473
+ [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค ์ฃผ๋ ฅ ์˜์•ฝํ’ˆ, ์‹์•ฝ์ฒ˜ ํŒ๋งค ์ค‘์ง€ ์ฒ˜๋ถ„", -1], [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค, ์‹ ๊ทœ ์‚ฌ์˜ฅ ๋””์ž์ธ ๊ณต๊ฐœ", 0], [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค, ํ•ญ์•”์ œ ์ž„์ƒ 2์ƒ ์ค‘๊ฐ„ ๊ฒฐ๊ณผ '์™„์ „ ๊ด€ํ•ด' ๋‹ค์ˆ˜ ํ™•์ธ", 1], [1, "๋ˆ„๋ฆฌ๋ฐ”์ด์˜ค ๊ฐ์‚ฌ์ธ, ์žฌ๋ฌด์ œํ‘œ ๊ฐ์‚ฌ์˜๊ฒฌ '์˜๊ฒฌ๊ฑฐ์ ˆ'", -1],
474
+ [2, "์ดˆ๋ก์‹ํ’ˆ, ์‹ ์ œํ’ˆ ๋ผ๋ฉด ์ถœ์‹œ ํ•œ ๋‹ฌ ๋งŒ์— 1์ฒœ๋งŒ ๊ฐœ ํŒ๋งค", 1], [2, "์ดˆ๋ก์‹ํ’ˆ ๋Œ€ํ‘œ์ด์‚ฌ, ํšŒ๊ณ„ ๋ถ€์ • ํ˜์˜๋กœ ๊ฒ€์ฐฐ ์กฐ์‚ฌ", -1], [2, "์ดˆ๋ก์‹ํ’ˆ, ์›์žฌ๋ฃŒ ๊ฐ€๊ฒฉ ๊ธ‰๋“ฑ์— 3๋ถ„๊ธฐ ์ ์ž ์ „ํ™˜", -1],
475
+ [2, "์ดˆ๋ก์‹ํ’ˆ, ๊ณต์‹ ์œ ํŠœ๋ธŒ ์ฑ„๋„ ๊ตฌ๋…์ž 10๋งŒ ๋ช… ๋ŒํŒŒ", 0], [2, "์ดˆ๋ก์‹ํ’ˆ, ๋ฏธ๊ตญ ๋Œ€ํ˜•๋งˆํŠธ 3์ฒœ ๊ฐœ ๋งค์žฅ ์ž…์  ํ™•์ •", 1], [2, "์ดˆ๋ก์‹ํ’ˆ ์ œํ’ˆ์—์„œ ์ด๋ฌผ์งˆโ€ฆ์ „๋Ÿ‰ ํšŒ์ˆ˜ ์กฐ์น˜", -1],
476
+ [2, "์ดˆ๋ก์‹ํ’ˆ, ์ฃผ๋‹น ๋ฐฐ๋‹น๊ธˆ ๋‘ ๋ฐฐ๋กœ ํ™•๋Œ€", 1], [2, "์ดˆ๋ก์‹ํ’ˆ, ๋ณธ์‚ฌ ๊ตฌ๋‚ด์‹๋‹น ๋ฉ”๋‰ด ๊ฐœํŽธ", 0], [2, "์ดˆ๋ก์‹ํ’ˆ ๊ฒฝ์Ÿ์‚ฌ, ๊ฐ€๊ฒฉ 20% ์ธ์ƒ ๋ฐœํ‘œ", 1], [2, "์ดˆ๋ก์‹ํ’ˆ, ๊ณต์ •์œ„ ๋‹ดํ•ฉ ๊ณผ์ง•๊ธˆ 500์–ต์› ๋ถ€๊ณผ", -1],
477
+ [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ, ๊ธ€๋กœ๋ฒŒ ์™„์„ฑ์ฐจ ์—…์ฒด์™€ 5์กฐ์› ๊ทœ๋ชจ ๋ฐฐํ„ฐ๋ฆฌ ๊ณต๊ธ‰ ๊ณ„์•ฝ", 1], [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ ์ „๊ธฐ์ฐจ 10๋งŒ ๋Œ€ ๋ฆฌ์ฝœโ€ฆ๋ฐฐํ„ฐ๋ฆฌ ๊ฒฐํ•จ", -1], [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ ์‹ ์ž„ CFO ์„ ์ž„", 0],
478
+ [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ, ์ •๋ถ€ ๋ณด์กฐ๊ธˆ ๋Œ€์ƒ์—์„œ ์ œ์™ธ๋ผ ํŒ๋งค ๊ฐ์†Œ ์šฐ๋ ค", -1], [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ, 3๋ถ„๊ธฐ ์ „๊ธฐ์ฐจ ํŒ๋งค๋Ÿ‰ ์‚ฌ์ƒ ์ตœ๋Œ€", 1], [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ ๊ณต์žฅ ์ฆ์„ค ๊ณ„ํš ๋ฐฑ์ง€ํ™”", -1],
479
+ [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ, ์ž์œจ์ฃผํ–‰ ๊ธฐ์ˆ  ๊ตญ๋‚ด ์ตœ์ดˆ ๋ ˆ๋ฒจ4 ์ธ์ฆ", 1], [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ, ํšŒ์‚ฌ ๋กœ๊ณ  ๋ฆฌ๋‰ด์–ผ", 0], [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ ์ตœ๋Œ€ ๊ณ ๊ฐ์‚ฌ ํŒŒ์‚ฐ ์‹ ์ฒญ", -1], [3, "๋‹ค์˜จ๋ชจ๋นŒ๋ฆฌํ‹ฐ, ์œ ๋Ÿฝ ์นœํ™˜๊ฒฝ์ฐจ ์„ธ์•ก๊ณต์ œ ๋Œ€์ƒ ์„ ์ •", 1],
480
+ ].map(([co, title, impact]) => ({ co, title, impact }));
481
+ async function judgeNews(company, title, decide) {
482
+ const r = await decide({ instruction: NEWS_INSTR, item: { "ํšŒ์‚ฌ": company, "๋‰ด์Šค ์ œ๋ชฉ": title }, choices: NEWS_CHOICES });
483
+ return { pick: r.choice.charCodeAt(0) - 65, conf: r.confidence, ms: r.ms, probs: [r.probs.A, r.probs.B, r.probs.C] };
484
+ }
485
+
486
+ const api = { DRIVE_INSTR, DRIVE, DRIVE_SAMPLES, drive, NEWS_INSTR, NEWS_CHOICES, COMPANIES, NEWS_BANK, judgeNews,
487
+ AXES, CASES, URGENCY, SAMPLES, classify, route, BOOL_INSTR, NLI_INSTR, QUESTIONS, CONTRACT, CLAIMS, splitClauses, askClause, checkClaim };
488
+ if (typeof module !== "undefined" && module.exports) module.exports = api; else root.Scenarios = api;
489
+ })(this);
490
+
491
+ </script>
492
+ <script>
493
+ /* โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ์ด๋ฆ„ โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ */
494
+ const NAME = "KJH-Judge-4B-ko", SHORT = "KJH-Judge";
495
+ // ๋งˆ์ง€๋ง‰ ์žฅ๋ฉด์˜ '์ง์ ‘ ํ•ด ๋ณด๊ธฐ' ๋ฌธ๊ตฌ (ํ—ˆ๊น…ํŽ˜์ด์Šค์šฉ ๋‹จ์ผ ํŒŒ์ผ์—์„œ๋Š” make_showreel.py ๊ฐ€ ์ฃผ์†Œ๋กœ ๋ฐ”๊ฟ” ๋„ฃ๋Š”๋‹ค)
496
+ const TRY = window.SHOW_TRY || "๋งˆ์Œ ์ฝ๊ธฐ ยท ํ•œ๊ตญ์–ด ๋Œ€๊ฒฐ ยท ์—์ด์ „ํŠธ ๋ผ์šฐํ„ฐ ยท ๋ฌธ์˜ ๋ถ„๋ฅ˜ํ•จ";
497
+
498
+ /* โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ๋ฐ์ดํ„ฐ (๋ชจ๋‘ ์ €์žฅ๋œ ์‹ค์ œ ํŒ์ • ๊ฒฐ๊ณผ) โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ */
499
+ const D = window.JEV_DATA, LIVE = window.JEV_LIVE_EXAMPLE, QZ = window.JEV_QUIZ, EX = window.JEV_EXAMPLES, SN = window.Scenarios;
500
+ const esc = s => String(s).replace(/[&<>"']/g, c => ({ "&": "&amp;", "<": "&lt;", ">": "&gt;", '"': "&quot;", "'": "&#39;" }[c]));
501
+ const pct = (x, d = 1) => (x * 100).toFixed(d) + "%";
502
+ const sec = ms => (ms / 1000).toFixed(2) + "์ดˆ";
503
+
504
+ const TURNS = []; { let u = null; for (const x of LIVE.state.log) { if (x.t === "user") u = x.text; else if (x.t === "decision" && x.d.step === 1) TURNS.push({ u, d: x.d }); } }
505
+ const prob = (d, name) => d.probs[d.choices.indexOf(name)] || 0;
506
+ const D1 = TURNS[0].d, ASKC = D1.choices.find(c => c.startsWith("ASK")), RESC = D1.choices.find(c => c.startsWith("RESPOND"));
507
+ const TOOL = { get_weather: ["cloud", "๋‚ ์”จ ์กฐํšŒ"], call_taxi: ["car", "ํƒ์‹œ ํ˜ธ์ถœ"], create_event: ["calendar", "์ผ์ • ๋“ฑ๋ก"], send_money: ["send", "์†ก๊ธˆ"], track_parcel: ["package", "ํƒ๋ฐฐ ์กฐํšŒ"] };
508
+
509
+ const qfind = f => QZ.pool.find(f);
510
+ const QWIC = qfind(q => q.item.word === "์ด์ƒ"), QCOPA = qfind(q => q.item.premise === "๋น„ํ–‰๊ธฐ๊ฐ€ ๋‚œ๊ธฐ๋ฅ˜๋ฅผ ๋งŒ๋‚ฌ๋‹ค."), QNEWS = qfind(q => (q.item.headline || "").startsWith("K๋ฆฌ๊ทธ"));
511
+
512
+ const INB = t => EX.inbox.find(x => x.text.includes(t));
513
+ const IN_HACK = INB("ํ•ดํ‚น"), IN_THANK = INB("๊น€์ง€์€"), IN_PAY = INB("์ผ์‹œ์  ์˜ค๋ฅ˜");
514
+ const GOLD_PAY = (SN.SAMPLES.find(s => s.text === IN_PAY.text) || { gold: [] }).gold;
515
+
516
+ const MS = [...EX.inbox.flatMap(x => Object.values(x.axes).map(a => a.ms)), ...EX.news.map(n => n.ms), ...EX.drive.map(d => d.ms)].sort((a, b) => a - b);
517
+ const MED = MS[MS.length >> 1];
518
+ // ๋‰ด์Šค: ํšŒ์‚ฌ๋ณ„๋กœ ๋ฌถ์—ฌ ์žˆ์œผ๋‹ˆ ๋ฒˆ๊ฐˆ์•„ ๋‚˜์˜ค๊ฒŒ (ํšŒ์‚ฌ ์•ˆ ์ˆœ๋ฒˆ โ†’ ํšŒ์‚ฌ ์ˆœ)
519
+ const NEWS = (() => { const seen = {}; return SN.NEWS_BANK.map((n, i) => ({ ...n, r: EX.news[i], k: seen[n.co] = (seen[n.co] || 0) + 1 })).sort((a, b) => a.k - b.k || a.co - b.co); })();
520
+
521
+ /* โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ์•„์ด์ฝ˜ ยท ๋งˆํฌ ยท ๊ธ€์ž ๋“ฑ์žฅ โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ */
522
+ const ICONS = {
523
+ car: '<path d="M19 17h2c.6 0 1-.4 1-1v-3c0-.9-.7-1.7-1.5-1.9C18.7 10.6 16 10 16 10s-1.3-1.4-2.2-2.3c-.5-.4-1.1-.7-1.8-.7H5c-.6 0-1.1.4-1.4.9l-1.4 2.9A3.7 3.7 0 0 0 2 12v4c0 .6.4 1 1 1h2"/><circle cx="7" cy="17" r="2"/><path d="M9 17h6"/><circle cx="17" cy="17" r="2"/>',
524
+ help: '<circle cx="12" cy="12" r="10"/><path d="M9.1 9a3 3 0 0 1 5.8 1c0 2-3 3-3 3"/><path d="M12 17h.01"/>',
525
+ chat: '<path d="M21 15a2 2 0 0 1-2 2H7l-4 4V5a2 2 0 0 1 2-2h14a2 2 0 0 1 2 2z"/>',
526
+ cloud: '<path d="M17.5 19H9a7 7 0 1 1 6.7-9h1.8a4.5 4.5 0 1 1 0 9Z"/>',
527
+ calendar: '<rect x="3" y="4" width="18" height="18" rx="2"/><path d="M16 2v4M8 2v4M3 10h18"/>',
528
+ send: '<path d="m22 2-7 20-4-9-9-4Z"/><path d="M22 2 11 13"/>',
529
+ package: '<path d="M21 16V8a2 2 0 0 0-1-1.7l-7-4a2 2 0 0 0-2 0l-7 4A2 2 0 0 0 3 8v8a2 2 0 0 0 1 1.7l7 4a2 2 0 0 0 2 0l7-4a2 2 0 0 0 1-1.7z"/><path d="M3.3 7 12 12l8.7-5M12 22V12"/>',
530
+ shield: '<path d="M12 22s8-4 8-10V5l-8-3-8 3v7c0 6 8 10 8 10z"/><path d="M12 8v4M12 16h.01"/>',
531
+ heart: '<path d="M19 14c1.5-1.5 3-3.2 3-5.5A5.5 5.5 0 0 0 16.5 3c-1.8 0-3 .5-4.5 2-1.5-1.5-2.7-2-4.5-2A5.5 5.5 0 0 0 2 8.5c0 2.3 1.5 4 3 5.5l7 7Z"/>',
532
+ pause: '<rect x="6" y="4" width="4" height="16" rx="1"/><rect x="14" y="4" width="4" height="16" rx="1"/>',
533
+ user: '<circle cx="12" cy="8" r="4"/><path d="M4 21v-1a6 6 0 0 1 6-6h4a6 6 0 0 1 6 6v1"/>',
534
+ check: '<path d="M20 6 9 17l-5-5"/>',
535
+ x: '<path d="M18 6 6 18M6 6l12 12"/>',
536
+ zap: '<path d="M13 2 3 14h9l-1 8 10-12h-9l1-8z"/>',
537
+ arrow: '<path d="M5 12h14M12 5l7 7-7 7"/>',
538
+ up: '<path d="m22 7-8.5 8.5-5-5L2 17"/><path d="M16 7h6v6"/>',
539
+ down: '<path d="m22 17-8.5-8.5-5 5L2 7"/><path d="M16 17h6v-6"/>',
540
+ minus: '<path d="M5 12h14"/>',
541
+ cpu: '<rect x="4" y="4" width="16" height="16" rx="2"/><rect x="9" y="9" width="6" height="6"/><path d="M15 2v2M15 20v2M2 15h2M2 9h2M20 15h2M20 9h2M9 2v2M9 20v2"/>',
542
+ clock: '<circle cx="12" cy="12" r="10"/><path d="M12 6v6l4 2"/>',
543
+ layers: '<path d="m12 2 10 5-10 5L2 7l10-5Z"/><path d="m2 17 10 5 10-5M2 12l10 5 10-5"/>',
544
+ target: '<circle cx="12" cy="12" r="10"/><circle cx="12" cy="12" r="6"/><circle cx="12" cy="12" r="2"/>',
545
+ play: '<path d="m6 3 14 9-14 9V3z"/>',
546
+ };
547
+ const I = n => `<svg class="ic" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round">${ICONS[n]}</svg>`;
548
+ // ๋งˆํฌ: ์—ฌ๋Ÿฌ ๋ณด๊ธฐ๊ฐ€ ํ•˜๋‚˜์˜ ํŒ๋‹จ์œผ๋กœ ๋ชจ์ธ๋‹ค
549
+ const MARK = cls => `<svg class="${cls}" viewBox="0 0 48 48" fill="none"><rect x="1" y="1" width="46" height="46" rx="14" fill="url(#gB)" fill-opacity=".13" stroke="url(#gB)" stroke-opacity=".55"/>
550
+ <path class="draw" pathLength="1" d="M13 14C22 14 24 24 34 24M13 24H34M13 34C22 34 24 24 34 24" stroke="url(#gB)" stroke-width="2.6" stroke-linecap="round"/>
551
+ <circle cx="13" cy="14" r="3" fill="#fff" fill-opacity=".55"/><circle cx="13" cy="24" r="3" fill="#fff" fill-opacity=".55"/><circle cx="13" cy="34" r="3" fill="#fff" fill-opacity=".55"/><circle class="dot" cx="35" cy="24" r="5.5" fill="url(#gB)"/></svg>`;
552
+ const CONN = d => `<svg class="conn" viewBox="0 0 96 30" data-in="${d}"><path class="draw" pathLength="1" d="M4 15H86"/><path class="draw" pathLength="1" d="M76 6 87 15 76 24"/></svg>`;
553
+ // ๋‹จ์–ด ๋‹จ์œ„ ๋“ฑ์žฅ. *๊ฐ•์กฐ* ๋Š” ๊ทธ๋ผ๋ฐ์ด์…˜
554
+ function H(s) { let on = false; // '*'๋ฅผ ๋งŒ๋‚  ๋•Œ๋งˆ๋‹ค ๊ฐ•์กฐ๋ฅผ ์ผœ๊ณ  ๋ˆ๋‹ค (์กฐ์‚ฌ๊ฐ€ ๋ถ™์–ด๋„ ๋จ: *ํ•˜๋‚˜*๋ฅผ)
555
+ return s.split(" ").map((tok, i) => { let h = "";
556
+ tok.split("*").forEach((p, k) => { if (k) on = !on; if (p) h += on ? `<span class="acc">${esc(p)}</span>` : esc(p); });
557
+ return `<span class="w"><span style="--d:${i}">${h}</span></span>`; }).join(" "); }
558
+ const K = (i, t) => `<div class="kicker" data-in="80"><b>${String(i + 1).padStart(2, "0")}</b><i></i>${t}</div>`;
559
+ const HL = (s, d = 250, cls = "") => `<h1 class="hl words ${cls}" data-in="${d}">${H(s)}</h1>`;
560
+ const TYPE = (s, d, sp = 85) => `<span data-type="${d}" data-sp="${sp}" data-full="${esc(s)}"><span class="tt"></span><i class="caret"></i></span>`;
561
+
562
+ /* โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ์žฅ๋ฉด โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ */
563
+ const CARD3 = () => [
564
+ { ic: "car", tt: "๋ฐ”๋กœ ํƒ์‹œ ํ˜ธ์ถœ", ds: "์ถœ๋ฐœ์ง€ยท๋„์ฐฉ์ง€๋Š” ์•Œ์•„์„œ?", k: "call", p: prob(D1, "CALL:call_taxi") },
565
+ { ic: "help", tt: "๋จผ์ € ๋˜๋ฌป๊ธฐ", ds: "โ€œ์–ด๋””์„œ ์–ด๋””๋กœ ๊ฐ€์„ธ์š”?โ€", k: "ask", p: prob(D1, ASKC) },
566
+ { ic: "chat", tt: "๋ง๋กœ๋งŒ ๋‹ตํ•˜๊ธฐ", ds: "โ€œํƒ์‹œ ์•ฑ์„ ์จ ๋ณด์„ธ์š”โ€", k: "respond", p: prob(D1, RESC) },
567
+ ];
568
+ const BRAND = ["#6d5dfc", "#2b9fff", "#20d3ad"];
569
+
570
+ const SCENES = [
571
+ { name: "์ƒํ™ฉ", dur: 7600, aura: BRAND, cls: "s-hook", cap: "AI๊ฐ€ ์ผ์„ ํ•˜๋ ค๋ฉด, ๋จผ์ € โ€˜๋ฌด์—‡์„ ํ• ์ง€โ€™ ๊ณจ๋ผ์•ผ ํ•ฉ๋‹ˆ๋‹ค.",
572
+ html: () => `<div class="who" data-in="150">์‚ฌ์šฉ์ž๊ฐ€ AI ๋น„์„œ์—๊ฒŒ</div>
573
+ <div class="bubble glass" data-in="350">โ€œ${TYPE(TURNS[0].u, 700)}โ€</div>
574
+ ${HL("AI๋Š” ๋จผ์ € *๋ฌด์—‡์„* ํ•ด์•ผ ํ• ๊นŒ์š”?", 2000)}
575
+ <div class="opts3">${CARD3().map((c, i) => `<div class="opt3 glass k-${c.k}" data-in="${3000 + i * 260}"><div class="itile">${I(c.ic)}</div><div class="tt">${c.tt}</div><div class="ds">${c.ds}</div></div>`).join("")}</div>` },
576
+
577
+ { name: "ํŒ๋‹จ", dur: 8800, aura: ["#ff9a3d", "#6d5dfc", "#2b9fff"], cls: "s-hook", cap: "์ถœ๋ฐœ์ง€๋„ ๋„์ฐฉ์ง€๋„ ๋ชจ๋ฅด๋‹ˆ, ๋ฉ‹๋Œ€๋กœ ๋ถ€๋ฅด์ง€ ์•Š๊ณ  ๋˜๋ฌป์Šต๋‹ˆ๋‹ค.",
578
+ html: () => { const cs = CARD3(), other = 1 - cs.reduce((s, c) => s + c.p, 0);
579
+ return `<div class="who">${SHORT}์˜ ํŒ๋‹จ</div>
580
+ <div class="bubble glass">โ€œ${esc(TURNS[0].u)}โ€</div>
581
+ ${HL(`๋ณด๊ธฐ ${D1.choices.length}๊ฐœ ์ค‘ *ํ•˜๋‚˜*๋ฅผ ๊ณ ๋ฆ…๋‹ˆ๋‹ค`, 150)}
582
+ <div class="stats"><span class="chipk" data-in="3500">${I("zap")} ํŒ๋‹จ <b>${sec(D1.ms)}</b></span><span class="chipk" data-in="3700">๋‚˜๋จธ์ง€ ๋„๊ตฌ ${D1.choices.length - 3}๊ฐœ ํ•ฉ <b>${pct(other)}</b></span></div>
583
+ <div class="opts3" id="o3">${cs.map((c, i) => `<div class="opt3 glass k-${c.k}" data-c="${i}"><span class="vd">DECISION</span><div class="itile">${I(c.ic)}</div><div class="tt">${c.tt}</div><div class="ds">${c.ds}</div>
584
+ <div class="meter"><div class="bar"><i data-w="${c.p}"></i></div><div class="pct" data-n="${c.p}">0.0%</div></div></div>`).join("")}</div>`; },
585
+ play(x) { x.at(700, () => x.$("#o3").classList.add("scan")); x.at(1800, () => x.$("#o3").classList.remove("scan"));
586
+ x.bars(1800, 1300); x.counts(1800, 1300, v => pct(v));
587
+ const cs = CARD3(), w = cs.reduce((b, c, i) => c.p > cs[b].p ? i : b, 0);
588
+ x.at(3200, () => x.$$("[data-c]").forEach((el, i) => el.classList.add(i === w ? "win" : "lose"))); } },
589
+
590
+ { name: "๋Œ€ํ™”", dur: 10800, aura: ["#3f7dff", "#20d3ad", "#6d5dfc"], cap: "ํ•„์š”ํ•œ ๋„๊ตฌ๋ฅผ ๊ณ ๋ฅด๊ณ , ์—†๋Š” ๊ธฐ๋Šฅ์€ ์ง€์–ด๋‚ด์ง€ ์•Š์Šต๋‹ˆ๋‹ค.",
591
+ html: i => `${K(i, "๋Œ€ํ™”๊ฐ€ ์ด์–ด์ง€๋ฉด")}${HL("ํ•  ์ผ์ด๋ฉด ํ•˜๊ณ , *๋ชป ํ•˜๋ฉด ๋ชป ํ•œ๋‹ค๊ณ *")}
592
+ <div class="turns">${TURNS.slice(1, 4).map((t, j) => { const d = t.d, b = 900 + j * 2900;
593
+ const [ic, lb, k] = d.kind === "CALL" ? [...TOOL[d.tool], "call"] : d.kind === "ASK" ? ["help", "๋˜๋ฌป๊ธฐ", "ask"] : ["chat", "ํ•  ์ˆ˜ ์—†๋‹ค๊ณ  ์•ˆ๋‚ด", "respond"];
594
+ const note = d.kind === "RESPOND" ? `<div class="nt">์—ฐ๊ฒฐ๋œ ๋„๊ตฌ: ${LIVE.state.enabled.map(n => TOOL[n][1]).join(" ยท ")} โ€” ์ฃผ์‹ ๋งค๋งค ๋„๊ตฌ๋Š” ์—†์Œ</div>` : "";
595
+ return `<div class="turn"><div class="ub glass" data-in="${b}">โ€œ${esc(t.u)}โ€</div>${CONN(b + 500)}
596
+ <div class="dec glass k-${k}" data-in="${b + 900}"><div class="itile">${I(ic)}</div><div class="lb"><small>${d.kind}</small>${lb}</div><span class="pct" data-n="${d.conf}" data-t="${b + 1100}">0%</span>
597
+ <div class="bar"><i data-w="${d.conf}" data-t="${b + 1100}"></i></div>${note}</div></div>`; }).join("")}</div>`,
598
+ play(x) { x.bars(null, 1000); x.counts(null, 1000, v => pct(v)); } },
599
+
600
+ { name: "์†Œ๊ฐœ", dur: 8200, aura: BRAND, cap: "๊ธด ๊ธ€์„ ์“ฐ๋Š” ๋Œ€์‹ , ์ฃผ์–ด์ง„ ๋ณด๊ธฐ ์ค‘ ํ•˜๋‚˜๋ฅผ ๋น ๋ฅด๊ณ  ์ •ํ™•ํ•˜๊ฒŒ ๊ณ ๋ฆ…๋‹ˆ๋‹ค.",
601
+ html: () => `<div class="center">
602
+ <div data-in="200">${MARK("markbig")}</div>
603
+ <div class="wm" data-in="900"><span class="a">KJH-Judge</span><span class="b">-4B-ko</span></div>
604
+ <div class="tag words" data-in="1700">${H("ํ•œ๊ตญ์–ด๋กœ *ํŒ๋‹จ*๋งŒ ํ•˜๋Š” ์ž‘์€ ๋ชจ๋ธ")}</div>
605
+ <div class="facts">
606
+ <div class="fact glass k-call" data-in="2600"><div class="itile">${I("cpu")}</div><b>4B</b><span>40์–ต ํŒŒ๋ผ๋ฏธํ„ฐ ยท Qwen3-4B ๊ธฐ๋ฐ˜</span></div>
607
+ <div class="fact glass k-respond" data-in="2850"><div class="itile">${I("clock")}</div><b>${D.train.gpu_hours.toFixed(1)}์‹œ๊ฐ„</b><span>GPU ํ•™์Šต ยท ${D.train.steps.toLocaleString()}์Šคํ…</span></div>
608
+ <div class="fact glass k-hi" data-in="3100"><div class="itile">${I("target")}</div><b>2~26๊ฐœ</b><span>๋ณด๊ธฐ ์ค‘ ํ•˜๋‚˜ + ํ™•๋ฅ </span></div>
609
+ </div></div>` },
610
+
611
+ { name: "ํ•™์Šต ์ „ํ›„", dur: 11200, aura: ["#ff6b5e", "#3f7dff", "#6d5dfc"], cap: "ํ•™์Šต ์ „์—” ๊ฑฐ์˜ โ€˜Aโ€™๋งŒ ์ฐ๋˜ ๋ชจ๋ธ์ด, ์—ด ๋ฌธ์ œ ์ค‘ ์•„ํ™‰์„ ๋งžํž™๋‹ˆ๋‹ค.",
612
+ html: i => { const N = 60, aShare = D.base_pred_letters.A / D.base_pooled.n, tot = D.pooled.n, L = Object.entries(D.pred_letters).sort((a, b) => b[1] - a[1]);
613
+ let cells = []; L.forEach(([l, c]) => { for (let k = 0; k < Math.round(c / tot * N); k++) cells.push(l); }); cells = cells.slice(0, N); while (cells.length < N) cells.push(L[0][0]);
614
+ cells = cells.map((c, j) => [c, (j * 37) % N]).sort((a, b) => a[1] - b[1]).map(c => c[0]);
615
+ return `${K(i, `๊ฐ™์€ ํ•œ๊ตญ์–ด ๋ฌธ์ œ ${D.pooled.n.toLocaleString()}๊ฐœ ยท 22๊ฐœ ๊ณผ๋ชฉ`)}${HL("โ€˜Aโ€™๋งŒ ์ฐ๋˜ ๋ชจ๋ธ์ด, *์—ด์— ์•„ํ™‰*์„ ๋งžํžˆ๊ธฐ๊นŒ์ง€")}
616
+ <div class="vs">
617
+ <div class="side glass before" data-in="500"><span class="lab">ํ•™์Šต ์ „ ยท Qwen3-4B ๊ทธ๋Œ€๋กœ</span>
618
+ <div class="tiles" data-tiles="1000">${Array.from({ length: N }, (_, j) => `<span style="--i:${j}">A</span>`).join("")}</div>
619
+ <div class="note">๋‹ต์˜ <b>${pct(aShare)}</b>๊ฐ€ ๊ทธ๋ƒฅ โ€˜Aโ€™</div>
620
+ <div class="bign" data-n="${D.base_pooled.acc}" data-t="2000" data-d="900">0%</div><div class="sub">์ •๋‹ต๋ฅ  ยท ๋ฌด์ž‘์œ„๋กœ ์ฐ๊ธฐ(${pct(D.pooled.chance)})์™€ ๊ฐ™์€ ์ˆ˜์ค€</div></div>
621
+ <div class="mid" data-in="3300"><div class="ring">${I("arrow")}</div>๋ฏธ์„ธ์กฐ์ •<br>${D.train.steps.toLocaleString()}์Šคํ…</div>
622
+ <div class="side glass after" data-in="3700"><span class="lab">ํ•™์Šต ํ›„ ยท ${NAME}</span>
623
+ <div class="tiles" data-tiles="4200">${cells.map((c, j) => `<span style="--i:${j};--h:${255 - (c.charCodeAt(0) - 65) * 11}">${c}</span>`).join("")}</div>
624
+ <div class="note">๋ฌธ์ œ๋งˆ๋‹ค ๋‚ด์šฉ์„ ์ฝ๊ณ  <b>A~K</b>๋ฅผ ๊ณ ๋ฃจ ๊ณ ๋ฆ„</div>
625
+ <div class="bign" data-n="${D.pooled.acc}" data-t="5300" data-d="1900">0%</div><div class="sub">์ •๋‹ต๋ฅ  ยท ์—ด ๋ฌธ์ œ ์ค‘ ์•„ํ™‰</div></div>
626
+ </div>`; },
627
+ play(x) { x.$$("[data-tiles]").forEach(el => x.at(+el.dataset.tiles, () => el.classList.add("on"))); x.counts(null, null, v => pct(v)); } },
628
+
629
+ { name: "ํ•œ๊ตญ์–ด", dur: 15200, aura: ["#ffd36b", "#20d3ad", "#3f7dff"], cap: "๋™์Œ์ด์˜์–ด, ์›์ธ๊ณผ ๊ฒฐ๊ณผ, ๋‰ด์Šค ๋ถ„์•ผ๊นŒ์ง€ โ€” ๋งฅ๋ฝ์„ ์ฝ๊ณ  ํŒ๋‹จํ•ฉ๋‹ˆ๋‹ค.",
630
+ html: i => { const hl = s => esc(s).replace(/\[(.+?)\]/g, "<mark>$1</mark>");
631
+ const opts = (q, b, top) => { let idx = q.choices.map((_, j) => j); if (top) idx = idx.sort((a, c) => q.jev.probs[c] - q.jev.probs[a]).slice(0, top);
632
+ let h = idx.map(j => `<div class="op" data-op="${j === q.jev.pick ? "pick" : "rest"}" data-r="${b + 2700}"><span class="t">${esc(q.choices[j])}</span><span class="pct" data-n="${q.jev.probs[j]}" data-t="${b + 1300}">0%</span><div class="bar"><i data-w="${q.jev.probs[j]}" data-t="${b + 1300}" style="--c:${j === q.jev.pick ? "var(--good)" : "#59637a"}"></i></div></div>`).join("");
633
+ if (top && q.choices.length > top) { const rest = 1 - idx.reduce((s, j) => s + q.jev.probs[j], 0); h += `<div class="op" data-op="rest" data-r="${b + 2700}"><span class="t" style="color:var(--muted)">๊ทธ ์™ธ ${q.choices.length - top}๊ฐœ ๋ถ„์•ผ</span><span class="pct" style="color:var(--muted)" data-n="${rest}" data-t="${b + 1300}">0%</span></div>`; }
634
+ return h; };
635
+ const foot = (q, b) => `<div class="foot" data-in="${b + 2800}">${q.jev.pick === q.gold ? `<span class="badge k-good">${I("check")} ์ •๋‹ต</span>` : `<span class="badge k-bad">${I("x")} ์˜ค๋‹ต</span>`}<span>${I("zap")} ${sec(q.jev.ms)}</span></div>`;
636
+ const B = [700, 5300, 9900];
637
+ return `${K(i, "ํ•œ๊ตญ์–ด, ์–ผ๋งˆ๋‚˜ ์•Œ์•„๋“ค์„๊นŒ? ยท ๋ฌธ์ œ ์ถœ์ฒ˜ KoBESTยทKLUE (CC BY-SA 4.0)")}${HL("์‚ฌ๋žŒ๋„ *์ž ๊น ๋ฉˆ์นซํ•˜๋Š”* ๋ฌธ์ œ๋“ค")}
638
+ <div class="qs">
639
+ <div class="qc glass" data-in="${B[0]}"><span class="qtag">๊ฐ™์€ ๋‹จ์–ด, ๊ฐ™์€ ๋œป์ผ๊นŒ?</span><div class="qb"><p>โ‘  ${hl(QWIC.item.context_1)}</p><p>โ‘ก ${hl(QWIC.item.context_2)}</p></div>${opts(QWIC, B[0])}${foot(QWIC, B[0])}</div>
640
+ <div class="qc glass" data-in="${B[1]}"><span class="qtag">๊ทธ ${esc(QCOPA.item.relation_to_select)}๋Š”?</span><div class="qb"><p>${esc(QCOPA.item.premise)}</p><small>๋” ๊ทธ๋Ÿด๋“ฏํ•œ ${esc(QCOPA.item.relation_to_select)}๋ฅผ ๊ณ ๋ฅด์„ธ์š”</small></div>${opts(QCOPA, B[1])}${foot(QCOPA, B[1])}</div>
641
+ <div class="qc glass" data-in="${B[2]}"><span class="qtag">์–ด๋А ๋ถ„์•ผ ๋‰ด์Šค์ผ๊นŒ?</span><div class="qb"><p>โ€œ${esc(QNEWS.item.headline)}โ€</p><small>๋ณด๊ธฐ ${QNEWS.choices.length}๊ฐœ ยท ${QNEWS.choices.map(esc).join(" ยท ")}</small></div>${opts(QNEWS, B[2], 2)}${foot(QNEWS, B[2])}</div>
642
+ </div>`; },
643
+ play(x) { x.bars(null, 1000); x.counts(null, 1000, v => pct(v)); x.$$("[data-op=rest]").forEach(el => x.at(+el.dataset.r, () => el.classList.add("dim"))); } },
644
+
645
+ { name: "๊ณ ๊ฐ์„ผํ„ฐ", dur: 12200, aura: ["#ff6b5e", "#20d3ad", "#6d5dfc"], cap: "AI๋Š” ์‚ฌ์•ˆ๊ณผ ๊ฐ์ •์„ ๊ณ ๋ฅด๊ณ , ๋‹ด๋‹น ๋ถ€์„œ์™€ ๊ธด๊ธ‰๋„๋Š” ๊ณต๊ฐœ๋œ ๊ทœ์น™ํ‘œ๊ฐ€ ์ •ํ•ฉ๋‹ˆ๋‹ค.",
646
+ html: i => { const MOOD = SN.AXES.find(a => a.key === "mood").choices, UK = ["bad", "ask", "good"];
647
+ const row = (it, b, ic) => { const c = SN.CASES[it.axes.case.pick], m = it.axes.mood;
648
+ return `<div class="row"><div class="msg glass" data-in="${b}"><div class="h"><i></i>๊ณ ๊ฐ ๋ฌธ์˜</div><div class="t">โ€œ${esc(it.text)}โ€</div></div>
649
+ <div class="chips"><div class="chip glass" data-in="${b + 1100}"><span class="k">์‚ฌ์•ˆ</span><span class="v">${esc(c.label)}</span><span class="pct" data-n="${it.axes.case.conf}" data-t="${b + 1200}">0%</span></div>
650
+ <div class="chip glass" data-in="${b + 1500}"><span class="k">๊ฐ์ •</span><span class="v">${esc(MOOD[m.pick])}</span><span class="pct" data-n="${m.conf}" data-t="${b + 1600}">0%</span></div></div>
651
+ ${CONN(b + 2200)}
652
+ <div class="route glass k-${UK[c.urgency]}" data-in="${b + 2700}"><div class="itile">${I(ic)}</div><div class="d">${esc(c.dept)}ํŒ€</div><div class="u">${SN.URGENCY[c.urgency]}</div><div class="s">๊ทœ์น™ํ‘œ๋กœ ๊ฒฐ์ •</div></div></div>`; };
653
+ return `${K(i, "๊ณ ๊ฐ์„ผํ„ฐ๋ผ๋ฉด")}${HL("๋ฌธ์˜๋ฅผ ์ฝ๊ณ , ๋‚˜๋ˆ„๊ณ , *๋ฐ”๋กœ ๋ณด๋ƒ…๋‹ˆ๋‹ค*")}
654
+ <div class="rows">${row(IN_HACK, 800, "shield")}${row(IN_THANK, 5600, "heart")}</div>`; },
655
+ play(x) { x.counts(null, 800, v => pct(v, 0)); } },
656
+
657
+ { name: "ํ™•์‹ ", dur: 13200, aura: ["#ffb44d", "#ff6b5e", "#6d5dfc"], cls: "s-unsure", cap: "ํ™•์‹  ์ˆซ์ž๋ฅผ ๋ฏฟ์„ ์ˆ˜ ์žˆ์œผ๋‹ˆ, ๋‚ฎ์„ ๋•Œ๋งŒ ์‚ฌ๋žŒ์ด ๋ณด๋ฉด ๋ฉ๋‹ˆ๋‹ค.",
658
+ html: i => { const pr = IN_PAY.axes.case.probs, top = pr.map((p, j) => [p, j]).sort((a, b) => b[0] - a[0]).slice(0, 3), conf = IN_PAY.axes.case.conf, TH = 0.7;
659
+ const gold = GOLD_PAY.length ? SN.CASES[GOLD_PAY[0]].label : null, right = GOLD_PAY.includes(IN_PAY.axes.case.pick);
660
+ // ๋ฐ˜์› ๊ฒŒ์ด์ง€: ์ค‘์‹ฌ (220,230), ๋ฐ˜์ง€๋ฆ„ 190
661
+ const cx = 220, cy = 230, R = 190, ang = p => Math.PI * (1 - p), pt = (p, r) => [cx + r * Math.cos(ang(p)), cy - r * Math.sin(ang(p))];
662
+ const [t1x, t1y] = pt(TH, R - 26), [t2x, t2y] = pt(TH, R + 26), [lx, ly] = pt(TH, R + 52);
663
+ const arc = `M${cx - R} ${cy} A${R} ${R} 0 0 1 ${cx + R} ${cy}`;
664
+ return `${K(i, `${SHORT}๋„ ํ—ท๊ฐˆ๋ฆด ๋•Œ`)}${HL("๋ชจ๋ฅด๋ฉด, *๋ชจ๋ฅธ๋‹ค๊ณ * ๋งํ•ฉ๋‹ˆ๋‹ค")}
665
+ <div class="unsure">
666
+ <div class="ucol"><div class="msg glass" data-in="500"><div class="h"><i></i>๊ณ ๊ฐ ๋ฌธ์˜</div><div class="t">โ€œ${esc(IN_PAY.text)}โ€</div></div>
667
+ <div class="cands glass" data-in="1100">${top.map(([p, j], k) => `<div class="op"><span class="t">${esc(SN.CASES[j].label)}</span><span class="pct" data-n="${p}" data-t="1300">0%</span><div class="bar"><i data-w="${p}" data-t="1300" style="--c:${k === 0 ? "var(--ask)" : "#59637a"}"></i></div></div>`).join("")}</div>
668
+ <div class="calib glass" data-in="7600"><div><div class="n" data-n="${D.pooled.mean_conf}" data-t="7800">0%</div><div class="l">๋ชจ๋ธ์ด ๋งํ•œ ํ‰๊ท  ํ™•์‹ </div></div><div class="eq">โ‰ˆ</div>
669
+ <div><div class="n" data-n="${D.pooled.acc}" data-t="7800">0%</div><div class="l">์‹ค์ œ ์ •๋‹ต๋ฅ  ยท ${D.pooled.n.toLocaleString()}๋ฌธํ•ญ</div></div>
670
+ <div class="say">ํ™•์‹  ์ˆซ์ž๊ฐ€ ์‹ค์ œ์™€ ๊ฑฐ์˜ ๊ฐ™์•„<br>๊ธฐ์ค€์„ ์„ ๊ฑธ์–ด ๋‘๊ณ  ์“ธ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค</div></div></div>
671
+ <div class="gauge glass" data-in="2200"><div class="lab2">1์ˆœ์œ„ ํŒ๋‹จ์˜ ํ™•์‹ </div>
672
+ <div class="gwrap"><svg viewBox="0 0 440 250"><path d="${arc}" stroke="rgba(255,255,255,.08)" stroke-width="30" fill="none" stroke-linecap="round"/>
673
+ <path id="arcv" d="${arc}" pathLength="100" stroke="url(#gA)" stroke-width="30" fill="none" stroke-linecap="round" stroke-dasharray="100" stroke-dashoffset="100" style="filter:drop-shadow(0 0 14px rgba(255,170,70,.55))"/>
674
+ <line x1="${t1x}" y1="${t1y}" x2="${t2x}" y2="${t2y}" stroke="#fff" stroke-width="3.5" stroke-linecap="round"/>
675
+ <text class="gth" x="${lx}" y="${ly}" text-anchor="middle">์ž๋™ ์ฒ˜๋ฆฌ ๊ธฐ์ค€ ${pct(TH, 0)}</text></svg>
676
+ <div class="gnum" data-n="${conf}" data-t="2500" data-d="1200">0%</div></div>
677
+ <div class="hold" data-in="4100">${I("pause")} ์ž๋™ ์ฒ˜๋ฆฌ ๋ณด๋ฅ˜ ${I("arrow")} ${I("user")} ์‚ฌ๋žŒ ์ƒ๋‹ด์‚ฌ</div>
678
+ ${gold ? `<div class="truth" data-in="5600">${right ? "์ด๋ฒˆ 1์ˆœ์œ„๋Š” ๋งž์•˜์ง€๋งŒ, ์Šค์Šค๋กœ ํ™•์‹ ์ด ๋‚ฎ๋‹ค๊ณ  ์•Œ๋ ธ์Šต๋‹ˆ๋‹ค." : `์‹ค์ œ ์ •๋‹ต์€ <b>โ€˜${esc(gold)}โ€™</b>.<br>1์ˆœ์œ„๋Š” ํ‹€๋ ธ๊ณ , <b>๊ทธ๋ž˜์„œ ๋„˜๊ธด ๊ฒŒ ๋งž์•˜์Šต๋‹ˆ๋‹ค.</b>`}</div>` : ""}</div>
679
+ </div>`; },
680
+ play(x) { x.bars(null, 1000); x.counts(null, 1000, v => pct(v)); const a = x.$("#arcv"), c = IN_PAY.axes.case.conf; x.tween(2500, 1200, p => a.setAttribute("stroke-dashoffset", 100 - c * 100 * p)); } },
681
+
682
+ { name: "์ˆœ์œ„", dur: 12200, aura: ["#ffd36b", "#6d5dfc", "#2b9fff"], cap: "๊ณต๊ฐœ ๋ฒค์น˜๋งˆํฌ ํ‘œ์˜ 4B ๋ชจ๋ธ ์ค‘ ๊ฐ€์žฅ ๋†’๊ณ , 27B๊ธ‰ ๋ชจ๋ธ๊ณผ ๋‚˜๋ž€ํžˆ ์„ญ๋‹ˆ๋‹ค.",
683
+ html: i => { const rows = [["Gemma 4 31B", "31B", 94.40], ["Decision 2.0 Vega 27B", "27B", 92.38], ["Gemma 4 26B-A4B", "26B", 90.37], ["Gemma 4 12B", "12B", 89.58], ["Cygnet ยท Gemma 12B", "12B", 89.18],
684
+ ["Qwen3.8 27B", "27B", 89.02], ["JEV 1.13 ยท hosted API", "API", 88.93], ["K-Decision 4B", "4B", 85.41], ["Mica v0.1 4B", "4B", 81.47], ["Qwen3.5 4B", "4B", 78.77]];
685
+ rows.push([`${NAME} (์ด ๋ชจ๋ธ)`, "4B", D.pooled.acc * 100, true]); rows.sort((a, b) => b[2] - a[2] || (a[3] ? 1 : 0) - (b[3] ? 1 : 0)); // ๋™์ ์ด๋ฉด ์ด ๋ชจ๋ธ์„ ์•„๋ž˜์—
686
+ return `${K(i, `๊ณต๊ฐœ ํ•œ๊ตญ์–ด ํŒ๋‹จ ๋ฒค์น˜๋งˆํฌ ยท ${D.pooled.n.toLocaleString()}๋ฌธํ•ญ`)}${HL("๋ฉ์น˜ *7๋ฐฐ* ๋ชจ๋ธ๋“ค๊ณผ ๊ฐ™์€ ์ค„์—")}
687
+ <div class="board">${rows.map((r, j) => `<div class="lr ${r[3] ? "me" : ""} ${r[1] === "4B" ? "small" : ""}" data-in="${600 + j * 110}"><span class="rk">${String(j + 1).padStart(2, "0")}</span><span class="nm">${esc(r[0])}</span><span class="sz">${r[1]}</span>
688
+ <div class="bar"><i data-w="${(r[2] - 70) / 30}" data-t="${1000 + j * 110}"></i></div><span class="pct" data-n="${r[2] / 100}" data-t="${1000 + j * 110}">0%</span></div>`).join("")}</div>
689
+ <div class="fine" data-in="2800">์ถœ์ฒ˜: Korean JEV Benchmark ๊ณต๊ฐœ ํ‘œ(2026-10-09)์˜ ํ•œ๊ตญ์–ด ์ •ํ™•๋„, ๋ง‰๋Œ€๋Š” 70~100% ๊ตฌ๊ฐ„. ๋‹ค๋ฅธ ๋ชจ๋ธ์€ ์ถ”๊ฐ€ ํ•™์Šต ์—†๋Š” ์ œ๋กœ์ƒท์ด๊ณ , ${NAME}์€ ๊ฐ™์€ ์ถœ์ฒ˜ ๋ฐ์ดํ„ฐ์˜ ํ•™์Šต ๋ถ„ํ• ๋กœ ๋ฏธ์„ธ์กฐ์ •ํ–ˆ์Šต๋‹ˆ๋‹ค โ€” ๊ฐ™์€ ์กฐ๊ฑด์˜ ๋น„๊ต๊ฐ€ ์•„๋‹ˆ๋ฉฐ, ์˜์–ด ์„ฑ๋Šฅ์€ ์ธก์ •ํ•˜์ง€ ์•Š์•˜์Šต๋‹ˆ๋‹ค.</div>`; },
690
+ play(x) { x.bars(null, 1300); x.counts(null, 1300, v => (v * 100).toFixed(2) + "%"); } },
691
+
692
+ { name: "์†๋„", dur: 11200, aura: ["#20d3ad", "#2b9fff", "#6d5dfc"], cap: "๋‰ด์Šค ์ œ๋ชฉ์ด ๋œจ์ž๋งˆ์ž, ํ˜ธ์žฌ์ธ์ง€ ์•…์žฌ์ธ์ง€ ํŒ๋‹จํ•ฉ๋‹ˆ๋‹ค.",
693
+ html: i => `${K(i, "์†๋„")}${HL(`ํŒ๋‹จ ํ•œ ๋ฒˆ, *${(MED / 1000).toFixed(2)}์ดˆ*`)}
694
+ <div class="speed"><div class="ticker glass" id="tick" data-in="400"></div>
695
+ <div class="spr"><div class="spbox glass" data-in="700"><div class="big"><span data-n="${MED}" data-t="900" data-d="1000">0</span><small>ms</small></div><div class="l">ํŒ๋‹จ 1๋ฒˆ ๊ณ„์‚ฐ ์‹œ๊ฐ„ (๋„คํŠธ์›Œํฌ ์™•๋ณต ์ œ์™ธ)<br>GPU 1์žฅ ยท ์ €์žฅ๋œ ์˜ˆ์‹œ ํŒ์ • ${MS.length}๊ฑด์˜ ์ค‘์•™๊ฐ’</div></div>
696
+ <div class="cnt glass" data-in="1100"><div><b id="tkn">0</b><span>๊ฐ€์ƒ ํšŒ์‚ฌ ๋‰ด์Šค<br>ํŒ์ • ๊ฑด์ˆ˜</span></div><div class="g"><b id="tkh">0</b><span>๋ฏธ๋ฆฌ ์ •ํ•ด ๋‘”<br>๋‹ต๊ณผ ์ผ์น˜</span></div></div></div></div>`,
697
+ play(x) { const box = x.$("#tick"), LAB = [["ํ˜ธ์žฌ", "up", "up"], ["์•…์žฌ", "dn", "down"], ["์˜ํ–ฅ ์ ์Œ", "nn", "minus"]]; let hit = 0;
698
+ x.counts(null, null, v => Math.round(v));
699
+ NEWS.forEach((n, j) => x.at(1000 + j * 210, () => { const ok = [1, -1, 0][n.r.pick] === n.impact; if (ok) hit++; const L = LAB[n.r.pick];
700
+ const el = document.createElement("div"); el.className = "tk " + L[1];
701
+ el.innerHTML = `<span class="tr">${I(L[2])}</span><span class="ti">${esc(n.title)}</span><span class="tg">${L[0]}</span><span class="ck" style="color:var(--${ok ? "good" : "bad"})">${I(ok ? "check" : "x")}</span>`;
702
+ box.prepend(el); while (box.children.length > 10) box.lastChild.remove();
703
+ x.$("#tkn").textContent = j + 1; x.$("#tkh").textContent = hit; })); } },
704
+
705
+ { name: "๋งˆ๋ฌด๋ฆฌ", dur: 9500, aura: BRAND, cap: "",
706
+ html: () => `<div class="center">
707
+ <div data-in="200">${MARK("markbig")}</div>
708
+ <div class="wm" data-in="900"><span class="a">KJH-Judge</span><span class="b">-4B-ko</span></div>
709
+ <div class="tag words" data-in="1700">${H("๊ณ ๋ฅด๋Š” ์ผ์€, *KJH-Judge*์—๊ฒŒ.")}</div>
710
+ <div class="facts">
711
+ <div class="fact glass k-call" data-in="2600"><div class="itile">${I("target")}</div><b>${pct(D.pooled.acc)}</b><span>ํ•œ๊ตญ์–ด ํŒ๋‹จ ์ •ํ™•๋„ ยท ${D.pooled.n.toLocaleString()}๋ฌธํ•ญ</span></div>
712
+ <div class="fact glass k-respond" data-in="2850"><div class="itile">${I("zap")}</div><b>${(MED / 1000).toFixed(2)}์ดˆ</b><span>ํŒ๋‹จ 1๋ฒˆ ๊ณ„์‚ฐ ยท GPU 1์žฅ</span></div>
713
+ <div class="fact glass k-hi" data-in="3100"><div class="itile">${I("cpu")}</div><b>4B</b><span>์ž‘์•„์„œ ๋‚ด ์„œ๋ฒ„์—์„œ ์ง์ ‘ ์šด์˜</span></div>
714
+ </div>
715
+ <div class="try" data-in="3900">${I("play")} ์ง์ ‘ ํ•ด ๋ณด๊ธฐ ยท <b>${esc(TRY)}</b></div></div>` },
716
+ ];
717
+
718
+ /* โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ ์žฌ์ƒ ์—”์ง„ (์ž์ฒด ์‹œ๊ณ„: ์ผ์‹œ์ •์ง€ยท์žฅ๋ฉด ์ด๋™์ด ์ •ํ™•) โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€ */
719
+ const $ = s => document.querySelector(s), stage = $("#stage");
720
+ const P = new URLSearchParams(location.search);
721
+ const LOOP = P.get("loop") === "1", HOLD = P.get("hold") === "1";
722
+ if (P.get("cap") === "0") document.body.classList.add("nocap");
723
+ if (P.get("clean") === "1") document.body.classList.add("clean");
724
+ let cur = 0, t = 0, paused = false, cues = [], tweens = [], sceneEl = null, camEl = null, last = performance.now();
725
+ const easeOut = p => 1 - Math.pow(1 - p, 3), lin = p => p;
726
+
727
+ $("#brand").innerHTML = MARK("on") + `<b>${SHORT}</b><span class="pl">4B ยท ko</span>`;
728
+ $("#chapall").textContent = String(SCENES.length).padStart(2, "0");
729
+ $("#segs").innerHTML = SCENES.map(() => "<span><i></i></span>").join("");
730
+
731
+ function makeCtx(root) {
732
+ const x = {
733
+ $: s => root.querySelector(s), $$: s => [...root.querySelectorAll(s)],
734
+ at(ms, fn) { cues.push({ ms, fn, done: false }); },
735
+ tween(ms, dur, fn, ease = easeOut) { tweens.push({ ms, dur, fn, ease, done: false }); },
736
+ bars(start, dur) { x.$$("[data-w]").forEach(el => { const s = el.dataset.t ? +el.dataset.t : start, d = el.dataset.d ? +el.dataset.d : dur, w = Math.max(0, Math.min(1, +el.dataset.w));
737
+ x.tween(s, d, p => el.style.width = w * p * 100 + "%"); }); },
738
+ counts(start, dur, fmt) { x.$$("[data-n]").forEach(el => { const s = el.dataset.t ? +el.dataset.t : start, d = el.dataset.d ? +el.dataset.d : dur, n = +el.dataset.n;
739
+ x.tween(s, d, p => el.textContent = fmt(n * p)); }); },
740
+ };
741
+ return x;
742
+ }
743
+ function go(i) {
744
+ cur = (i + SCENES.length) % SCENES.length; t = 0; cues = []; tweens = [];
745
+ if (sceneEl) { const old = sceneEl; old.classList.add("leaving"); setTimeout(() => old.remove(), 560); }
746
+ const sc = SCENES[cur], el = document.createElement("div"); el.className = "scene";
747
+ el.innerHTML = `<div class="cam ${sc.cls || ""}">${sc.html(cur)}</div>`;
748
+ stage.insertBefore(el, $("#cap")); sceneEl = el; camEl = el.firstChild;
749
+ const x = makeCtx(el);
750
+ x.$$("[data-in]").forEach(n => x.at(+n.dataset.in, () => n.classList.add("on")));
751
+ x.$$("[data-type]").forEach(n => { const full = n.dataset.full, tt = n.querySelector(".tt"), sp = +n.dataset.sp;
752
+ x.tween(+n.dataset.type, full.length * sp, p => tt.textContent = full.slice(0, Math.round(full.length * p)), lin); });
753
+ if (sc.play) sc.play(x);
754
+ const cap = $("#cap"); cap.classList.remove("on"); cap.textContent = sc.cap || ""; if (sc.cap) x.at(900, () => cap.classList.add("on"));
755
+ (sc.aura || BRAND).forEach((c, k) => $("#aurora .b" + (k + 1)).style.backgroundColor = c);
756
+ $("#chapn").textContent = String(cur + 1).padStart(2, "0"); $("#chapt").textContent = sc.name;
757
+ cues.sort((a, b) => a.ms - b.ms);
758
+ tick(0); renderHud();
759
+ }
760
+ function tick(dt) {
761
+ if (!paused) t += dt;
762
+ for (const c of cues) if (!c.done && t >= c.ms) { c.done = true; c.fn(); }
763
+ for (const w of tweens) if (!w.done && t >= w.ms) { const p = Math.min(1, (t - w.ms) / w.dur); w.fn(w.ease(p)); if (p >= 1) w.done = true; }
764
+ const dur = SCENES[cur].dur, prog = Math.min(1, t / dur);
765
+ if (camEl) camEl.style.transform = `scale(${1 + 0.022 * prog})`; // ์ฒœ์ฒœํžˆ ๋‹ค๊ฐ€๊ฐ€๋Š” ์นด๋ฉ”๋ผ
766
+ document.querySelectorAll("#segs i").forEach((s, k) => s.style.width = (k < cur ? 100 : k === cur ? prog * 100 : 0) + "%");
767
+ const lastScene = cur === SCENES.length - 1 && !LOOP && !HOLD;
768
+ $("#fade").style.opacity = lastScene ? Math.max(0, Math.min(1, (t - (dur - 1500)) / 1300)) : 0;
769
+ if (!paused && !HOLD && t >= dur) { if (cur < SCENES.length - 1) go(cur + 1); else if (LOOP) go(0); else t = dur; }
770
+ }
771
+ function loop(now) { const dt = Math.min(100, now - last); last = now; tick(dt); requestAnimationFrame(loop); }
772
+
773
+ function fit() { const s = Math.min(innerWidth / 1920, innerHeight / 1080); stage.style.transform = `translate(-50%,-50%) scale(${s})`; }
774
+ addEventListener("resize", fit); fit();
775
+
776
+ function setPause(v) { paused = v; $("#play").textContent = paused ? "โ–ถ๏ธŽ ์žฌ์ƒ" : "โšโš"; $("#pausebadge").hidden = !paused || document.body.classList.contains("clean"); }
777
+ function renderHud() { $("#dots").innerHTML = SCENES.map((s, i) => `<button class="${i === cur ? "cur" : ""}" data-g="${i}" title="${i + 1}. ${s.name}">${i + 1}</button>`).join(""); }
778
+ $("#dots").onclick = e => { const b = e.target.closest("[data-g]"); if (b) go(+b.dataset.g); };
779
+ $("#prev").onclick = () => go(cur - 1); $("#next").onclick = () => go(cur + 1); $("#play").onclick = () => setPause(!paused);
780
+ addEventListener("keydown", e => {
781
+ if (e.ctrlKey || e.metaKey || e.altKey) return;
782
+ const k = e.key;
783
+ if (k === " ") { e.preventDefault(); setPause(!paused); }
784
+ else if (k === "ArrowRight" || k === "PageDown") go(cur + 1);
785
+ else if (k === "ArrowLeft" || k === "PageUp") go(cur - 1);
786
+ else if (k === "r" || k === "R") { setPause(false); go(0); }
787
+ else if (k === "h" || k === "H") { document.body.classList.toggle("clean"); setPause(paused); }
788
+ else if (k === "c" || k === "C") document.body.classList.toggle("nocap");
789
+ else if (k === "f" || k === "F") { document.fullscreenElement ? document.exitFullscreen() : document.documentElement.requestFullscreen().catch(() => {}); }
790
+ else if (/^[0-9]$/.test(k)) { const n = k === "0" ? 9 : +k - 1; if (n < SCENES.length) go(n); }
791
+ });
792
+ let idleT; addEventListener("mousemove", () => { document.body.classList.remove("idle"); clearTimeout(idleT); idleT = setTimeout(() => document.body.classList.add("idle"), 2200); });
793
+ idleT = setTimeout(() => document.body.classList.add("idle"), 2200);
794
+
795
+ const start = Math.max(0, Math.min(SCENES.length - 1, (+P.get("s") || 1) - 1));
796
+ (document.fonts ? Promise.race([document.fonts.ready, new Promise(r => setTimeout(r, 1800))]) : Promise.resolve()).then(() => { go(start);
797
+ const at = +P.get("at") || 0; for (let k = 0; k < at; k += 50) tick(Math.min(50, at - k)); // ?at=ms : ์žฅ๋ฉด ์•ˆ์˜ ๊ทธ ์‹œ์ ์œผ๋กœ ์ด๋™
798
+ last = performance.now(); requestAnimationFrame(loop); });
799
+ </script>
800
+ </body>
801
+ </html>