Multiple Choice
Transformers
Safetensors
Korean
qwen3
text-generation
korean
classification
natural-language-inference
function-calling
tool-use
calibrated
Eval Results (legacy)
text-generation-inference
Instructions to use coderecode95/KJH-Judge-4B-ko with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use coderecode95/KJH-Judge-4B-ko with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("coderecode95/KJH-Judge-4B-ko") model = AutoModelForCausalLM.from_pretrained("coderecode95/KJH-Judge-4B-ko", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Upload folder using huggingface_hub
Browse files- README.md +266 -23
- TRAINING.md +5 -1
- config.json +10 -0
- judge.py +225 -27
- judge_pipeline.py +52 -0
- quickstart.ipynb +204 -0
- space/README.md +31 -0
- space/index.html +801 -0
README.md
CHANGED
|
@@ -68,34 +68,276 @@ model-index:
|
|
| 68 |
## ๋น ๋ฅด๊ฒ ์์ํ๊ธฐ
|
| 69 |
|
| 70 |
```bash
|
| 71 |
-
pip install torch "transformers>=5" accelerate
|
| 72 |
```
|
| 73 |
|
| 74 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 75 |
|
| 76 |
```python
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 81 |
|
| 82 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 83 |
|
| 84 |
-
|
| 85 |
-
{"text": "๋ฐฐ์ก์ ๋๋ ธ์ง๋ง ๋ฌผ๊ฑด์ ์ ๋ง ๋ง์์ ๋ค์ด์"},
|
| 86 |
-
["๊ธ์ ์ ๊ฐ์ ", "๋ถ์ ์ ๊ฐ์ "])
|
| 87 |
-
# {'choice': 'A', 'index': 0, 'text': '๊ธ์ ์ ๊ฐ์ ', 'confidence': 0.9โฆ, 'probs': {'A': 0.9โฆ, 'B': 0.0โฆ}}
|
| 88 |
|
| 89 |
-
|
| 90 |
-
|
| 91 |
-
|
| 92 |
-
|
| 93 |
-
|
| 94 |
-
|
| 95 |
-
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 96 |
```
|
| 97 |
|
| 98 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 99 |
|
| 100 |
```python
|
| 101 |
import torch, json
|
|
@@ -126,13 +368,13 @@ print({c: round(p, 4) for c, p in zip(choices, probs.tolist())})
|
|
| 126 |
|
| 127 |
```
|
| 128 |
<|im_start|>user
|
| 129 |
-
{๊ณผ์ ์ค๋ช
}
|
| 130 |
|
| 131 |
-
{ํญ๋ชฉ ์ด๋ฆ}: {๊ฐ} โ ํญ๋ชฉ๋ง๋ค ํ ์ค. ๊ฐ์ด ๋ฌธ์์ด์ด ์๋๋ฉด JSON
|
| 132 |
{ํญ๋ชฉ ์ด๋ฆ}: {๊ฐ}
|
| 133 |
|
| 134 |
๋ณด๊ธฐ:
|
| 135 |
-
A. {๋ณด๊ธฐ 1}
|
| 136 |
B. {๋ณด๊ธฐ 2}
|
| 137 |
โฆ
|
| 138 |
|
|
@@ -140,6 +382,7 @@ B. {๋ณด๊ธฐ 2}
|
|
| 140 |
<|im_start|>assistant
|
| 141 |
```
|
| 142 |
|
|
|
|
| 143 |
- ๋ณด๊ธฐ๋ 2~26๊ฐ์
๋๋ค.
|
| 144 |
- ๊ณผ์ ์ค๋ช
์ ์งง๊ณ ๊ตฌ์ฒด์ ์ผ๋ก ์ฐ์ธ์. ํ๋จ ๊ธฐ์ค์ ํ๋ ๋ฌธ์ฅ ๋ง๋ถ์ด๋ฉด(์: โ๋ฐ์ด๋ฅผ ๊ณ ๋ คํ๋คโ, โ์ ๋ณด๊ฐ ์๋ค๋ ์ด์ ๋ง์ผ๋ก ๋ชจ์์ ๊ณ ๋ฅด์ง ์๋๋คโ) ์ ํ๋๊ฐ ํฌ๊ฒ ์ค๋ฆ
๋๋ค.
|
| 145 |
- `generate()`๋ก ์ธ ๊ฒฝ์ฐ `max_new_tokens=1`๋ก ๋ณด๊ธฐ ๊ธฐํธ ํ๋๋ง ๋ฐ์ผ์ธ์ (์ด ์ ์ฅ์์ `generation_config.json`์ `do_sample: false`์
๋๋ค). ํ๋ฅ ์ด ํ์ํ๋ฉด ์์ฒ๋ผ logits๋ฅผ ์ฝ์ผ์ธ์.
|
|
@@ -208,7 +451,7 @@ B. {๋ณด๊ธฐ 2}
|
|
| 208 |
| ๋์ 4๊ฐ์ฉ ๋ณด๋์ ๋ ์ฒ๋ฆฌ๋ | 3.9๊ฑด/์ด | **9.9๊ฑด/์ด** |
|
| 209 |
| ์๊ฐ์ ์ผ๊ณ ๋ต์ ์์ฑํ ๋ | | 6.3์ด |
|
| 210 |
|
| 211 |
-
- ๋์ ์ฒ๋ฆฌ๋์ ๋น๊ต ๋ชจ๋ธ์ด ์์ฐ์ต๋๋ค. ๋น๊ต ๋ชจ๋ธ์ ์์ฒญ์ ๋ฌถ์ด ์ฒ๋ฆฌํ๋ ์๋น ์์ง์์, ์ด ๋ชจ๋ธ์ ํ๋์ฉ ์ฒ๋ฆฌํ๋ ๋จ์ํ ์๋ฒ์์ ๋์๊ธฐ ๋๋ฌธ์
๋๋ค. ๋๋ ์ฒ๋ฆฌ์๋
|
| 212 |
- CPU(๋
ธํธ๋ถ, fp32)์์๋ ํ์ ํ ๋ฒ์ 6์ด์์ ์ ๋ถ์ด ๊ฑธ๋ ค ์ค์ฌ์ฉ์ด ์ด๋ ต์ต๋๋ค.
|
| 213 |
|
| 214 |
## ์ํ๋ ๊ฒ๊ณผ ๋ชปํ๋ ๊ฒ
|
|
|
|
| 68 |
## ๋น ๋ฅด๊ฒ ์์ํ๊ธฐ
|
| 69 |
|
| 70 |
```bash
|
| 71 |
+
pip install torch "transformers>=5" accelerate
|
| 72 |
```
|
| 73 |
|
| 74 |
+
```python
|
| 75 |
+
from transformers import pipeline
|
| 76 |
+
|
| 77 |
+
judge = pipeline(model="coderecode95/KJH-Judge-4B-ko", trust_remote_code=True,
|
| 78 |
+
device=0, dtype="bfloat16") # GPU๊ฐ ์์ผ๋ฉด device, dtype ๋ฅผ ๋นผ์ธ์ (๋งค์ฐ ๋๋ฆผ)
|
| 79 |
+
```
|
| 80 |
+
|
| 81 |
+
์ฐ๋ ๋ฐฉ๋ฒ์ ์ธ ๊ฐ์ง์ด๊ณ , **๊ฒฐ๊ณผ๋ ๋ชจ๋ ๊ฐ์ ๋ชจ์**์
๋๋ค.
|
| 82 |
|
| 83 |
```python
|
| 84 |
+
{'choice': '๊ธ์ ', 'confidence': 0.97, 'probabilities': {'๊ธ์ ': 0.97, '๋ถ์ ': 0.03}}
|
| 85 |
+
# ๊ณ ๋ฅธ ๋ณด๊ธฐ ๊ทธ ๋ณด๊ธฐ์ ํ๋ฅ (๋ณด์ ๋จ) ๋ณด๊ธฐ๋ณ ํ๋ฅ
|
| 86 |
+
```
|
| 87 |
+
|
| 88 |
+
#### 1. ์์ฃผ ์ฐ๋ ํ์ โ ๋ฉ์๋ ํ๋๋ก
|
| 89 |
+
|
| 90 |
+
ํ์ต ๋์ ๊ฐ์ ์ง์นจยท๋ณด๊ธฐ ๋ฌธ๊ตฌ๊ฐ ์๋์ผ๋ก ๋ค์ด๊ฐ์, ๋ฐ๋ก ํ๋กฌํํธ๋ฅผ ์ธ ํ์๊ฐ ์๊ณ ์ ํ๋๋ ๊ฐ์ฅ ์ ๋์ต๋๋ค.
|
| 91 |
+
|
| 92 |
+
```python
|
| 93 |
+
judge.sentiment("๋ฐฐ์ก์ ๋๋ ธ์ง๋ง ๋ฌผ๊ฑด์ ์ ๋ง ๋ง์์ ๋ค์ด์") # โ ๊ธ์
|
| 94 |
+
judge.nli("๋ณด์ฆ๊ธ์ ํด๊ฑฐ ํ 30์ผ ์ด๋ด ๋ฐํํ๋ค.", "๋ณด์ฆ๊ธ์ ํด๊ฑฐ 40์ผ ๋ค์ ๋ฐ๋๋ค.") # โ contradiction
|
| 95 |
+
judge.next_action("๊ฐ๋จ์ญ์์ ์์ธ์ญ๊น์ง ํ์ ๋ถ๋ฌ์ค", tools) # โ CALL:call_taxi
|
| 96 |
+
```
|
| 97 |
+
|
| 98 |
+
| ๋ฉ์๋ | ํ์ | ๊ณ ๋ฅด๋ ๊ฐ |
|
| 99 |
+
|---|---|---|
|
| 100 |
+
| `sentiment(๋ฌธ์ฅ)` | ๊ฐ์ | ๊ธ์ / ๋ถ์ |
|
| 101 |
+
| `topic(๋ด์ค ์ ๋ชฉ)` | ๋ด์ค ์ฃผ์ | ์ฌํ / IT๊ณผํ / ์ธ๊ณ / ์ํ๋ฌธํ / ์ ์น / ์คํฌ์ธ / ๊ฒฝ์ |
|
| 102 |
+
| `hate(๋ฌธ์ฅ)` | ํ์คยท๋นํ ํํ | ๋นํ์ค / ํ์ค |
|
| 103 |
+
| `offensive(๋๊ธ, news_title=None)` | ๋๊ธ ๊ณต๊ฒฉ์ฑ 3๋จ๊ณ | ์์ / ๊ณต๊ฒฉ์ / ํ์ค |
|
| 104 |
+
| `nli(์ ์ , ๊ฐ์ค)` | ๋ฌธ์ฅ ๊ด๊ณ | entailment / contradiction / neutral |
|
| 105 |
+
| `similar(๋ฌธ์ฅ1, ๋ฌธ์ฅ2)` | ๊ฐ์ ๋ป์ธ์ง | ๊ฐ์ / ๋ค๋ฆ |
|
| 106 |
+
| `yes_no(์ง๋ฌธ, ์ง๋ฌธ)` | ์ง๋ฌธ ๊ทผ๊ฑฐ ์/์๋์ค | ์ / ์๋์ค |
|
| 107 |
+
| `same_meaning(๋จ์ด, ๋ฌธ๋งฅ1, ๋ฌธ๋งฅ2)` | ๋จ์ด ๋ป์ด ๊ฐ์์ง | ๊ฐ์ / ๋ค๋ฆ |
|
| 108 |
+
| `reading(์ง๋ฌธ, ์ง๋ฌธ, ๋ณด๊ธฐ)` | ๋
ํด ๊ฐ๊ด์ | ๋ณด๊ธฐ ์ค ํ๋ |
|
| 109 |
+
| `next_action(๋ํ, ๋๊ตฌ ๋ชฉ๋ก)` | ์์ด์ ํธ ๋ค์ ํ๋ | CALL:<๋๊ตฌ> / ASK / RESPOND |
|
| 110 |
+
| `policy_action(์ ์ฑ
, ๊ณ ๊ฐ ์์ฒญ)` | ์ ์ฑ
์ ๋ฐ๋ฅธ ํ๋ | ANSWER / ASK_CLARIFICATION / ASK_CONFIRMATION / CALL_TOOL / CALL_MULTIPLE_TOOLS / ESCALATE / REFUSE |
|
| 111 |
+
|
| 112 |
+
๋ฌธ์ฅ ํ๋๋ง ๋ฐ๋ ๋ฉ์๋(`sentiment`, `topic`, `hate`, `nli` ๋ฑ)๋ **๋ฆฌ์คํธ๋ฅผ ๋ฃ์ผ๋ฉด ์ฌ๋ฌ ๊ฐ๋ฅผ ํ ๋ฒ์** ํ์ ํฉ๋๋ค.
|
| 113 |
+
|
| 114 |
+
#### 2. ๋ด ํ์ ๋ง๋ค๊ธฐ โ JEV ํ์
|
| 115 |
+
|
| 116 |
+
[Korean JEV Benchmark](https://huggingface.co/datasets/DaehanKim/korean-jev-benchmark)ยทJEV API์ ๊ฐ์ ๋ชจ์์
๋๋ค. **์ํฉ(`state`) ํ๋์ ์ด๋ฆ ๋ถ์ธ ์ง๋ฌธ ์ฌ๋ฌ ๊ฐ**๋ฅผ ํ ๋ฒ์ ๋ฌป๊ณ , ๋ณด๊ธฐ์๋ **๋ด๊ฐ ์ธ ID**๋ฅผ ๋ถ์
๋๋ค. ๊ฒฐ๊ณผ๋ ๊ทธ ID๋ก ๋์์ต๋๋ค.
|
| 117 |
+
|
| 118 |
+
```python
|
| 119 |
+
judge.decide(
|
| 120 |
+
state={"๊ณ ๊ฐ ๋ฌธ์": "์ง๋๋ฌ ์๊ธ์ด ๋ ๋ฒ ๋น ์ ธ๋๊ฐ์ด์. ์ค๋ ์์ ์ฒ๋ฆฌํด ์ฃผ์ธ์."},
|
| 121 |
+
questions={
|
| 122 |
+
"๋ถ์": {
|
| 123 |
+
"instructions": "๊ณ ๊ฐ ๋ฌธ์๋ฅผ ๋ด๋น ๋ถ์๋ก ๋ถ๋ฅํ๋ค.",
|
| 124 |
+
"criteria": {"billing": "๊ฒฐ์ ยทํ๋ถ", "delivery": "๋ฐฐ์ก", "account": "๊ณ์ ยท๋ก๊ทธ์ธ"},
|
| 125 |
+
},
|
| 126 |
+
"๊ธด๊ธ": {
|
| 127 |
+
"instructions": "๊ณ ๊ฐ์ด ์ฆ์ ์ฒ๋ฆฌ๋ฅผ ์๊ตฌํ๋์ง ํ๋จํ๋ค.",
|
| 128 |
+
"criteria": {"urgent": "์ฆ์ ์ฒ๋ฆฌ ์๊ตฌ", "normal": "์ผ๋ฐ ๋ฌธ์"},
|
| 129 |
+
},
|
| 130 |
+
},
|
| 131 |
+
)
|
| 132 |
+
# {'๋ถ์': {'choice': 'billing', 'confidence': 0.9โฆ, 'probabilities': {...}},
|
| 133 |
+
# '๊ธด๊ธ': {'choice': 'urgent', 'confidence': 0.9โฆ, 'probabilities': {...}}}
|
| 134 |
+
```
|
| 135 |
+
|
| 136 |
+
- **`state`**: ํ๋จํ ๋ด์ฉ. `{"์ด๋ฆ": ๊ฐ}`์ด ํ๋กฌํํธ์ ํ ์ค์ฉ ๋ค์ด๊ฐ๋๋ค. ๋ฌธ์ฅ ํ๋๋ฉด ๊ทธ๋ฅ ๋ฌธ์์ด๋ก ๋ฃ์ด๋ ๋ฉ๋๋ค.
|
| 137 |
+
- **`instructions`**: ๋ฌด์์ ์ด๋ค ๊ธฐ์ค์ผ๋ก ๊ณ ๋ฅผ์ง. ํ๋จ ๊ธฐ์ค์ ํ๋ ๋ฌธ์ฅ ๋ง๋ถ์ด๋ฉด(์: โ๋ฐ์ด๋ฅผ ๊ณ ๋ คํ๋คโ) ์ ํ๋๊ฐ ํฌ๊ฒ ์ค๋ฆ
๋๋ค.
|
| 138 |
+
- **`criteria`**: `{ID: ์ค๋ช
}`, 2~26๊ฐ. ID๋ ๊ฒฐ๊ณผ๋ก ๋๋ ค๋ฐ๋ ๊ฐ์ด๊ณ , ๋ชจ๋ธ์ ์ค๋ช
์ ๋ณด๊ณ ๊ณ ๋ฆ
๋๋ค. ID๊ฐ ํ์ ์์ผ๋ฉด `["๊ฒฐ์ ยทํ๋ถ", "๋ฐฐ์ก"]`์ฒ๋ผ ๋ฆฌ์คํธ๋ก ๋ฃ์ด๋ ๋ฉ๋๋ค.
|
| 139 |
+
|
| 140 |
+
#### 3. ํ ์ค๋ก
|
| 141 |
+
|
| 142 |
+
```python
|
| 143 |
+
judge("์ง๋๋ฌ ์๊ธ์ด ๋ ๋ฒ ๋น ์ ธ๋๊ฐ์ด์", choices=["๊ฒฐ์ ยทํ๋ถ", "๋ฐฐ์ก", "๊ธฐํ"],
|
| 144 |
+
instruction="๊ณ ๊ฐ ๋ฌธ์๋ฅผ ๋ด๋น ๋ถ์๋ก ๋ถ๋ฅํ๋ค.")
|
| 145 |
+
```
|
| 146 |
+
|
| 147 |
+
`judge.decide`์์ ์ง๋ฌธ์ด ํ๋์ผ ๋์ ๊ฐ์ต๋๋ค. ๋ฆฌ์คํธ๋ฅผ ๋ฃ๊ณ `batch_size=8`์ฒ๋ผ ์ฃผ๋ฉด ๋ฌถ์ด์ ๊ณ์ฐํฉ๋๋ค.
|
| 148 |
+
|
| 149 |
+
---
|
| 150 |
+
|
| 151 |
+
`trust_remote_code=True`๋ ์ด ์ ์ฅ์์ [`judge_pipeline.py`](judge_pipeline.py)์ [`judge.py`](judge.py)(ํ๋กฌํํธ ๋ง๋ค๊ธฐ์ ๋ณด๏ฟฝ๏ฟฝ๏ฟฝ ์ ์ ๊ณ์ฐ)๋ฅผ ์คํํ๋ค๋ ๋ป์
๋๋ค. ์๊ฒฉ ์ฝ๋๋ฅผ ์ฐ๊ณ ์ถ์ง ์์ผ๋ฉด `judge.py`๋ฅผ ๋ด๋ ค๋ฐ์ `from judge import Judge; judge = Judge()`๋ก ๋๊ฐ์ด ์ธ ์ ์์ต๋๋ค. [`quickstart.ipynb`](quickstart.ipynb)์ ์์๋ฅผ ๋ชจ์ ๋์์ต๋๋ค.
|
| 152 |
+
|
| 153 |
+
## ์ฌ์ฉ ์์
|
| 154 |
+
|
| 155 |
+
์ด ๋ชจ๋ธ์ **โ๋ฌด์์ ํ ์งโ๋ฅผ ๋น ๋ฅด๊ฒ ์ ํ๋ ์๋จ**์ ๋๋ ๊ฒ์ด ๊ฐ์ฅ ์ ๋ง์ต๋๋ค. ์ ํด์ง ๋ณด๊ธฐ ์ค ํ๋๋ฅผ ๊ณ ๋ฅด๋ ํ๋จ์ ์ด ๋ชจ๋ธ์ด ํ๊ณ , ๊ธ ์ฐ๊ธฐ๋ ๊ฐ ์ฑ์ฐ๊ธฐ์ฒ๋ผ ์์ฑ์ด ํ์ํ ์ผ๋ง ํฐ ๋ชจ๋ธ์ด๋ ์ฌ๋์๊ฒ ๋๊ธฐ๋ ๊ตฌ์ฑ์
๋๋ค. ์๋ ์์๋ ๋ชจ๋ ์์์ ๋ง๋ `judge`๋ก ๋ฐ๋ก ๋์๊ฐ๋๋ค. ์ฃผ์์ ์ ์ ๊ฒฐ๊ณผ๋ ์๋ํ ์ ๋ต์ด๊ณ , ์ค์ ํ๋ฅ ์ ์ง์ ์คํํด ํ์ธํ์ธ์.
|
| 156 |
+
|
| 157 |
+
### 1. ๊ณ ๊ฐ ๋ฌธ์ ๋ถ๋ฅ โ ๋ถ์์ ๊ธด๊ธ๋๋ฅผ ํ ๋ฒ์
|
| 158 |
+
|
| 159 |
+
๋ฌธ์ ํ๋๋ฅผ ์ฌ๋ฌ ๊ด์ ์ผ๋ก ๋์์ ๋ถ๋ฅํฉ๋๋ค. ์ง๋ฌธ๋ง๋ค ๋ณด๊ธฐ ID๋ฅผ ์ ํด ๋๋ฉด ๊ฒฐ๊ณผ๋ฅผ ๋ฐ๋ก ์
๋ฌด ์ฝ๋์ ์ฐ๊ฒฐํ ์ ์์ต๋๋ค.
|
| 160 |
+
|
| 161 |
+
```python
|
| 162 |
+
def route_ticket(text):
|
| 163 |
+
r = judge.decide(
|
| 164 |
+
state={"๊ณ ๊ฐ ๋ฌธ์": text},
|
| 165 |
+
questions={
|
| 166 |
+
"๋ถ์": {
|
| 167 |
+
"instructions": "๊ณ ๊ฐ ๋ฌธ์๋ฅผ ๋ด๋น ๋ถ์๋ก ๋ถ๋ฅํ๋ค. ์ฌ๋ฌ ๋ด์ฉ์ด ์์ฌ ์์ผ๋ฉด ๊ณ ๊ฐ์ด ํด๊ฒฐ์ ์ํ๋ ๋ฌธ์ ๋ฅผ ์ฐ์ ํ๋ค.",
|
| 168 |
+
"criteria": {"billing": "๊ฒฐ์ ยทํ๋ถ", "delivery": "๋ฐฐ์ก", "account": "๊ณ์ ยท๋ก๊ทธ์ธ",
|
| 169 |
+
"product": "์ ํ ์ฌ์ฉยท๊ณ ์ฅ", "other": "๊ธฐํ"},
|
| 170 |
+
},
|
| 171 |
+
"๊ธด๊ธ": {
|
| 172 |
+
"instructions": "๊ณ ๊ฐ์ด ์ฆ์ ์ฒ๋ฆฌ๋ฅผ ์๊ตฌํ๊ฑฐ๋ ๊ธ์ ํผํด๊ฐ ์งํ ์ค์ธ์ง ํ๋จํ๋ค.",
|
| 173 |
+
"criteria": {"urgent": "์ฆ์ ์ฒ๋ฆฌ ํ์", "normal": "์ผ๋ฐ ์ฒ๋ฆฌ"},
|
| 174 |
+
},
|
| 175 |
+
},
|
| 176 |
+
)
|
| 177 |
+
return r["๋ถ์"]["choice"], r["๊ธด๊ธ"]["choice"]
|
| 178 |
+
|
| 179 |
+
route_ticket("์ง๋๋ฌ ์๊ธ์ด ๋ ๋ฒ ๋น ์ ธ๋๊ฐ์ด์. ์ค๋ ์์ ํ๋ถํด ์ฃผ์ธ์.") # ('billing', 'urgent')
|
| 180 |
+
```
|
| 181 |
+
|
| 182 |
+
- ์ง์นจ์ **ํท๊ฐ๋ฆฌ๋ ๊ฒฝ์ฐ์ ๊ธฐ์ค**์ ํ ๋ฌธ์ฅ ๋ฃ์ผ๋ฉด(โ์ฌ๋ฌ ๋ด์ฉ์ด ์์ฌ ์์ผ๋ฉด โฆ์ ์ฐ์ ํ๋คโ) ์ ํ๋๊ฐ ์ค๋ฆ
๋๋ค.
|
| 183 |
+
- ๋ณด๊ธฐ์ `๊ธฐํ`๋ฅผ ๋๋ฉด ์ด๋์๋ ์ ๋ง๋ ๋ฌธ์๋ฅผ ์ต์ง๋ก ๋ผ์ ๋ฃ์ง ์์ต๋๋ค.
|
| 184 |
+
|
| 185 |
+
### 2. ๋ฆฌ๋ทฐ ๊ฐ์ ๋ถ์ โ ๋๋ ์ฒ๋ฆฌ์ ์ฌ๋ ๊ฒํ ๊ธฐ์ค
|
| 186 |
+
|
| 187 |
+
๋ฆฌ์คํธ๋ก ๋ฃ์ผ๋ฉด ๋ฌถ์ด์ ๊ณ์ฐํฉ๋๋ค. ํ์ ์ด ๋ฎ์ ๊ฑด ๋ฐ๋ก ๋ชจ์ ์ฌ๋์ด ๋ด
๋๋ค.
|
| 188 |
+
|
| 189 |
+
```python
|
| 190 |
+
reviews = ["๋ฐฐ์ก ์ฐธ ๋น ๋ฅด๋ค์. 2์ฃผ ๊ฑธ๋ ธ์ด์", "๊ฐ๊ฒฉ ๋๋น ๊ด์ฐฎ์์", "๋ค์๋ ์ ์ฝ๋๋ค", "๊ทธ๋ฅ ๊ทธ๋์"]
|
| 191 |
+
results = judge.sentiment(reviews)
|
| 192 |
+
|
| 193 |
+
auto = [(t, r["choice"]) for t, r in zip(reviews, results) if r["confidence"] >= 0.7]
|
| 194 |
+
review = [t for t, r in zip(reviews, results) if r["confidence"] < 0.7] # ์ฌ๋์ด ํ์ธ
|
| 195 |
+
```
|
| 196 |
+
|
| 197 |
+
- **๋ฐ์ดยท๋น๊ผผ**(โ๋ฐฐ์ก ์ฐธ ๋น ๋ฅด๋ค์. 2์ฃผ ๊ฑธ๋ ธ์ด์โ)์ ๋์ ํ์ ์ผ๋ก ํ๋ฆฌ๊ธฐ๋ ํฉ๋๋ค. ์ค์ํ ๊ณณ์๋ ํ๋ณธ์ ์ฌ๋์ด ๋ค์ ๋ณด์ธ์.
|
| 198 |
+
- ๊ธฐ์ค๊ฐ 0.7์ ์์์
๋๋ค. ์ค์ ๋ฐ์ดํฐ ์๋ฐฑ ๊ฑด์ ์ ๋ต์ ๋ฌ์ ๋ณด๊ณ โ์ด ๊ธฐ์ค ์ด์์ด๋ฉด ๋ช %๊ฐ ๋ง๋์งโ๋ฅผ ํ์ธํด ์ ํ์ธ์.
|
| 199 |
+
|
| 200 |
+
### 3. ๋ฆฌ๋ทฐ๋ฅผ ์ฌ๋ฌ ์ธก๋ฉด์ผ๋ก โ ๋ฐฐ์กยทํ์งยท๊ฐ๊ฒฉ ๊ฐ๊ฐ
|
| 201 |
+
|
| 202 |
+
ํ ๋ฆฌ๋ทฐ์์ ์ธก๋ฉด๋ณ๋ก ๋ฐ๋ก ํ๋จํฉ๋๋ค. ๊ฐ์ `state`์ ์ง๋ฌธ๋ง ๋๋ฆฌ๋ฉด ๋ฉ๋๋ค.
|
| 203 |
|
| 204 |
+
```python
|
| 205 |
+
ASPECT = {"pos": "๊ธ์ ์ ์ผ๋ก ์ธ๊ธ", "neg": "๋ถ์ ์ ์ผ๋ก ์ธ๊ธ", "none": "์ธ๊ธํ์ง ์์"}
|
| 206 |
+
|
| 207 |
+
judge.decide(
|
| 208 |
+
state={"๋ฆฌ๋ทฐ": "๋ฐฐ์ก์ ํ๋ฃจ ๋ง์ ์๋๋ฐ ๋ง๊ฐ์ด ์๋ง์ด๋ค์. ์ด ๊ฐ๊ฒฉ์ด๋ฉด ๊ทธ๋ฅ ๊ทธ๋์."},
|
| 209 |
+
questions={
|
| 210 |
+
"๋ฐฐ์ก": {"instructions": "๋ฆฌ๋ทฐ๊ฐ ๋ฐฐ์ก(์๋ยทํฌ์ฅ)์ ์ด๋ป๊ฒ ์ธ๊ธํ๋์ง ๊ณ ๋ฅธ๋ค.", "criteria": ASPECT},
|
| 211 |
+
"ํ์ง": {"instructions": "๋ฆฌ๋ทฐ๊ฐ ์ ํ ํ์ง(๋ง๊ฐยท๋ด๊ตฌ์ฑยท์ฑ๋ฅ)์ ์ด๋ป๊ฒ ์ธ๊ธํ๋์ง ๊ณ ๋ฅธ๋ค.", "criteria": ASPECT},
|
| 212 |
+
"๊ฐ๊ฒฉ": {"instructions": "๋ฆฌ๋ทฐ๊ฐ ๊ฐ๊ฒฉยท๊ฐ์ฑ๋น๋ฅผ ์ด๋ป๊ฒ ์ธ๊ธํ๋์ง ๊ณ ๋ฅธ๋ค. ์ ๋งคํ ํ๊ฐ๋ ์ธ๊ธํ ๊ฒ์ผ๋ก ๋ณด๋ ๊ธ์ ยท๋ถ์ ์ ๋ฌธ๋งฅ์ผ๋ก ํ๋จํ๋ค.", "criteria": ASPECT},
|
| 213 |
+
},
|
| 214 |
+
)
|
| 215 |
+
# {'๋ฐฐ์ก': {'choice': 'pos', โฆ}, 'ํ์ง': {'choice': 'neg', โฆ}, '๊ฐ๊ฒฉ': {โฆ}}
|
| 216 |
+
```
|
| 217 |
+
|
| 218 |
+
### 4. ๋๊ธ ๊ฒ์ โ ํ์ค ์ฌ๋ถ์ ๊ณต๊ฒฉ์ฑ ์์ค
|
| 219 |
+
|
| 220 |
+
`hate`๋ก ์ฐจ๋ณยท๋นํ ์ฌ๋ถ๋ฅผ ๊ฑฐ๋ฅด๊ณ , `offensive`๋ก ๊ณต๊ฒฉ์ฑ ์์ค์ ๋๋๋๋ค. ๊ธฐ์ฌ ๋๊ธ์ด๋ฉด ์ ๋ชฉ์ ๋ฌธ๋งฅ์ผ๋ก ํจ๊ป ๋ฃ์ต๋๋ค.
|
| 221 |
+
|
| 222 |
+
```python
|
| 223 |
+
comment = "์ด๋ฐ ๊ธฐ์ฌ ์ฐ๋ ๊ธฐ์๋ ๋จธ๋ฆฌ๊ฐ ์๋ ๊ฑด์ง"
|
| 224 |
+
|
| 225 |
+
judge.hate(comment) # ๋นํ์ค / ํ์ค
|
| 226 |
+
judge.offensive(comment, news_title="์ ๋ถ, ๋ด๋
์์ฐ์ ๋ฐํ") # ์์ / ๊ณต๊ฒฉ์ / ํ์ค
|
| 227 |
+
```
|
| 228 |
+
|
| 229 |
+
- ๋ ๋ฉ์๋๋ ๊ธฐ์ค์ด ๋ค๋ฆ
๋๋ค. `hate`๋ ์ฑ๋ณยท๋์ดยท์ถ์ ๊ฐ์ ์ง๋จ์ ๋ํ ์ฐจ๋ณยท๋นํ(APEACH ๊ธฐ์ค), `offensive`๋ ๊ฐ์ธ์ ํฅํ ๋ชจ์๊น์ง ํฌํจํ ๊ณต๊ฒฉ์ฑ 3๋จ๊ณ(BEEP ๊ธฐ์ค)์
๋๋ค.
|
| 230 |
+
- ์ฌ๋์๊ฒ ๋ถ์ด์ต์ ์ฃผ๋ ๊ฒฐ์ (์ญ์ ยท์ ์ฌ)์ ์ธ ๋๋ ํ์ ์ด ๋ฎ์ ๊ฑด ๋ฐ๋์ ์ฌ๋์ด ๊ฒํ ํ๊ฒ ํ์ธ์.
|
| 231 |
+
|
| 232 |
+
### 5. ์์ด์ ํธ ๋ผ์ฐํฐ โ ๋๊ตฌ ํธ์ถ / ๋๋ฌป๊ธฐ / ์ง์ ๋ต๋ณ
|
| 233 |
+
|
| 234 |
+
์์ด์ ํธ๊ฐ ๋งค ํด ํฐ ๋ชจ๋ธ์ โ๋ค์์ ๋ญ ํ ์งโ๋ฅผ ๋ฌป๋ ๋์ , ์ด ๋ชจ๋ธ์ด ๋จผ์ ์ ํฉ๋๋ค. ๋๊ตฌ ์ธ์ ์ฑ์ฐ๊ธฐ์ ๋ต๋ณ ์์ฑ๋ง ํฐ ๋ชจ๋ธ์ ๋งก๊น๋๋ค.
|
| 235 |
+
|
| 236 |
+
```python
|
| 237 |
+
tools = [
|
| 238 |
+
{"type": "function", "function": {"name": "call_taxi", "description": "ํ์๋ฅผ ํธ์ถํ๋ค",
|
| 239 |
+
"parameters": {"type": "object", "properties": {"pickup": {"type": "string"}, "destination": {"type": "string"}},
|
| 240 |
+
"required": ["pickup", "destination"]}}},
|
| 241 |
+
{"type": "function", "function": {"name": "get_weather", "description": "์ง์ญ์ ํ์ฌ ๋ ์จ๋ฅผ ์๋ ค์ค๋ค",
|
| 242 |
+
"parameters": {"type": "object", "properties": {"city": {"type": "string"}}, "required": ["city"]}}},
|
| 243 |
+
]
|
| 244 |
+
messages = [{"role": "user", "content": "๊ฐ๋จ์ญ์์ ์์ธ์ญ๊น์ง ํ์ ๋ถ๋ฌ์ค"}]
|
| 245 |
+
|
| 246 |
+
r = judge.next_action(messages, tools)
|
| 247 |
+
if r["confidence"] < 0.7:
|
| 248 |
+
action = "ํฐ ๋ชจ๋ธ์๊ฒ ๋ค์ ํ๋์ ๋งก๊น"
|
| 249 |
+
elif r["choice"].startswith("CALL:"):
|
| 250 |
+
action = f"ํฐ ๋ชจ๋ธ๋ก {r['choice'][5:]} ์ ์ธ์๋ฅผ ์ฑ์ ํธ์ถ" # ์ด ๋ชจ๋ธ์ ์ธ์๋ฅผ ์ฑ์ฐ์ง ๋ชปํฉ๋๋ค
|
| 251 |
+
elif r["choice"] == "ASK":
|
| 252 |
+
action = "๋น ์ง ํ์ ์ ๋ณด๋ฅผ ์ฌ์ฉ์์๊ฒ ๋๋ฌป๊ธฐ"
|
| 253 |
+
else: # RESPOND
|
| 254 |
+
action = "๋๊ตฌ ์์ด ๋ฐ๋ก ๋ต๋ณ"
|
| 255 |
+
```
|
| 256 |
+
|
| 257 |
+
- ๋๊ตฌ๋ **OpenAI ํ์ ๊ทธ๋๋ก**, ํนํ `required`๋ฅผ ๊ผญ ๋ฃ์ผ์ธ์. ์ด๋ฆ๋ง ์ฃผ๋ฉด ํ์ ์ธ์๋ฅผ ๋ณผ ์ ์์ด ASK์ CALL์ ๊ตฌ๋ณํ์ง ๋ชปํฉ๋๋ค.
|
| 258 |
+
- ๋ํ ๊ธฐ๋ก(์ ํด, ๋๊ตฌ ๊ฒฐ๊ณผ `{"role": "tool", โฆ}`)์ ํจ๊ป ๋ฃ์ผ๋ฉด โ์ด๋ฏธ ์ฒ๋ฆฌ๋์ผ๋ ๊ฒฐ๊ณผ ์๋ด(RESPOND)โ ๊ฐ์ ํ๋จ๋ ํฉ๋๋ค.
|
| 259 |
+
- ๋๊ตฌ๋ ์ต๋ 24๊ฐ๊น์ง ๋ฃ์ ์ ์์ต๋๋ค (๋ณด๊ธฐ 26๊ฐ ์ค 2๊ฐ๊ฐ ASKยทRESPOND).
|
| 260 |
+
|
| 261 |
+
### 6. ์ ์ฑ
์ ๋ฐ๋ฅธ ๊ณ ๊ฐ์ผํฐ ํ๋ ๊ฒฐ์
|
| 262 |
+
|
| 263 |
+
์ ์ฑ
๋ฌธ์์ ๊ณ ๊ฐ ์์ฒญ์ ์ฃผ๋ฉด ์คํ / ํ์ธ / ๋๋ฌป๊ธฐ / ์ด๊ด / ๊ฑฐ์ ์ค ๋ฌด์์ ํ ์ง ๊ณ ๋ฆ
๋๋ค. ์์ธ ์กฐํญ์ด ์ ์ฉ๋๋์ง๊น์ง ๋ฐ์ง๋๋ค.
|
| 264 |
+
|
| 265 |
+
```python
|
| 266 |
+
policy = ("ํด์ธ ์นด๋ ์น์ธ ๊ธ์ก์ด 100,000์ ์ด์์ด๋ฉด ๊ณ ๊ฐ์ ํ์ธ์ ๋ฐ์ ํ์๋ง ์คํํ๋ค. "
|
| 267 |
+
"๋ค๋ง VIP ๋ฑ๊ธ ๊ณ ๊ฐ์ ํ์ธ ์์ด ๋ฐ๋ก ์คํํ๋ค.")
|
| 268 |
+
|
| 269 |
+
judge.policy_action(policy, "ํ์ฝฉ์์ ์นด๋๋ก 149,000์ ๊ฒฐ์ ํ๋ ค๋๋ฐ ์น์ธํด์ค. ๋ด ๋ฑ๊ธ์ ์ผ๋ฐ์ด์ผ.")
|
| 270 |
+
# โ ASK_CONFIRMATION (๊ธ์ก ๊ธฐ์ค์ ๋์๊ณ VIP ์์ธ๊ฐ ์๋)
|
| 271 |
+
```
|
| 272 |
+
|
| 273 |
+
- ์ ์ฑ
์ **์ ํ ์๋ ๊ฒ๋ง** ๊ทผ๊ฑฐ๋ก ํ๋จํ๋๋ก ํ์ตํ์ต๋๋ค. ์ค์ ์
๋ฌด ๊ท์ ์ ๋ชจ๋ธ์ด ์์์ ๋ณด์ถฉํ์ง ์์ผ๋, ํ์ํ ์กฐ๊ฑด์ ์ ์ฑ
๋ฌธ์ฅ์ ๋ค ์ฐ์ธ์.
|
| 274 |
+
- ๋ณด๊ธฐ: `ANSWER`, `ASK_CLARIFICATION`, `ASK_CONFIRMATION`, `CALL_TOOL`, `CALL_MULTIPLE_TOOLS`, `ESCALATE`, `REFUSE`.
|
| 275 |
|
| 276 |
+
### 7. ๋ต๋ณ์ด ๊ทผ๊ฑฐ ๋ฌธ์์ ๋ง๋์ง ํ์ธ (RAG ๊ฒ์ฆ)
|
|
|
|
|
|
|
|
|
|
| 277 |
|
| 278 |
+
๊ฒ์ํ ๋ฌธ์๋ฅผ ์ ์ ๋ก, ์์ฑ๋ ๋ต๋ณ์ ๋ฌธ์ฅ์ ๊ฐ์ค๋ก ๋ฃ์ต๋๋ค. `contradiction`์ด๋ฉด ๋ฌธ์์ ์ด๊ธ๋ ๋ต์ด๊ณ , `neutral`์ด๋ฉด ๋ฌธ์์ ๊ทผ๊ฑฐ๊ฐ ์๋ ๋ด์ฉ์
๋๋ค.
|
| 279 |
+
|
| 280 |
+
```python
|
| 281 |
+
doc = "์๋์ธ์ ๊ณ์ฝ์ด ๋๋๊ณ ์์ฐจ์ธ์ด ์ง์ ๋น์ด ๋ ๋ถํฐ 30์ผ ์ด๋ด์ ๋ณด์ฆ๊ธ์ ๋๋ ค์ค๋ค."
|
| 282 |
+
answer_sentences = ["๋ณด์ฆ๊ธ์ ์ง์ ๋น์ด ๋ค 30์ผ ์์ ๋๋ ค๋ฐ์ต๋๋ค.",
|
| 283 |
+
"๋ณด์ฆ๊ธ์ ์ง์ ๋น์ด ๋ค 40์ผ ๋ค์ ๋๋ ค๋ฐ์ต๋๋ค.",
|
| 284 |
+
"๋ณด์ฆ๊ธ์๋ ์ฐ 3% ์ด์๊ฐ ๋ถ์ต๋๋ค."]
|
| 285 |
+
|
| 286 |
+
for s, r in zip(answer_sentences, judge.nli([doc] * len(answer_sentences), answer_sentences)):
|
| 287 |
+
print(r["choice"], s)
|
| 288 |
+
# entailment โฆ 30์ผ ์์ โฆ โ ๊ทผ๊ฑฐ ์์
|
| 289 |
+
# contradiction โฆ 40์ผ ๋ค์ โฆ โ ๋ฌธ์์ ์ด๊ธ๋จ
|
| 290 |
+
# neutral โฆ ์ฐ 3% ์ด์ โฆ โ ๋ฌธ์์ ๊ทผ๊ฑฐ ์์
|
| 291 |
+
```
|
| 292 |
+
|
| 293 |
+
- ๋ต๋ณ์ **๋ฌธ์ฅ ๋จ์๋ก ๋๋ ** ๋ฃ์ผ์ธ์. ์ฌ๋ฌ ์ฃผ์ฅ์ด ์์ธ ๊ธด ๋ต๋ณ์ ํ๋จ์ด ํ๋ ค์ง๋๋ค.
|
| 294 |
+
- ํ์ต ์ต๋ ๊ธธ์ด๊ฐ 2,048ํ ํฐ์ด๋ผ ๏ฟฝ๏ฟฝ ๋ฌธ์๋ ๊ด๋ จ ๋จ๋ฝ๋ง ์๋ผ ๋ฃ์ผ์ธ์.
|
| 295 |
+
|
| 296 |
+
### 8. ์ฝ๊ดยท๋ฌธ์์ ๊ทผ๊ฑฐํ ์/์๋์ค
|
| 297 |
+
|
| 298 |
+
๋ฌธ์๋ฅผ ์ฃผ๊ณ ์ง๋ฌธ์ ์/์๋์ค๋ก ๋ตํ๊ฒ ํฉ๋๋ค. ๋ฌธ์์ ์๋ ์์์ผ๋ก ๋ตํ์ง ์๋๋ก ํ์ตํ์ต๋๋ค.
|
| 299 |
+
|
| 300 |
+
```python
|
| 301 |
+
terms = "๊ตฌ๋งค ํ 7์ผ ์ด๋ด์๋ ๋จ์ ๋ณ์ฌ์ผ๋ก๋ ํ๋ถํ ์ ์๋ค. ๋จ, ํฌ์ฅ์ ๋ฏ์ ์ํํธ์จ์ด๋ ํ๋ถ ๋์์์ ์ ์ธํ๋ค."
|
| 302 |
+
|
| 303 |
+
judge.yes_no("ํฌ์ฅ์ ๋ฏ์ ๊ฒ์ CD๋ฅผ 3์ผ ๋ง์ ํ๋ถํ ์ ์๋์?", terms) # โ ์๋์ค
|
| 304 |
+
judge.yes_no("๋ฏ์ง ์์ ํค๋ณด๋๋ฅผ 5์ผ ๋ง์ ํ๋ถํ ์ ์๋์?", terms) # โ ์
|
| 305 |
+
```
|
| 306 |
+
|
| 307 |
+
### 9. ๋น์ทํ ์ง๋ฌธ ์ฐพ๊ธฐ โ FAQ ์ค๋ณต ํ์ธ
|
| 308 |
+
|
| 309 |
+
์๋ก ๋ค์ด์จ ์ง๋ฌธ์ด ๊ธฐ์กด FAQ์ ๊ฐ์ ๋ป์ธ์ง ํ์ธํฉ๋๋ค. ํ๋ณด๋ ๊ฒ์(์๋ฒ ๋ฉ ๋ฑ)์ผ๋ก ๋จผ์ ์ขํ๊ณ , ์ต์ข
ํ์ธ์ ์ด ๋ชจ๋ธ์ ์ฐ๋ ๊ตฌ์ฑ์ด ์ข์ต๋๋ค.
|
| 310 |
+
|
| 311 |
+
```python
|
| 312 |
+
faq = ["๋น๋ฐ๋ฒํธ๋ฅผ ์์ด๋ฒ๋ ธ์ด์", "๋ฐฐ์ก์ง๋ ์ด๋ป๊ฒ ๋ฐ๊พธ๋์", "ํ์ ํํด๋ ์ด๋์ ํ๋์"]
|
| 313 |
+
q = "๋ก๊ทธ์ธ ๋น๋ฒ์ด ๊ธฐ์ต์ด ์ ๋์"
|
| 314 |
+
|
| 315 |
+
hits = judge.similar([q] * len(faq), faq)
|
| 316 |
+
best = max(range(len(faq)), key=lambda i: hits[i]["probabilities"]["๊ฐ์"])
|
| 317 |
+
faq[best], hits[best]["choice"] # ('๋น๋ฐ๋ฒํธ๋ฅผ ์์ด๋ฒ๋ ธ์ด์', '๊ฐ์')
|
| 318 |
```
|
| 319 |
|
| 320 |
+
- `similar`๋ ํ์ตํ์ง ์์ ๊ณผ์ ์
๋๋ค (ํ์ตํ์ง ์์ KLUE-STS์์ 85.9%).
|
| 321 |
+
|
| 322 |
+
### 10. ๋ด ๋ถ๋ฅ ์ฒด๊ณ ๊ทธ๋๋ก ์ฐ๊ธฐ
|
| 323 |
+
|
| 324 |
+
์ด๋ค ๋ถ๋ฅ๋ ์ง์นจ๊ณผ ๋ณด๊ธฐ๋ง ์ฐ๋ฉด ๋ฉ๋๋ค. ํ์ตํ์ง ์์ ๊ณผ์ ๋ผ๋ **ํ๋จ ๊ธฐ์ค์ ์ง์นจ์ ์ ์ด ์ฃผ๋ ๊ฒ**์ด ์ ํ๋๋ฅผ ๊ฐ์ฅ ํฌ๊ฒ ์ข์ฐํฉ๋๋ค.
|
| 325 |
+
|
| 326 |
+
```python
|
| 327 |
+
judge.decide(
|
| 328 |
+
state={"๋ณด๊ณ ์ ๋ฌธ์ฅ": "3๋ถ๊ธฐ ๋งค์ถ์ ์ ๋
๋๋น 12% ์ฆ๊ฐํ์ผ๋ ์์
์ด์ต๋ฅ ์ ์ํญ ํ๋ฝํ๋ค."},
|
| 329 |
+
questions={
|
| 330 |
+
"๋
ผ์กฐ": {
|
| 331 |
+
"instructions": "๋ฌธ์ฅ์ด ํ์ฌ ์ค์ ์ ์ด๋ค ๋
ผ์กฐ๋ก ์ ๋ฌํ๋์ง ๊ณ ๋ฅธ๋ค. ์ข์ ์ ๊ณผ ๋์ ์ ์ด ํจ๊ป ์์ผ๋ฉด ํผํฉ์ผ๋ก ๋ณธ๋ค.",
|
| 332 |
+
"criteria": {"positive": "๊ธ์ ์ ", "negative": "๋ถ์ ์ ", "mixed": "ํผํฉ", "neutral": "์ฌ์ค ์ ๋ฌ๋ง"},
|
| 333 |
+
},
|
| 334 |
+
},
|
| 335 |
+
)
|
| 336 |
+
```
|
| 337 |
+
|
| 338 |
+
**์ ์ ๋๋ ์ฐ์์**: ์ซ์ ๋น๊ตยท๊ณ์ฐ์ด ํต์ฌ์ธ ํ๋จ(โ์ด๋ ์ชฝ์ด ๋ ์ผ๊ฐโ), ๋ฌธ์ฅ์์ ๊ฐ ๋ฝ๊ธฐ, ๋ต๋ณ ์์ฑ, ๋ค๋ฅธ ๋ชจ๋ธ ๋ต๋ณ์ ํ์ง ์ฑ์ (LLM-as-a-judge). ์ด๋ฐ ์ผ์ ์์ฑ ๋ชจ๋ธ์ ๋งก๊ธฐ์ธ์.
|
| 339 |
+
|
| 340 |
+
### ์๋ฆฌ: transformers๋ง์ผ๋ก ์ง์ ๊ณ์ฐํ๊ธฐ
|
| 341 |
|
| 342 |
```python
|
| 343 |
import torch, json
|
|
|
|
| 368 |
|
| 369 |
```
|
| 370 |
<|im_start|>user
|
| 371 |
+
{๊ณผ์ ์ค๋ช
} โ instructions
|
| 372 |
|
| 373 |
+
{ํญ๋ชฉ ์ด๋ฆ}: {๊ฐ} โ state ์ ํญ๋ชฉ๋ง๋ค ํ ์ค. ๊ฐ์ด ๋ฌธ์์ด์ด ์๋๋ฉด JSON
|
| 374 |
{ํญ๋ชฉ ์ด๋ฆ}: {๊ฐ}
|
| 375 |
|
| 376 |
๋ณด๊ธฐ:
|
| 377 |
+
A. {๋ณด๊ธฐ 1} โ criteria ์ ์ค๋ช
|
| 378 |
B. {๋ณด๊ธฐ 2}
|
| 379 |
โฆ
|
| 380 |
|
|
|
|
| 382 |
<|im_start|>assistant
|
| 383 |
```
|
| 384 |
|
| 385 |
+
- `judge.decide()`์ ๋ฉ์๋๋ค์ ์ด ํ์์ ์๋์ผ๋ก ๋ง๋ญ๋๋ค. ์ง์ ๋ง๋ค ๋๋ง ์ ๊ฒฝ ์ฐ๋ฉด ๋ฉ๋๋ค.
|
| 386 |
- ๋ณด๊ธฐ๋ 2~26๊ฐ์
๋๋ค.
|
| 387 |
- ๊ณผ์ ์ค๋ช
์ ์งง๊ณ ๊ตฌ์ฒด์ ์ผ๋ก ์ฐ์ธ์. ํ๋จ ๊ธฐ์ค์ ํ๋ ๋ฌธ์ฅ ๋ง๋ถ์ด๋ฉด(์: โ๋ฐ์ด๋ฅผ ๊ณ ๋ คํ๋คโ, โ์ ๋ณด๊ฐ ์๋ค๋ ์ด์ ๋ง์ผ๋ก ๋ชจ์์ ๊ณ ๋ฅด์ง ์๋๋คโ) ์ ํ๋๊ฐ ํฌ๊ฒ ์ค๋ฆ
๋๋ค.
|
| 388 |
- `generate()`๋ก ์ธ ๊ฒฝ์ฐ `max_new_tokens=1`๋ก ๋ณด๊ธฐ ๊ธฐํธ ํ๋๋ง ๋ฐ์ผ์ธ์ (์ด ์ ์ฅ์์ `generation_config.json`์ `do_sample: false`์
๋๋ค). ํ๋ฅ ์ด ํ์ํ๋ฉด ์์ฒ๋ผ logits๋ฅผ ์ฝ์ผ์ธ์.
|
|
|
|
| 451 |
| ๋์ 4๊ฐ์ฉ ๋ณด๋์ ๋ ์ฒ๋ฆฌ๋ | 3.9๊ฑด/์ด | **9.9๊ฑด/์ด** |
|
| 452 |
| ์๊ฐ์ ์ผ๊ณ ๋ต์ ์์ฑํ ๋ | | 6.3์ด |
|
| 453 |
|
| 454 |
+
- ๋์ ์ฒ๋ฆฌ๋์ ๋น๊ต ๋ชจ๋ธ์ด ์์ฐ์ต๋๋ค. ๋น๊ต ๋ชจ๋ธ์ ์์ฒญ์ ๋ฌถ์ด ์ฒ๋ฆฌํ๋ ์๋น ์์ง์์, ์ด ๋ชจ๋ธ์ ํ๋์ฉ ์ฒ๋ฆฌํ๋ ๋จ์ํ ์๋ฒ์์ ๋์๊ธฐ ๋๋ฌธ์
๋๋ค. ๋๋ ์ฒ๋ฆฌ์๋ ๋ฆฌ์คํธ๋ก ๋ฃ๊ณ `batch_size`๋ฅผ ์ฃผ์ด ๋ฌถ์ด ๊ณ์ฐํ์ธ์.
|
| 455 |
- CPU(๋
ธํธ๋ถ, fp32)์์๋ ํ์ ํ ๋ฒ์ 6์ด์์ ์ ๋ถ์ด ๊ฑธ๋ ค ์ค์ฌ์ฉ์ด ์ด๋ ต์ต๋๋ค.
|
| 456 |
|
| 457 |
## ์ํ๋ ๊ฒ๊ณผ ๋ชปํ๋ ๊ฒ
|
TRAINING.md
CHANGED
|
@@ -70,6 +70,8 @@ A<|im_end|>
|
|
| 70 |
|
| 71 |
๊ณผ์ ์ค๋ช
์ ๊ณผ์ ๋ง๋ค ํ๋จ ๊ธฐ์ค์ ํ๋ ๋ฌธ์ฅ ๋ด์์ต๋๋ค (์: ๋ฌธ์ฅ ๊ด๊ณ์์๋ โ์ ๋ณด๊ฐ ์๋ค๋ ์ด์ ๋ง์ผ๋ก ๋ชจ์์ ๊ณ ๋ฅด์ง ์๋๋คโ). ๊ฐ์ ํ์์ ๋ค์ํ ๊ณผ์ ์ค๋ช
์ด ์์ฌ ์์ด์, ํ์ตํ์ง ์์ ์ง์๋ฌธ๋ ๋ฐ๋ฅด๊ฒ ๋ฉ๋๋ค.
|
| 72 |
|
|
|
|
|
|
|
| 73 |
### 3.3 ๋ณด๊ธฐ ์์ ์๊ธฐ์ ์ญ์ ๋ฃ๊ธฐ
|
| 74 |
|
| 75 |
- ๋ณด๊ธฐ ์์๋ ๋ฌธํญ๋ง๋ค ๋ฌด์์๋ก ์์์ต๋๋ค. ์ ๋ต ๊ธฐํธ๊ฐ A๋ B์ ๋ชฐ๋ฆฌ๋ฉด ๋ชจ๋ธ์ด ๋ด์ฉ ๋์ ์์น๋ฅผ ์ธ์ฐ๊ธฐ ๋๋ฌธ์
๋๋ค (์๋ณธ ๋ชจ๋ธ์ ์ด ํ์์์ ๊ฑฐ์ ๋ A๋ฅผ ๊ณจ๋์ต๋๋ค).
|
|
@@ -139,7 +141,9 @@ A<|im_end|>
|
|
| 139 |
| KorNLI | 74.5 | 83.6 | +9.1 |
|
| 140 |
| KLUE-STS | 85.9 | 87.4 | +1.5 |
|
| 141 |
| KMMLU | 42.6 | 52.9 | +10.2 |
|
| 142 |
-
| HAE-RAE 1.0 | 56.1 | 57.1 | +1.0 |
|
|
|
|
|
|
|
| 143 |
|
| 144 |
## 6. ํ๊ฐ
|
| 145 |
|
|
|
|
| 70 |
|
| 71 |
๊ณผ์ ์ค๋ช
์ ๊ณผ์ ๋ง๋ค ํ๋จ ๊ธฐ์ค์ ํ๋ ๋ฌธ์ฅ ๋ด์์ต๋๋ค (์: ๋ฌธ์ฅ ๊ด๊ณ์์๋ โ์ ๋ณด๊ฐ ์๋ค๋ ์ด์ ๋ง์ผ๋ก ๋ชจ์์ ๊ณ ๋ฅด์ง ์๋๋คโ). ๊ฐ์ ํ์์ ๋ค์ํ ๊ณผ์ ์ค๋ช
์ด ์์ฌ ์์ด์, ํ์ตํ์ง ์์ ์ง์๋ฌธ๋ ๋ฐ๋ฅด๊ฒ ๋ฉ๋๋ค.
|
| 72 |
|
| 73 |
+
ํ์ต์ ์ด ๊ณผ์ ์ค๋ช
๊ณผ ๋ณด๊ธฐ ๋ฌธ๊ตฌ๋ [`judge.py`](judge.py)์ `TASKS`ยท`CRITERIA`์ ๊ทธ๋๋ก ๋ค์ด ์์ต๋๋ค. `judge.sentiment()`, `judge.nli()` ๊ฐ์ ๋ฉ์๋๋ ์ด ๋ฌธ๊ตฌ๋ก ํ๋กฌํํธ๋ฅผ ๋ง๋ค๊ธฐ ๋๋ฌธ์ ํ์ต ๋์ ๊ฐ์ ์กฐ๊ฑด์ผ๋ก ํ์ ํฉ๋๋ค.
|
| 74 |
+
|
| 75 |
### 3.3 ๋ณด๊ธฐ ์์ ์๊ธฐ์ ์ญ์ ๋ฃ๊ธฐ
|
| 76 |
|
| 77 |
- ๋ณด๊ธฐ ์์๋ ๋ฌธํญ๋ง๋ค ๋ฌด์์๋ก ์์์ต๋๋ค. ์ ๋ต ๊ธฐํธ๊ฐ A๋ B์ ๋ชฐ๋ฆฌ๋ฉด ๋ชจ๋ธ์ด ๋ด์ฉ ๋์ ์์น๋ฅผ ์ธ์ฐ๊ธฐ ๋๋ฌธ์
๋๋ค (์๋ณธ ๋ชจ๋ธ์ ์ด ํ์์์ ๊ฑฐ์ ๋ A๋ฅผ ๊ณจ๋์ต๋๋ค).
|
|
|
|
| 141 |
| KorNLI | 74.5 | 83.6 | +9.1 |
|
| 142 |
| KLUE-STS | 85.9 | 87.4 | +1.5 |
|
| 143 |
| KMMLU | 42.6 | 52.9 | +10.2 |
|
| 144 |
+
| HAE-RAE 1.0 | 56.1 | 57.1 | +1.0 |
|
| 145 |
+
|
| 146 |
+
๋ณด์ ์จ๋๋ [`calibration.json`](calibration.json)์ ์๊ณ [`judge.py`](judge.py)๊ฐ ์๋์ผ๋ก ์ ์ฉํฉ๋๋ค.
|
| 147 |
|
| 148 |
## 6. ํ๊ฐ
|
| 149 |
|
config.json
CHANGED
|
@@ -5,6 +5,16 @@
|
|
| 5 |
"attention_bias": false,
|
| 6 |
"attention_dropout": 0.0,
|
| 7 |
"bos_token_id": 151643,
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
"dtype": "bfloat16",
|
| 9 |
"eos_token_id": 151645,
|
| 10 |
"head_dim": 128,
|
|
|
|
| 5 |
"attention_bias": false,
|
| 6 |
"attention_dropout": 0.0,
|
| 7 |
"bos_token_id": 151643,
|
| 8 |
+
"custom_pipelines": {
|
| 9 |
+
"kjh-judge": {
|
| 10 |
+
"impl": "judge_pipeline.KJHJudgePipeline",
|
| 11 |
+
"pt": [
|
| 12 |
+
"AutoModelForCausalLM"
|
| 13 |
+
],
|
| 14 |
+
"tf": [],
|
| 15 |
+
"type": "text"
|
| 16 |
+
}
|
| 17 |
+
},
|
| 18 |
"dtype": "bfloat16",
|
| 19 |
"eos_token_id": 151645,
|
| 20 |
"head_dim": 128,
|
judge.py
CHANGED
|
@@ -1,17 +1,40 @@
|
|
| 1 |
"""KJH-Judge-4B-ko ํ์ ๋์ฐ๋ฏธ โ ์ ํด์ง ๋ณด๊ธฐ ์ค ํ๋๋ฅผ ๊ณจ๋ผ ๋ณด์ ๋ ํ๋ฅ ๊ณผ ํจ๊ป ๋๋ ค์ค๋ค.
|
| 2 |
|
| 3 |
-
from
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
|
| 8 |
๋์: ์๋ ํ์์ ํ๋กฌํํธ๋ฅผ ํ ๋ฒ ๊ณ์ฐํ๊ณ , ๋ค์ ํ ํฐ ์๋ฆฌ์์ ๋ณด๊ธฐ ๊ธฐํธ(A, B, โฆ) ํ ํฐ์ ์ ์๋ง ๊บผ๋ด
|
| 9 |
-
calibration.json ์ ์จ๋๋ก ๋๋ softmax ํ๋ค. ๊ธ์ ์์ฑํ์ง ์์ผ๋ฏ๋ก ๋น ๋ฅด๋ค
|
| 10 |
|
| 11 |
<|im_start|>user
|
| 12 |
-
{
|
| 13 |
|
| 14 |
-
{ํญ๋ชฉ ์ด๋ฆ}: {๊ฐ} โ
|
| 15 |
|
| 16 |
๋ณด๊ธฐ:
|
| 17 |
A. {๋ณด๊ธฐ 1}
|
|
@@ -21,58 +44,237 @@ calibration.json ์ ์จ๋๋ก ๋๋ softmax ํ๋ค. ๊ธ์ ์์ฑํ์ง ์์ผ
|
|
| 21 |
<|im_start|>assistant
|
| 22 |
"""
|
| 23 |
import json
|
|
|
|
| 24 |
from pathlib import Path
|
| 25 |
|
| 26 |
import torch
|
| 27 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 28 |
|
|
|
|
| 29 |
HINT = "์ ๋ต ๋ณด๊ธฐ์ ๊ธฐํธ ํ๋๋ง ๋ตํ์ธ์."
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
|
| 32 |
def render_prompt(instruction, item, choices):
|
|
|
|
|
|
|
| 33 |
lines = [f"{k}: {v if isinstance(v, str) else json.dumps(v, ensure_ascii=False)}" for k, v in item.items()]
|
| 34 |
opts = "\n".join(f"{chr(65 + i)}. {c}" for i, c in enumerate(choices))
|
| 35 |
-
return "\n\n".join([instruction.strip(), "\n".join(lines), "๋ณด๊ธฐ:\n" + opts, HINT])
|
| 36 |
|
| 37 |
|
| 38 |
def chat_prefix(prompt):
|
| 39 |
return f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
|
| 40 |
|
| 41 |
|
| 42 |
-
def
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 43 |
p = Path(model) / "calibration.json"
|
| 44 |
if not p.is_file():
|
| 45 |
try:
|
| 46 |
from huggingface_hub import hf_hub_download
|
| 47 |
p = Path(hf_hub_download(model, "calibration.json"))
|
| 48 |
except Exception:
|
|
|
|
| 49 |
return 1.0
|
| 50 |
return float(json.loads(p.read_text(encoding="utf-8"))["temperature"])
|
| 51 |
|
| 52 |
|
| 53 |
-
|
| 54 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
device = device or ("cuda" if torch.cuda.is_available() else "cpu")
|
| 56 |
dtype = dtype or (torch.bfloat16 if device != "cpu" else torch.float32)
|
| 57 |
self.tok = AutoTokenizer.from_pretrained(model)
|
| 58 |
self.model = AutoModelForCausalLM.from_pretrained(model, dtype=dtype).to(device).eval()
|
| 59 |
self.device = device
|
| 60 |
-
self.temperature =
|
| 61 |
-
self.letter_ids =
|
| 62 |
|
| 63 |
-
def
|
| 64 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 65 |
|
| 66 |
@torch.no_grad()
|
| 67 |
def decide_batch(self, requests, batch_size=16, max_tokens=8000):
|
| 68 |
-
"""
|
| 69 |
-
|
|
|
|
|
|
|
| 70 |
seqs = []
|
| 71 |
for r in requests:
|
| 72 |
-
ch =
|
| 73 |
-
|
| 74 |
-
|
| 75 |
-
seqs.append((self._encode(r["instruction"], r["item"], ch), ch))
|
| 76 |
order = sorted(range(len(seqs)), key=lambda i: len(seqs[i][0]))
|
| 77 |
out = [None] * len(seqs)
|
| 78 |
W = self.model.get_output_embeddings().weight
|
|
@@ -90,18 +292,14 @@ class Judge:
|
|
| 90 |
for r, k in enumerate(grp):
|
| 91 |
ids, ch = seqs[k]
|
| 92 |
rows = torch.tensor(self.letter_ids[:len(ch)], device=self.device)
|
| 93 |
-
|
| 94 |
-
p = torch.softmax(scores, -1).tolist()
|
| 95 |
b = max(range(len(p)), key=p.__getitem__)
|
| 96 |
out[k] = {"choice": chr(65 + b), "index": b, "text": ch[b], "confidence": round(p[b], 4),
|
| 97 |
"probs": {chr(65 + j): round(v, 4) for j, v in enumerate(p)}}
|
| 98 |
return out
|
| 99 |
|
| 100 |
-
def decide(self, instruction, item, choices):
|
| 101 |
-
return self.decide_batch([{"instruction": instruction, "item": item, "choices": choices}])[0]
|
| 102 |
-
|
| 103 |
|
| 104 |
if __name__ == "__main__":
|
| 105 |
import sys
|
| 106 |
j = Judge(sys.argv[1] if len(sys.argv) > 1 else ".")
|
| 107 |
-
print(j.
|
|
|
|
| 1 |
"""KJH-Judge-4B-ko ํ์ ๋์ฐ๋ฏธ โ ์ ํด์ง ๋ณด๊ธฐ ์ค ํ๋๋ฅผ ๊ณจ๋ผ ๋ณด์ ๋ ํ๋ฅ ๊ณผ ํจ๊ป ๋๋ ค์ค๋ค.
|
| 2 |
|
| 3 |
+
from transformers import pipeline
|
| 4 |
+
judge = pipeline(model="coderecode95/KJH-Judge-4B-ko", trust_remote_code=True, device=0, dtype="bfloat16")
|
| 5 |
+
# ๋๋: from judge import Judge; judge = Judge() (์ด ํ์ผ์ ๋ด๋ ค๋ฐ์ ์ธ ๋)
|
| 6 |
+
|
| 7 |
+
1) JEV ํ์ โ ์ํฉ(state) ํ๋์ ์ด๋ฆ ๋ถ์ธ ์ง๋ฌธ ์ฌ๋ฌ ๊ฐ. ๋ณด๊ธฐ ID๋ ๋ง์๋๋ก ์ ํ๋ค.
|
| 8 |
+
|
| 9 |
+
judge.decide(
|
| 10 |
+
state={"๊ณ ๊ฐ ๋ฌธ์": "์ง๋๋ฌ ์๊ธ์ด ๋ ๋ฒ ๋น ์ ธ๋๊ฐ์ด์. ์ค๋ ์์ ์ฒ๋ฆฌํด ์ฃผ์ธ์."},
|
| 11 |
+
questions={
|
| 12 |
+
"๋ถ์": {"instructions": "๊ณ ๊ฐ ๋ฌธ์๋ฅผ ๋ด๋น ๋ถ์๋ก ๋ถ๋ฅํ๋ค.",
|
| 13 |
+
"criteria": {"billing": "๊ฒฐ์ ยทํ๋ถ", "delivery": "๋ฐฐ์ก", "account": "๊ณ์ ยท๋ก๊ทธ์ธ"}},
|
| 14 |
+
"๊ธด๊ธ": {"instructions": "๊ณ ๊ฐ์ด ์ฆ์ ์ฒ๋ฆฌ๋ฅผ ์๊ตฌํ๋์ง ํ๋จํ๋ค.",
|
| 15 |
+
"criteria": {"urgent": "์ฆ์ ์ฒ๋ฆฌ ์๊ตฌ", "normal": "์ผ๋ฐ ๋ฌธ์"}},
|
| 16 |
+
},
|
| 17 |
+
)
|
| 18 |
+
# โ {'๋ถ์': {'choice': 'billing', 'confidence': 0.98, 'probabilities': {...}},
|
| 19 |
+
# '๊ธด๊ธ': {'choice': 'urgent', 'confidence': 0.91, 'probabilities': {...}}}
|
| 20 |
+
|
| 21 |
+
2) ์์ฃผ ์ฐ๋ ํ์ โ ํ์ต ๋์ ๊ฐ์ ์ง์นจยท๋ณด๊ธฐ๋ฅผ ์๋์ผ๋ก ๋ฃ๋๋ค.
|
| 22 |
+
|
| 23 |
+
judge.sentiment("๋ฐฐ์ก์ ๋๋ ธ์ง๋ง ๋ฌผ๊ฑด์ ์ ๋ง ๋ง์์ ๋ค์ด์") # โ choice: ๊ธ์ / ๋ถ์
|
| 24 |
+
judge.nli("๋ณด์ฆ๊ธ์ 30์ผ ์ด๋ด ๋ฐํํ๋ค.", "๋ณด์ฆ๊ธ์ 40์ผ ๋ค์ ๋ฐ๋๋ค.") # โ entailment / contradiction / neutral
|
| 25 |
+
judge.next_action("ํ์ ๋ถ๋ฌ์ค", tools) # โ CALL:call_taxi / ASK / RESPOND
|
| 26 |
+
|
| 27 |
+
3) ํ ์ค๋ก โ judge(์ํฉ, ๋ณด๊ธฐ, instruction=โฆ). ๊ฒฐ๊ณผ ํ์์ ๋ชจ๋ ๊ฐ๋ค.
|
| 28 |
+
|
| 29 |
+
judge("์ง๋๋ฌ ์๊ธ์ด ๋ ๋ฒ ๋น ์ ธ๋๊ฐ์ด์", ["๊ฒฐ์ ยทํ๋ถ", "๋ฐฐ์ก", "๊ธฐํ"], instruction="๊ณ ๊ฐ ๋ฌธ์๋ฅผ ๋ด๋น ๋ถ์๋ก ๋ถ๋ฅํ๋ค.")
|
| 30 |
|
| 31 |
๋์: ์๋ ํ์์ ํ๋กฌํํธ๋ฅผ ํ ๋ฒ ๊ณ์ฐํ๊ณ , ๋ค์ ํ ํฐ ์๋ฆฌ์์ ๋ณด๊ธฐ ๊ธฐํธ(A, B, โฆ) ํ ํฐ์ ์ ์๋ง ๊บผ๋ด
|
| 32 |
+
calibration.json ์ ์จ๋๋ก ๋๋ softmax ํ๋ค. ๊ธ์ ์์ฑํ์ง ์์ผ๋ฏ๋ก ๋น ๋ฅด๋ค.
|
| 33 |
|
| 34 |
<|im_start|>user
|
| 35 |
+
{์ง์นจ}
|
| 36 |
|
| 37 |
+
{ํญ๋ชฉ ์ด๋ฆ}: {๊ฐ} โ state ์ ํค๋ง๋ค ํ ์ค (๊ฐ์ด ๋ฌธ์์ด์ด ์๋๋ฉด JSON). ๋ฌธ์์ด๋ง ์ฃผ๋ฉด "text: {๋ฌธ์์ด}"
|
| 38 |
|
| 39 |
๋ณด๊ธฐ:
|
| 40 |
A. {๋ณด๊ธฐ 1}
|
|
|
|
| 44 |
<|im_start|>assistant
|
| 45 |
"""
|
| 46 |
import json
|
| 47 |
+
import warnings
|
| 48 |
from pathlib import Path
|
| 49 |
|
| 50 |
import torch
|
| 51 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 52 |
|
| 53 |
+
REPO = "coderecode95/KJH-Judge-4B-ko"
|
| 54 |
HINT = "์ ๋ต ๋ณด๊ธฐ์ ๊ธฐํธ ํ๋๋ง ๋ตํ์ธ์."
|
| 55 |
+
DEFAULT_INSTRUCTION = "์ฃผ์ด์ง ๋ด์ฉ์ ์ฝ๊ณ ๊ฐ์ฅ ์๋ง์ ๋ณด๊ธฐ๋ฅผ ๊ณ ๋ฅธ๋ค."
|
| 56 |
+
|
| 57 |
+
# ๊ณผ์ ๋ณ ์ง์นจ โ ํ์ตยทKorean JEV Benchmark ์ ๊ฐ์ ๋ฌธ๊ตฌ (๋ฐ๊พธ๋ฉด ์ ํ๋๊ฐ ๋จ์ด์ง ์ ์๋ค)
|
| 58 |
+
TASKS = {
|
| 59 |
+
"sentiment": "๋ฌธ์ฅ์ ์ ๋ฐ์ ์ธ ๊ฐ์ ๊ทน์ฑ์ ํ๋จํ๋ค. ๋ถ์ ํํ๊ณผ ๋ฐ์ด๋ฅผ ๊ณ ๋ คํ๋ค.",
|
| 60 |
+
"nli": ("์ ์ ๋ฅผ ์ฐธ์ด๋ผ๊ณ ํ ๋ ๊ฐ์ค์ ๋ถ๋ฅํ๋ค. entailment: ์ ์ ๋ก๋ถํฐ ๊ฐ์ค์ด ๋ฐ๋ผ์จ๋ค. contradiction: ์ ์ ์ ๊ฐ์ค์ด ์๋ฆฝํ ์ ์๋ค. neutral: ๋ ๋ค ์๋๋ค. "
|
| 61 |
+
"์ ๋ณด๊ฐ ์๋ค๋ ์ด์ ๋ง์ผ๋ก contradiction์ ๊ณ ๋ฅด์ง ์๋๋ค. neutral์ ์ ์ ์ ๋ต์ด๋ฉฐ insufficient_context๊ฐ ์๋๋ค. ํต์์ ์ธ ๋ฌธ์ฅ ์๋ฏธ๋ก ํ๋จํ๋ฉฐ ํฌ๋ฐํ ๊ฐ์ ์ ๋ง๋ค์ด ๋ชจํธํ๋ค๊ณ ํ์ง ์๋๋ค. "
|
| 62 |
+
"์ ์ ์ ์ด๊ฑฐ ๋์๊ณผ ๊ฐ์ค์ ๋ฒ์๋ฅผ ๋น ์ง์์ด ๋์กฐํ๋ค. ๊ฐ์ค์ ๋ง/๋ฐ์/์ค์ง/๋ชจ๋ ๊ฐ์ ํํ์ด ์ ์ ์ ๋ช
์๋ ๋ค๋ฅธ ๋์์ด๋ ์ฌ๋ก๋ฅผ ๋ฐฐ์ ํ๋์ง ํ์ธํ๋ค. "
|
| 63 |
+
"์ ์ ์ ๋ฐฐํ ํํ์ด ์๋ค๋ ์ฌ์ค๋ง์ผ๋ก ์ค๋ฆฝ์ด๋ผ๊ณ ํ์ง ์๋๋ค. ํต์์ ์ธ ๋ฌธ๋งฅ์ด ๋ช
ํํ๋ฉด ๋ค๋ฅธ ์์ธยท์ํฉ์ ์์๋ก ์ถ๊ฐํ์ง ์๋๋ค."),
|
| 64 |
+
"topic": "ํ๊ตญ์ด ๋ด์ค ์ ๋ชฉ์ ์ค์ฌ ์ฃผ์ ๋ฅผ ๊ณ ๋ฅธ๋ค. ์ฌ๋ฌ ๋ถ์ผ๊ฐ ์ธ๊ธ๋์ด๋ ๊ธฐ์ฌ์ ์ฃผ๋ ์ฌ๊ฑด์ ์ฐ์ ํ๋ค.",
|
| 65 |
+
"hate": ("APEACH ์ ๋
ผ๋ฌธ์ ์์ฑ ๊ธฐ์ค์ ๋ฐ๋ฅธ๋ค. ์ฑ๋ณยท์ฑ์ ์งํฅ/์ ์ฒด์ฑยท๋์ด/์ ๋ถ/๊ฒฝ๋ ฅยท๊ตญ์ /์ธ์ข
ยท์ถ์ /๊ฑฐ์ฃผ์งยท์ธ๋ชจยท์ง๋ณ/์ฅ์ ยท์์ต๊ดยทํ๋ ฅ/์ ๊ณต ๊ด๋ จ ์ฐจ๋ณยท๋นํยท๊ณต๊ฒฉ์ ํฌํจํ๋ค. "
|
| 66 |
+
"๋ณดํธ์ง๋จ ์ ์ฒด์ฑ์ ๋ช
์ํด์ผ ํ๋ค๋ ์ ํ์ ์๋ค. ๋ถํ์ํ๊ฑฐ๋ ๊ณต๊ฒฉ์ ์ธ ์ธ๋ชจ ํ๊ฐ, ์์ต๊ด ๊ฐ์/ํํ๋ ํด๋นํ๋ค. ๋น๊ณต๊ฒฉ์ ์ธ ์ฃผ์ ์ธ๊ธ์ด๋ ์ฐจ๋ณ์ ๋ํ ๋ฐ๋ ๋ฐ์ธ์ ๋นํ์ค๋ค."),
|
| 67 |
+
"offensive": "BEEP ์ ์ง์นจ์ ๋ฐ๋ฅธ ๊ณต๊ฒฉ์ฑ ์์ค. hate ๋์์ ๋ณดํธ ์ง๋จ์ ํ์ ๋์ง ์๊ณ ๊ธฐ์ฌ ์ ์ธ๋ฌผยท์์ฑ์ ๋ฑ ๊ฐ์ธ๋ ํฌํจํ๋ค. ๋น์์ด ์กด์ฌ๋ง์ผ๋ก hate๊ฐ ๋์ง๋ ์๋๋ค. ๋ด์ค ์ ๋ชฉ์ ๋ฌธ๋งฅ์ผ๋ก ์ฌ์ฉํ๋ค.",
|
| 68 |
+
"yes_no": "๋ฌธ๋จ์ ๊ทผ๊ฑฐํ์ฌ ์ง๋ฌธ์ ์/์๋์ค๋ก ๋ตํ๋ค.",
|
| 69 |
+
"same_meaning": "๋ ๋ฌธ๋งฅ์์ ํ์๋ ๋จ์ด์ ์๋ฏธ๊ฐ ๊ฐ์์ง ํ๋จํ๋ค.",
|
| 70 |
+
"similar": "๋ ๋ฌธ์ฅ์ ์๋ฏธ๊ฐ ๊ฐ์์ง ํ๋จํ๋ค. ํํ์ด ๋ฌ๋ผ๋ ์ ๋ฌํ๋ ๋ด์ฉ์ด ๊ฐ์ผ๋ฉด ๊ฐ์ ์๋ฏธ๋ค.",
|
| 71 |
+
"reading": "์ง๋ฌธ์ ๊ทผ๊ฑฐํ์ฌ ์ง๋ฌธ์ ๋ต์ ๊ณ ๋ฅธ๋ค. ๋ถ์ ์ง๋ฌธ์ ์ฃผ์ํ๋ค.",
|
| 72 |
+
"next_action": ("๋ค์ ํ ๋จ๊ณ์ ํ๋์ ์ ํํ๋ค. CALL:<name>: ์ ๊ณต๋ ๋๊ตฌ๋ก ์์ฒญ์ ์ฒ๋ฆฌํ ์ ์๊ณ ํ์ํ ํ์ ์ธ์๊ฐ ๋ํ์ ๋ชจ๋ ์๋ค. "
|
| 73 |
+
"ASK: ๊ด๋ จ ๋๊ตฌ๋ ์์ผ๋ ํ์ ์ธ์๊ฐ ๋ถ์กฑํด ์ง๋ฌธ์ด ํ์ํ๋ค. RESPOND: ๋๊ตฌ๊ฐ ๋ถํ์ํ ์ค๋ช
/์๋ฃ ์๋ด ๋๋ ์ ๊ณต ๋๊ตฌ๋ก ์ง์ํ์ง ์๋ ์์ฒญ์ ๋ํ ์๋ด. "
|
| 74 |
+
"์ค์ ๋๊ตฌ ์คํยท์ธ์ ์์ฑ์ ํ์ง ์๋๋ค. ๊ณผ๊ฑฐ ๋๊ตฌ ๊ฒฐ๊ณผ๋ฅผ ํ์ฉํ๊ณ ํ์ฌ ์ ๋ต์ด๋ ๋ฏธ๋ ํด์ ์ถ์ธกํ์ง ์๋๋ค. "
|
| 75 |
+
"๋๊ตฌ schema๊ฐ ํ์ ๊ฐ์ ๊ธฐ๋ณธ๊ฐยท๋ฌธ๋งฅ ์ถ๋ก ยท๋ช
์นญ ์์ฑ์ ๋ช
์์ ์ผ๋ก ํ์ฉํ๋ฉด ๊ทธ ์ ์๋ฅผ ๋ฐ๋ฅธ๋ค. ๊ทผ๊ฑฐ ์๋ ๊ฐ์ ๋ง๋๋ ๊ฒ๊ณผ ๋๊ตฌ ์ ์๊ฐ ํ์ฉํ๋ ๊ฐ์ ๋์ถํ๋ ๊ฒ์ ๊ตฌ๋ณํ๋ค. "
|
| 76 |
+
"ํ์ฌ๊น์ง์ ๋๊ตฌ ๊ฒฐ๊ณผ๋ก ์์ฒญ์ด ํด๊ฒฐ๋์ผ๋ฉด ๊ฒฐ๊ณผ ์๋ด๊ฐ ๋ค์ ํ๋์ด๋ฉฐ ๊ฐ์ ๋๊ตฌ๋ฅผ ๋ฐ๋ณต ํธ์ถํ์ง ์๋๋ค."),
|
| 77 |
+
"policy_action": ("๋ช
์๋ ์ ์ฑ
๊ณผ ์์ธ์ ์กฐ๊ฑด์ ๋ฐ๋ผ ๋ค์ ํ๋์ ๊ณ ๋ฅธ๋ค. ์์ธ๋ ์ฐ์ธ ์ ์ฉ ์กฐ๊ฑด์ ๋ง์กฑํ ๋๋ง ๊ธฐ๋ณธ ๊ท์น์ ๋ฎ์ด์ด๋ค. ๋ช
์๋์ง ์์ ์ค์ ๊ธ์ต ์ค๋ฌด ์๊ฑด์ ์ถ๊ฐํ์ง ์๋๋ค. "
|
| 78 |
+
"ASK_CLARIFICATION๊ณผ ASK_CONFIRMATION์ ๊ตฌ๋ณํ๋ค. ๋จผ์ ๊ธฐ๋ณธ ๊ท์น์ ์ ์ฉ ์กฐ๊ฑด๊ณผ ์์ธ์ ์ ์ฉ ์กฐ๊ฑด์ ๊ฐ๊ฐ ํ์ธํ๋ค. "
|
| 79 |
+
"์กฐ๊ฑด์ ๋ง์กฑํ๋ ๋ช
์์ ํ๋ ์ง์๋ฅผ ์ฐ์ ํ๋ฉฐ, ๊ณ ๊ฐ ๋ฌธ์ฅ์ด ์ง๋ฌธ ํํ๋ผ๋ ์ด์ ๋ก ์ด๋ฅผ ๋ฌด์ํ์ง ์๋๋ค. ์กฐ๊ฑด์ด ๋ง์ง ์๋ ์์ธ๋ ์ ์ฉํ์ง ์๋๋ค. "
|
| 80 |
+
"์ ์ฑ
์ ๋ณ๋ ํ๋ ์ง์๊ฐ ์์ผ๋ฉด ์ฃผ์ด์ง ํ๋ ์ ์์ ์ค์ ์์ฒญ์ ๋ง์ถฐ ํ๋จํ๋ค. ์ ์ฑ
ยท์ผ๋ฐ ์ฌ์ค ์ค๋ช
๊ณผ ์ธ๋ถ ๊ณ์ข ์ ๋ณด ์กฐํ๋ฅผ ๊ตฌ๋ณํ๋ค. "
|
| 81 |
+
"๋ช
์๋ ํ๋์ ๊ณ ๋ฅด๋ ์ถ์ ๊ณผ์ ์ด๋ฏ๋ก ์ค์ ๋๊ตฌ ์คํค๋ง๋ ๊ณ์ข ์ธ์ฆ ์ ์ฐจ๋ฅผ ์ถ๊ฐ๋ก ์๊ตฌํ์ง ์๋๋ค. ๋จ, ์๋ณธ์ ์๋ ๊ธฐ๋ณธ ํ๋์ด๋ ์ ์ฑ
์ ์๋ก ๋ง๋ค์ง ์๋๋ค."),
|
| 82 |
+
}
|
| 83 |
+
# ๊ณผ์ ๋ณ ๋ณด๊ธฐ โ {๋๋ ค์ค ID: ๋ชจ๋ธ์๊ฒ ๋ณด์ฌ ์ค ๋ณด๊ธฐ ๋ฌธ๊ตฌ}
|
| 84 |
+
CRITERIA = {
|
| 85 |
+
"sentiment": {"๊ธ์ ": "๊ธ์ ์ ๊ฐ์ ", "๋ถ์ ": "๋ถ์ ์ ๊ฐ์ "},
|
| 86 |
+
"nli": {"entailment": "entailment", "contradiction": "contradiction", "neutral": "neutral"},
|
| 87 |
+
"topic": {k: k for k in ["์ฌํ", "IT๊ณผํ", "์ธ๊ณ", "์ํ๋ฌธํ", "์ ์น", "์คํฌ์ธ ", "๊ฒฝ์ "]},
|
| 88 |
+
"hate": {"๋นํ์ค": "๋นํ์ค: ๋นํยท๊ณต๊ฒฉ์ฑ์ด ์๋ ํํ", "ํ์ค": "ํ์คยท๋นํยท๊ณต๊ฒฉ์ ํํ"},
|
| 89 |
+
"offensive": {"์์": "ํ์คยท๋ชจ์ยท๋ถ์พ ํํ ์์",
|
| 90 |
+
"๊ณต๊ฒฉ์ ": "๋ฌด๋กยท๊ณต๊ฒฉยท๋น๊ผผ ๋ฑ ๋ถ์พํ์ง๋ง ๊ฐํ ํ์ค/๋ชจ์ ์์ค์ ์๋",
|
| 91 |
+
"ํ์ค": "๊ฐ์ธ/์ง๋จ์ ๋ํ ๊ฐํ ํ์ค ๋๋ ์ฌํ์ ์ง์๋ฅผ ์ฌํ๊ฒ ํผ์ํ๋ ๋ชจ์; ์ฑํฌ๋กฑ ํฌํจ"},
|
| 92 |
+
"yes_no": {"์": "์", "์๋์ค": "์๋์ค"},
|
| 93 |
+
"same_meaning": {"๊ฐ์": "๊ฐ์ ์๋ฏธ", "๋ค๋ฆ": "์๋ก ๋ค๋ฅธ ์๋ฏธ"},
|
| 94 |
+
"similar": {"๊ฐ์": "๊ฐ์ ์๋ฏธ", "๋ค๋ฆ": "๋ค๋ฅธ ์๋ฏธ"},
|
| 95 |
+
"policy_action": {"ASK_CLARIFICATION": "ASK_CLARIFICATION: ๋ถ์กฑํ ์ ๋ณด๋ฅผ ๊ณ ๊ฐ์๊ฒ ๋๋ฌป๋๋ค",
|
| 96 |
+
"ASK_CONFIRMATION": "ASK_CONFIRMATION: ์คํ ์ ์ ๋ช
์์ ํ์ธยท๋์๋ฅผ ๋ฐ๋๋ค",
|
| 97 |
+
"ANSWER": "ANSWER: ๋๊ตฌ ํธ์ถ์ด๋ ์คํ ์์ด ์ ์ฑ
ยท์ฌ์ค ์ ๋ณด๋ก ๋ตํ๋ค",
|
| 98 |
+
"CALL_TOOL": "CALL_TOOL: ๋๊ตฌ ํ๋๋ก ์คํํ๊ฑฐ๋ ์กฐํํ๋ค",
|
| 99 |
+
"CALL_MULTIPLE_TOOLS": "CALL_MULTIPLE_TOOLS: ๋ ์ด์์ ๋๊ตฌ๋ฅผ ์ฐจ๋ก๋ก ํธ์ถํ๋ค",
|
| 100 |
+
"ESCALATE": "ESCALATE: ์๋ ์ฒ๋ฆฌ๋ฅผ ๋ฉ์ถ๊ณ ์ฌ๋ ์๋ด์ฌ์๊ฒ ๋๊ธด๋ค",
|
| 101 |
+
"REFUSE": "REFUSE: ์์ฒญ์ ์ดํํ์ง ์๊ณ ์ฌ์ ๋ฅผ ์๋ดํ๋ค"},
|
| 102 |
+
}
|
| 103 |
+
ASK = "ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ"
|
| 104 |
+
RESPOND = "RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด"
|
| 105 |
|
| 106 |
|
| 107 |
def render_prompt(instruction, item, choices):
|
| 108 |
+
if isinstance(item, str):
|
| 109 |
+
item = {"text": item}
|
| 110 |
lines = [f"{k}: {v if isinstance(v, str) else json.dumps(v, ensure_ascii=False)}" for k, v in item.items()]
|
| 111 |
opts = "\n".join(f"{chr(65 + i)}. {c}" for i, c in enumerate(choices))
|
| 112 |
+
return "\n\n".join([(instruction or DEFAULT_INSTRUCTION).strip(), "\n".join(lines), "๋ณด๊ธฐ:\n" + opts, HINT])
|
| 113 |
|
| 114 |
|
| 115 |
def chat_prefix(prompt):
|
| 116 |
return f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
|
| 117 |
|
| 118 |
|
| 119 |
+
def check_choices(choices):
|
| 120 |
+
choices = [c["text"] if isinstance(c, dict) else str(c) for c in choices]
|
| 121 |
+
if not 2 <= len(choices) <= 26:
|
| 122 |
+
raise ValueError(f"๋ณด๊ธฐ๋ 2~26๊ฐ์ฌ์ผ ํฉ๋๋ค (์ง๊ธ {len(choices)}๊ฐ)")
|
| 123 |
+
if len(set(choices)) != len(choices):
|
| 124 |
+
raise ValueError("๋ณด๊ธฐ ๋ฌธ๊ตฌ๊ฐ ๊ฒน์นฉ๋๋ค. ๋ณด๊ธฐ๋ง๋ค ๋ค๋ฅธ ๋ฌธ๊ตฌ๋ฅผ ์จ ์ฃผ์ธ์")
|
| 125 |
+
return choices
|
| 126 |
+
|
| 127 |
+
|
| 128 |
+
def load_temperature(model):
|
| 129 |
p = Path(model) / "calibration.json"
|
| 130 |
if not p.is_file():
|
| 131 |
try:
|
| 132 |
from huggingface_hub import hf_hub_download
|
| 133 |
p = Path(hf_hub_download(model, "calibration.json"))
|
| 134 |
except Exception:
|
| 135 |
+
warnings.warn(f"{model} ์์ calibration.json ์ ์ฐพ์ง ๋ชปํด ๋ณด์ ์์ด(์จ๋ 1.0) ํ๋ฅ ์ ๊ณ์ฐํฉ๋๋ค.")
|
| 136 |
return 1.0
|
| 137 |
return float(json.loads(p.read_text(encoding="utf-8"))["temperature"])
|
| 138 |
|
| 139 |
|
| 140 |
+
def letter_ids(tokenizer):
|
| 141 |
+
return [tokenizer.encode(chr(65 + i), add_special_tokens=False)[0] for i in range(26)]
|
| 142 |
+
|
| 143 |
+
|
| 144 |
+
def as_result(ids, probs):
|
| 145 |
+
"""๋ณด๊ธฐ ์์์ ํ๋ฅ โ {'choice', 'confidence', 'probabilities'}"""
|
| 146 |
+
b = max(range(len(probs)), key=probs.__getitem__)
|
| 147 |
+
return {"choice": ids[b], "confidence": round(probs[b], 4), "probabilities": {i: round(p, 4) for i, p in zip(ids, probs)}}
|
| 148 |
+
|
| 149 |
+
|
| 150 |
+
def _criteria(criteria):
|
| 151 |
+
"""{ID: ์ค๋ช
} ๋๋ [์ค๋ช
, โฆ] โ (ID ๋ชฉ๋ก, ์ค๋ช
๋ชฉ๋ก). ๋ฆฌ์คํธ๋ฉด ์ค๋ช
์ด ๊ณง ID."""
|
| 152 |
+
if isinstance(criteria, dict):
|
| 153 |
+
return [str(k) for k in criteria], check_choices(list(criteria.values()))
|
| 154 |
+
texts = check_choices(criteria)
|
| 155 |
+
return texts, texts
|
| 156 |
+
|
| 157 |
+
|
| 158 |
+
def _rows(**fields):
|
| 159 |
+
"""๊ฐ์ด ๋ชจ๋ ๋ฌธ์์ด์ด๋ฉด ํญ๋ชฉ ํ๋, ๋ชจ๋ ๊ฐ์ ๊ธธ์ด์ ๋ฆฌ์คํธ๋ฉด ํญ๋ชฉ ์ฌ๋ฌ ๊ฐ."""
|
| 160 |
+
vals = list(fields.values())
|
| 161 |
+
if all(isinstance(v, list) for v in vals):
|
| 162 |
+
if len({len(v) for v in vals}) != 1:
|
| 163 |
+
raise ValueError("๋ฆฌ์คํธ๋ก ์ฌ๋ฌ ๊ฐ๋ฅผ ๋ฃ์ ๋๋ ๊ธธ์ด๊ฐ ๊ฐ์์ผ ํฉ๋๋ค")
|
| 164 |
+
return [dict(zip(fields, row)) for row in zip(*vals)], True
|
| 165 |
+
return dict(fields), False
|
| 166 |
+
|
| 167 |
+
|
| 168 |
+
def _tool_name(t):
|
| 169 |
+
return (t.get("function") or t)["name"] if isinstance(t, dict) else str(t)
|
| 170 |
+
|
| 171 |
+
|
| 172 |
+
class Tasks:
|
| 173 |
+
"""JEV ํ์ decide() ์ ์์ฃผ ์ฐ๋ ํ์ . self(์ํฉ, choices=โฆ, instruction=โฆ) ๋ง ์์ผ๋ฉด ๋๋ค (Judge ์ pipeline ์ด ํจ๊ป ์ด๋ค)."""
|
| 174 |
+
|
| 175 |
+
def _choose(self, state, criteria, instructions, many=False):
|
| 176 |
+
ids, texts = _criteria(criteria)
|
| 177 |
+
res = self(state, choices=texts, instruction=instructions)
|
| 178 |
+
|
| 179 |
+
def rename(r):
|
| 180 |
+
return as_result(ids, [r["probabilities"][t] for t in texts])
|
| 181 |
+
return [rename(r) for r in res] if many else rename(res)
|
| 182 |
+
|
| 183 |
+
def decide(self, state, questions):
|
| 184 |
+
"""JEV ํ์. state: ์ํฉ(dict ๋๋ ๋ฌธ์ฅ). questions: {์ง๋ฌธ ์ด๋ฆ: {"instructions": ์ง์นจ, "criteria": {ID: ์ค๋ช
}}}.
|
| 185 |
+
โ {์ง๋ฌธ ์ด๋ฆ: {'choice': ID, 'confidence': ํ๋ฅ , 'probabilities': {ID: ํ๋ฅ }}}"""
|
| 186 |
+
out = {}
|
| 187 |
+
for name, q in questions.items():
|
| 188 |
+
if q.get("type", "choice") != "choice":
|
| 189 |
+
raise ValueError(f"'{name}': ์ง์ํ๋ type ์ 'choice' ๋ฟ์
๋๋ค")
|
| 190 |
+
out[name] = self._choose(state, q["criteria"], q.get("instructions"))
|
| 191 |
+
return out
|
| 192 |
+
|
| 193 |
+
def sentiment(self, text):
|
| 194 |
+
"""๊ฐ์ โ ๊ธ์ / ๋ถ์ . ๋ฌธ์ฅ ํ๋ ๋๋ ๋ฆฌ์คํธ."""
|
| 195 |
+
return self._choose(text, CRITERIA["sentiment"], TASKS["sentiment"], isinstance(text, list))
|
| 196 |
+
|
| 197 |
+
def topic(self, headline):
|
| 198 |
+
"""๋ด์ค ์ ๋ชฉ ์ฃผ์ โ ์ฌํ / IT๊ณผํ / ์ธ๊ณ / ์ํ๋ฌธํ / ์ ์น / ์คํฌ์ธ / ๊ฒฝ์ ."""
|
| 199 |
+
rows, many = _rows(headline=headline)
|
| 200 |
+
return self._choose(rows, CRITERIA["topic"], TASKS["topic"], many)
|
| 201 |
+
|
| 202 |
+
def hate(self, text):
|
| 203 |
+
"""ํ์คยท๋นํ ํํ ์ฌ๋ถ โ ๋นํ์ค / ํ์ค."""
|
| 204 |
+
return self._choose(text, CRITERIA["hate"], TASKS["hate"], isinstance(text, list))
|
| 205 |
+
|
| 206 |
+
def offensive(self, comment, news_title=None):
|
| 207 |
+
"""๋๊ธ ๊ณต๊ฒฉ์ฑ 3๋จ๊ณ โ ์์ / ๊ณต๊ฒฉ์ / ํ์ค. ๋ด์ค ์ ๋ชฉ์ด ์์ผ๋ฉด ๋ฌธ๋งฅ์ผ๋ก ์ด๋ค."""
|
| 208 |
+
rows, many = _rows(news_title=news_title, comments=comment) if news_title is not None else _rows(comments=comment)
|
| 209 |
+
return self._choose(rows, CRITERIA["offensive"], TASKS["offensive"], many)
|
| 210 |
+
|
| 211 |
+
def nli(self, premise, hypothesis):
|
| 212 |
+
"""๋ฌธ์ฅ ๊ด๊ณ โ entailment / contradiction / neutral."""
|
| 213 |
+
rows, many = _rows(premise=premise, hypothesis=hypothesis)
|
| 214 |
+
return self._choose(rows, CRITERIA["nli"], TASKS["nli"], many)
|
| 215 |
+
|
| 216 |
+
def similar(self, sentence1, sentence2):
|
| 217 |
+
"""๋ ๋ฌธ์ฅ์ด ๊ฐ์ ๋ป์ธ์ง โ ๊ฐ์ / ๋ค๋ฆ."""
|
| 218 |
+
rows, many = _rows(sentence1=sentence1, sentence2=sentence2)
|
| 219 |
+
return self._choose(rows, CRITERIA["similar"], TASKS["similar"], many)
|
| 220 |
+
|
| 221 |
+
def yes_no(self, question, passage):
|
| 222 |
+
"""์ง๋ฌธ์ ๊ทผ๊ฑฐํ ์/์๋์ค โ ์ / ์๋์ค."""
|
| 223 |
+
rows, many = _rows(paragraph=passage, question=question)
|
| 224 |
+
return self._choose(rows, CRITERIA["yes_no"], TASKS["yes_no"], many)
|
| 225 |
+
|
| 226 |
+
def same_meaning(self, word, context_1, context_2):
|
| 227 |
+
"""๋ ๋ฌธ๋งฅ์์ ๋จ์ด ๋ป์ด ๊ฐ์์ง โ ๊ฐ์ / ๋ค๋ฆ. ๋ฌธ๋งฅ ์์ ๋จ์ด๋ [๋จ์ด]๋ก ํ์ํ๋ฉด ์ข๋ค."""
|
| 228 |
+
rows, many = _rows(word=word, context_1=context_1, context_2=context_2)
|
| 229 |
+
return self._choose(rows, CRITERIA["same_meaning"], TASKS["same_meaning"], many)
|
| 230 |
+
|
| 231 |
+
def reading(self, passage, question, choices):
|
| 232 |
+
"""์ง๋ฌธ ๋
ํด ๊ฐ๊ด์ โ ๋ณด๊ธฐ ์ค ํ๋ (๋ฆฌ์คํธ๋ฉด ๋ณด๊ธฐ ๋ฌธ๊ตฌ, dict ๋ฉด ID)."""
|
| 233 |
+
return self._choose({"passage": passage, "question": question}, choices, TASKS["reading"])
|
| 234 |
+
|
| 235 |
+
def next_action(self, messages, tools):
|
| 236 |
+
"""์์ด์ ํธ์ ๋ค์ ํ๋ โ CALL:<๋๊ตฌ ์ด๋ฆ> / ASK (ํ์ ์ ๋ณด ๋ถ์กฑ) / RESPOND (์ง์ ๋ต๋ณ).
|
| 237 |
+
messages: ์ฌ์ฉ์ ๋ฌธ์ฅ(str) ๋๋ [{"role", "content"}, โฆ]. tools: OpenAI ํ์ ๋๊ตฌ ๋ชฉ๋ก ๋๋ ์ด๋ฆ ๋ชฉ๋ก."""
|
| 238 |
+
if isinstance(messages, str):
|
| 239 |
+
messages = [{"role": "user", "content": messages}]
|
| 240 |
+
criteria = {f"CALL:{_tool_name(t)}": f"CALL:{_tool_name(t)}" for t in tools} | {"ASK": ASK, "RESPOND": RESPOND}
|
| 241 |
+
return self._choose({"messages": messages, "tools": tools}, criteria, TASKS["next_action"])
|
| 242 |
+
|
| 243 |
+
def policy_action(self, policy, request):
|
| 244 |
+
"""์ ์ฑ
์ ๋ฐ๋ฅธ ํ๋ โ ASK_CLARIFICATION / ASK_CONFIRMATION / ANSWER / CALL_TOOL / CALL_MULTIPLE_TOOLS / ESCALATE / REFUSE."""
|
| 245 |
+
text = f"์ ์ฑ
: {policy}\n\n๊ณ ๊ฐ ์์ฒญ: \"{request}\"\n์ ์ ์ฑ
์ ๋ฐ๋ผ ์ฌ๋ฐ๋ฅด๊ฒ ์ฒ๋ฆฌํ๋ผ."
|
| 246 |
+
return self._choose({"policy_and_request": text}, CRITERIA["policy_action"], TASKS["policy_action"])
|
| 247 |
+
|
| 248 |
+
|
| 249 |
+
class Judge(Tasks):
|
| 250 |
+
def __init__(self, model=REPO, device=None, dtype=None):
|
| 251 |
device = device or ("cuda" if torch.cuda.is_available() else "cpu")
|
| 252 |
dtype = dtype or (torch.bfloat16 if device != "cpu" else torch.float32)
|
| 253 |
self.tok = AutoTokenizer.from_pretrained(model)
|
| 254 |
self.model = AutoModelForCausalLM.from_pretrained(model, dtype=dtype).to(device).eval()
|
| 255 |
self.device = device
|
| 256 |
+
self.temperature = load_temperature(model)
|
| 257 |
+
self.letter_ids = letter_ids(self.tok)
|
| 258 |
|
| 259 |
+
def __call__(self, inputs, choices, instruction=None):
|
| 260 |
+
"""inputs: ๋ฌธ์ฅ(str) ยท ์ํฉ(dict) ยท ๊ทธ ๋ฆฌ์คํธ. choices: [์ค๋ช
, โฆ] ๋๋ {ID: ์ค๋ช
}. ๋ฆฌ์คํธ๋ฅผ ์ฃผ๋ฉด ๊ฒฐ๊ณผ๋ ๋ฆฌ์คํธ."""
|
| 261 |
+
many = isinstance(inputs, list)
|
| 262 |
+
ids, texts = _criteria(choices)
|
| 263 |
+
out = self.decide_batch([{"instruction": instruction, "item": x, "choices": texts} for x in (inputs if many else [inputs])])
|
| 264 |
+
res = [as_result(ids, [r["probs"][chr(65 + i)] for i in range(len(texts))]) for r in out]
|
| 265 |
+
return res if many else res[0]
|
| 266 |
|
| 267 |
@torch.no_grad()
|
| 268 |
def decide_batch(self, requests, batch_size=16, max_tokens=8000):
|
| 269 |
+
"""์ ์์ค ๋ฌถ์ ํ์ (ํ๊ฐ ์คํฌ๋ฆฝํธ์ฉ).
|
| 270 |
+
requests: [{"instruction": str, "item": dict|str, "choices": [str, โฆ]}, โฆ] โ ๊ฐ์ ์์์ ๊ฒฐ๊ณผ ๋ชฉ๋ก.
|
| 271 |
+
๊ฒฐ๊ณผ: {'choice': 'A', 'index': 0, 'text': ๋ณด๊ธฐ, 'confidence': ํ๋ฅ , 'probs': {'A': โฆ, 'B': โฆ}}
|
| 272 |
+
๊ธธ์ด๊ฐ ๋น์ทํ ๊ฒ๋ผ๋ฆฌ ๋ฌถ์ด ๊ณ์ฐํ๋ค (์ค๋ฅธ์ชฝ์ ์ฑ์ฐ๊ณ ๊ฐ ๋ฌธ์ฅ์ ๋ง์ง๋ง ์๋ฆฌ๋ง ์ฝ์ผ๋ฏ๋ก ๊ฒฐ๊ณผ๋ ํ๋์ฉ ๊ณ์ฐํ ๊ฒ๊ณผ ๊ฐ๋ค)."""
|
| 273 |
seqs = []
|
| 274 |
for r in requests:
|
| 275 |
+
ch = check_choices(r["choices"])
|
| 276 |
+
ids = self.tok.encode(chat_prefix(render_prompt(r.get("instruction"), r["item"], ch)), add_special_tokens=False)
|
| 277 |
+
seqs.append((ids, ch))
|
|
|
|
| 278 |
order = sorted(range(len(seqs)), key=lambda i: len(seqs[i][0]))
|
| 279 |
out = [None] * len(seqs)
|
| 280 |
W = self.model.get_output_embeddings().weight
|
|
|
|
| 292 |
for r, k in enumerate(grp):
|
| 293 |
ids, ch = seqs[k]
|
| 294 |
rows = torch.tensor(self.letter_ids[:len(ch)], device=self.device)
|
| 295 |
+
p = torch.softmax((h[r, len(ids) - 1].float() @ W[rows].float().T) / self.temperature, -1).tolist()
|
|
|
|
| 296 |
b = max(range(len(p)), key=p.__getitem__)
|
| 297 |
out[k] = {"choice": chr(65 + b), "index": b, "text": ch[b], "confidence": round(p[b], 4),
|
| 298 |
"probs": {chr(65 + j): round(v, 4) for j, v in enumerate(p)}}
|
| 299 |
return out
|
| 300 |
|
|
|
|
|
|
|
|
|
|
| 301 |
|
| 302 |
if __name__ == "__main__":
|
| 303 |
import sys
|
| 304 |
j = Judge(sys.argv[1] if len(sys.argv) > 1 else ".")
|
| 305 |
+
print(j.sentiment("๋ฐฐ์ก์ ๋๋ ธ์ง๋ง ๋ฌผ๊ฑด์ ์ ๋ง ๋ง์์ ๋ค์ด์"))
|
judge_pipeline.py
ADDED
|
@@ -0,0 +1,52 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
"""transformers pipeline ์ผ๋ก KJH-Judge-4B-ko ๋ฅผ ์ด๋ค (trust_remote_code=True ์ผ ๋ ์๋์ผ๋ก ๋ถ๋ฆฐ๋ค).
|
| 2 |
+
|
| 3 |
+
from transformers import pipeline
|
| 4 |
+
judge = pipeline(model="coderecode95/KJH-Judge-4B-ko", trust_remote_code=True, device=0, dtype="bfloat16")
|
| 5 |
+
|
| 6 |
+
judge.decide(state={...}, questions={"์ด๋ฆ": {"instructions": "โฆ", "criteria": {"ID": "์ค๋ช
", โฆ}}}) # JEV ํ์
|
| 7 |
+
judge.sentiment("๋ฐฐ์ก์ ๋๋ ธ์ง๋ง ๋ฌผ๊ฑด์ ์ ๋ง ๋ง์์ ๋ค์ด์") # ์์ฃผ ์ฐ๋ ํ์
|
| 8 |
+
judge("์ง๋๋ฌ ์๊ธ์ด ๋ ๋ฒ ๋น ์ ธ๋๊ฐ์ด์", choices=["๊ฒฐ์ ยทํ๋ถ", "๋ฐฐ์ก", "๊ธฐํ"], instruction="โฆ") # ํ ์ค๋ก
|
| 9 |
+
# ๊ฒฐ๊ณผ๋ ๋ชจ๋ {'choice': โฆ, 'confidence': โฆ, 'probabilities': {โฆ}}
|
| 10 |
+
|
| 11 |
+
์ฌ์ฉ๋ฒ ์ ์ฒด๋ judge.py ๋งจ ์ ์ค๋ช
์ ๋ณด์ธ์.
|
| 12 |
+
"""
|
| 13 |
+
import torch
|
| 14 |
+
from transformers import Pipeline
|
| 15 |
+
|
| 16 |
+
from .judge import Tasks, _criteria, as_result, chat_prefix, letter_ids, load_temperature, render_prompt
|
| 17 |
+
|
| 18 |
+
|
| 19 |
+
class KJHJudgePipeline(Tasks, Pipeline):
|
| 20 |
+
def __init__(self, *args, **kwargs):
|
| 21 |
+
super().__init__(*args, **kwargs)
|
| 22 |
+
self.temperature = load_temperature(self.model.name_or_path)
|
| 23 |
+
self.letter_ids = letter_ids(self.tokenizer)
|
| 24 |
+
|
| 25 |
+
def _sanitize_parameters(self, choices=None, instruction=None, **kwargs):
|
| 26 |
+
pre, post = {}, {}
|
| 27 |
+
if choices is not None:
|
| 28 |
+
post["ids"], pre["choices"] = _criteria(choices)
|
| 29 |
+
if instruction is not None:
|
| 30 |
+
pre["instruction"] = instruction
|
| 31 |
+
return pre, {}, post
|
| 32 |
+
|
| 33 |
+
def preprocess(self, inputs, choices=None, instruction=None):
|
| 34 |
+
if choices is None:
|
| 35 |
+
raise ValueError("choices=[๋ณด๊ธฐ1, ๋ณด๊ธฐ2, โฆ] ๋๋ {ID: ์ค๋ช
} ์ ๋ฃ์ด ์ฃผ์ธ์")
|
| 36 |
+
enc = self.tokenizer(chat_prefix(render_prompt(instruction, inputs, choices)), add_special_tokens=False, return_tensors="pt")
|
| 37 |
+
return {"input_ids": enc["input_ids"], "attention_mask": enc["attention_mask"]}
|
| 38 |
+
|
| 39 |
+
def _forward(self, model_inputs):
|
| 40 |
+
mask = model_inputs["attention_mask"]
|
| 41 |
+
h = self.model.model(input_ids=model_inputs["input_ids"], attention_mask=mask).last_hidden_state
|
| 42 |
+
if self.tokenizer.padding_side == "left":
|
| 43 |
+
last = h[:, -1]
|
| 44 |
+
else:
|
| 45 |
+
last = h[torch.arange(h.size(0), device=h.device), mask.sum(-1) - 1]
|
| 46 |
+
W = self.model.get_output_embeddings().weight
|
| 47 |
+
rows = torch.tensor(self.letter_ids, device=h.device)
|
| 48 |
+
return {"logits": last.float() @ W[rows].float().T}
|
| 49 |
+
|
| 50 |
+
def postprocess(self, model_outputs, ids=None):
|
| 51 |
+
scores = model_outputs["logits"].reshape(-1)[:len(ids)].float() / self.temperature
|
| 52 |
+
return as_result(ids, torch.softmax(scores, -1).tolist())
|
quickstart.ipynb
ADDED
|
@@ -0,0 +1,204 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"cells": [
|
| 3 |
+
{
|
| 4 |
+
"cell_type": "markdown",
|
| 5 |
+
"metadata": {},
|
| 6 |
+
"source": [
|
| 7 |
+
"# KJH-Judge-4B-ko ๋น ๋ฅธ ํ
์คํธ\n",
|
| 8 |
+
"\n",
|
| 9 |
+
"ํ๊น
ํ์ด์ค์ ์ฌ๋ฆฐ ๋ชจ๋ธ์ ๋ด๋ ค๋ฐ์ ํ์ ํด ๋ด
๋๋ค.\n",
|
| 10 |
+
"\n",
|
| 11 |
+
"- **GPU ๋ฐํ์**์์ ์คํํ์ธ์ (Colab: ๋ฐํ์ โ ๋ฐํ์ ์ ํ ๋ณ๊ฒฝ โ T4 GPU). CPU์์๋ ํ์ ํ ๋ฒ์ ์์ญ ์ด ์ด์ ๊ฑธ๋ฆฌ๊ณ ๋ฉ๋ชจ๋ฆฌ๋ 16GB ๋๊ฒ ํ์ํฉ๋๋ค.\n",
|
| 12 |
+
"- ๋ชจ๋ธ ๋ด๋ ค๋ฐ๊ธฐ์ ๋ช ๋ถ ๊ฑธ๋ฆฝ๋๋ค (์ฝ 8GB).\n",
|
| 13 |
+
"- ๊ฒฐ๊ณผ๋ ๋ชจ๋ `{'choice': ๊ณ ๋ฅธ ๋ณด๊ธฐ, 'confidence': ๊ทธ ํ๋ฅ , 'probabilities': ๋ณด๊ธฐ๋ณ ํ๋ฅ }` ๋ชจ์์
๋๋ค."
|
| 14 |
+
]
|
| 15 |
+
},
|
| 16 |
+
{
|
| 17 |
+
"cell_type": "code",
|
| 18 |
+
"execution_count": null,
|
| 19 |
+
"metadata": {},
|
| 20 |
+
"outputs": [],
|
| 21 |
+
"source": [
|
| 22 |
+
"%pip install -q -U \"transformers>=5\" accelerate\n",
|
| 23 |
+
"# Colab์์ transformers ๊ฐ ์ด๋ฏธ 4.x ๋ก ๊น๋ ค ์์๋ค๋ฉด, ์ค์น ํ '๋ฐํ์ โ ์ธ์
๋ค์ ์์'์ ํ ๋ฒ ํ๊ณ ์๋ ์
๋ถํฐ ์คํํ์ธ์."
|
| 24 |
+
]
|
| 25 |
+
},
|
| 26 |
+
{
|
| 27 |
+
"cell_type": "markdown",
|
| 28 |
+
"metadata": {},
|
| 29 |
+
"source": [
|
| 30 |
+
"์ ์ฅ์๊ฐ **๋น๊ณต๊ฐ**๋ผ๋ฉด ์๋ ์
์ ์ฃผ์์ ํ๊ณ ํ ํฐ์ผ๋ก ๋ก๊ทธ์ธํ์ธ์ (Colab์ ์ผ์ชฝ ์ด์ ์์ด์ฝ์ ๋ณด์ ๋น๋ฐ์ `HF_TOKEN`์ ๋ฃ์ด ๋๋ฉด ์๋์ผ๋ก ์๋๋ค)."
|
| 31 |
+
]
|
| 32 |
+
},
|
| 33 |
+
{
|
| 34 |
+
"cell_type": "code",
|
| 35 |
+
"execution_count": null,
|
| 36 |
+
"metadata": {},
|
| 37 |
+
"outputs": [],
|
| 38 |
+
"source": [
|
| 39 |
+
"# from huggingface_hub import login\n",
|
| 40 |
+
"# login()"
|
| 41 |
+
]
|
| 42 |
+
},
|
| 43 |
+
{
|
| 44 |
+
"cell_type": "code",
|
| 45 |
+
"execution_count": null,
|
| 46 |
+
"metadata": {},
|
| 47 |
+
"outputs": [],
|
| 48 |
+
"source": [
|
| 49 |
+
"import torch\n",
|
| 50 |
+
"from transformers import pipeline\n",
|
| 51 |
+
"\n",
|
| 52 |
+
"gpu = torch.cuda.is_available()\n",
|
| 53 |
+
"print(\"GPU:\", torch.cuda.get_device_name(0) if gpu else \"์์ (CPU, ๋งค์ฐ ๋๋ฆผ)\")\n",
|
| 54 |
+
"\n",
|
| 55 |
+
"judge = pipeline(model=\"coderecode95/KJH-Judge-4B-ko\", trust_remote_code=True,\n",
|
| 56 |
+
" device=0 if gpu else -1, dtype=\"bfloat16\" if gpu else \"float32\")"
|
| 57 |
+
]
|
| 58 |
+
},
|
| 59 |
+
{
|
| 60 |
+
"cell_type": "markdown",
|
| 61 |
+
"metadata": {},
|
| 62 |
+
"source": [
|
| 63 |
+
"## 1. ์์ฃผ ์ฐ๋ ํ์ โ ๋ฉ์๋ ํ๋๋ก\n",
|
| 64 |
+
"\n",
|
| 65 |
+
"ํ์ต ๋์ ๊ฐ์ ์ง์นจยท๋ณด๊ธฐ๊ฐ ์๋์ผ๋ก ๋ค์ด๊ฐ๋๋ค."
|
| 66 |
+
]
|
| 67 |
+
},
|
| 68 |
+
{
|
| 69 |
+
"cell_type": "code",
|
| 70 |
+
"execution_count": null,
|
| 71 |
+
"metadata": {},
|
| 72 |
+
"outputs": [],
|
| 73 |
+
"source": [
|
| 74 |
+
"judge.sentiment(\"๋ฐฐ์ก์ ๋๋ ธ์ง๋ง ๋ฌผ๊ฑด์ ์ ๋ง ๋ง์์ ๋ค์ด์\")"
|
| 75 |
+
]
|
| 76 |
+
},
|
| 77 |
+
{
|
| 78 |
+
"cell_type": "code",
|
| 79 |
+
"execution_count": null,
|
| 80 |
+
"metadata": {},
|
| 81 |
+
"outputs": [],
|
| 82 |
+
"source": [
|
| 83 |
+
"print(judge.nli(\"ํก์ฐ์๋ถ๋ค์ ๋ฐ์ฝ๋๊ฐ ์๋ ๋ฐฉ์ด๋ฉด ๋ฐ์ฝ๋์์ ํก์ฐ์ด ๊ฐ๋ฅํฉ๋๋ค.\", \"์ด๋ค ๋ฐฉ์์๋ ํก์ฐ์ ๊ธ์ง๋ฉ๋๋ค.\"))\n",
|
| 84 |
+
"print(judge.topic(\"์ํฅ๋ฏผ, ์์ฆ 10ํธ๊ณจโฆํ ํธ๋ 3์ฐ์น ์ด๋์ด\"))\n",
|
| 85 |
+
"print(judge.hate(\"์ฐ๊ธฐ ์ง์ง ๋ง์ด ๋์๋ค ๋ค์ ์ํ๋ ๊ธฐ๋๋จ\"))\n",
|
| 86 |
+
"print(judge.yes_no(\"์ฝ๋ผ๋
๋ฆฝ 815๋ ์ฝ์นด์ฝ๋ผ์์ ๋ง๋ค์๋์?\",\n",
|
| 87 |
+
" \"์ฝ๋ผ๋
๋ฆฝ 815๋ ์ฝ์นด์ฝ๋ผ๋ฅผ ๋ผ์ด์ ์ค๋ก ๋ง๋ค์ด ์ค๋ ๋ฒ์์ํ์ด 1998๋
์ ์ถ์ํ ํ์ฐ์๋ฃ๋ค.\"))"
|
| 88 |
+
]
|
| 89 |
+
},
|
| 90 |
+
{
|
| 91 |
+
"cell_type": "code",
|
| 92 |
+
"execution_count": null,
|
| 93 |
+
"metadata": {},
|
| 94 |
+
"outputs": [],
|
| 95 |
+
"source": [
|
| 96 |
+
"# ์์ด์ ํธ์ ๋ค์ ํ๋: ํ์ ์ ๋ณด๊ฐ ๋น ์ก์ผ๋ฉด ASK, ๋ค ์์ผ๋ฉด CALL, ๋๊ตฌ๊ฐ ํ์ ์์ผ๋ฉด RESPOND\n",
|
| 97 |
+
"tools = [\n",
|
| 98 |
+
" {\"type\": \"function\", \"function\": {\"name\": \"call_taxi\", \"description\": \"ํ์๋ฅผ ํธ์ถํ๋ค\",\n",
|
| 99 |
+
" \"parameters\": {\"type\": \"object\", \"properties\": {\"pickup\": {\"type\": \"string\"}, \"destination\": {\"type\": \"string\"}}, \"required\": [\"pickup\", \"destination\"]}}},\n",
|
| 100 |
+
" {\"type\": \"function\", \"function\": {\"name\": \"get_weather\", \"description\": \"์ง์ญ์ ํ์ฌ ๋ ์จ๋ฅผ ์๋ ค์ค๋ค\",\n",
|
| 101 |
+
" \"parameters\": {\"type\": \"object\", \"properties\": {\"city\": {\"type\": \"string\"}}, \"required\": [\"city\"]}}},\n",
|
| 102 |
+
"]\n",
|
| 103 |
+
"for msg in [\"ํ์ ์ข ๋ถ๋ฌ์ค\", \"๊ฐ๋จ์ญ์์ ์์ธ์ญ๊น์ง ํ์ ๋ถ๋ฌ์ค\", \"๋ถ์ฐ ๋ ์จ ์ด๋?\", \"๊ณ ๋ง์!\"]:\n",
|
| 104 |
+
" r = judge.next_action(msg, tools)\n",
|
| 105 |
+
" print(f\"{r['choice']:<18} {r['confidence']:.1%} โ {msg}\")"
|
| 106 |
+
]
|
| 107 |
+
},
|
| 108 |
+
{
|
| 109 |
+
"cell_type": "code",
|
| 110 |
+
"execution_count": null,
|
| 111 |
+
"metadata": {},
|
| 112 |
+
"outputs": [],
|
| 113 |
+
"source": [
|
| 114 |
+
"# ๋ฆฌ์คํธ๋ฅผ ๋ฃ์ผ๋ฉด ์ฌ๋ฌ ๊ฐ๋ฅผ ํ ๋ฒ์\n",
|
| 115 |
+
"headlines = [\"์ํฅ๋ฏผ, ์์ฆ 10ํธ๊ณจโฆํ ํธ๋ 3์ฐ์น ์ด๋์ด\", \"์ฝ์คํผ 2,700 ๋ํโฆ์ธ๊ตญ์ธ ์๋งค์\", \"์ ์ค๋งํธํฐ ๊ณต๊ฐ, AI ๊ธฐ๋ฅ ๊ฐํ\", \"๊ตญํ ๋ณธํ์์ ์์ฐ์ ํต๊ณผ\"]\n",
|
| 116 |
+
"for h, r in zip(headlines, judge.topic(headlines)):\n",
|
| 117 |
+
" print(f\"{r['choice']:<5} {r['confidence']:.1%} {h}\")"
|
| 118 |
+
]
|
| 119 |
+
},
|
| 120 |
+
{
|
| 121 |
+
"cell_type": "markdown",
|
| 122 |
+
"metadata": {},
|
| 123 |
+
"source": [
|
| 124 |
+
"## 2. ๋ด ํ์ ๋ง๋ค๊ธฐ โ JEV ํ์\n",
|
| 125 |
+
"\n",
|
| 126 |
+
"์ํฉ(`state`) ํ๋์ ์ด๋ฆ ๋ถ์ธ ์ง๋ฌธ ์ฌ๋ฌ ๊ฐ๋ฅผ ํ ๋ฒ์ ๋ฌป์ต๋๋ค. `criteria`์ ํค(ID)๊ฐ ๊ฒฐ๊ณผ๋ก ๋์์ต๋๋ค."
|
| 127 |
+
]
|
| 128 |
+
},
|
| 129 |
+
{
|
| 130 |
+
"cell_type": "code",
|
| 131 |
+
"execution_count": null,
|
| 132 |
+
"metadata": {},
|
| 133 |
+
"outputs": [],
|
| 134 |
+
"source": [
|
| 135 |
+
"judge.decide(\n",
|
| 136 |
+
" state={\"๊ณ ๊ฐ ๋ฌธ์\": \"์ง๋๋ฌ ์๊ธ์ด ๋ ๋ฒ ๋น ์ ธ๋๊ฐ์ด์. ์ค๋ ์์ ์ฒ๋ฆฌํด ์ฃผ์ธ์.\"},\n",
|
| 137 |
+
" questions={\n",
|
| 138 |
+
" \"๋ถ์\": {\n",
|
| 139 |
+
" \"instructions\": \"๊ณ ๊ฐ ๋ฌธ์๋ฅผ ๋ด๋น ๋ถ์๋ก ๋ถ๋ฅํ๋ค.\",\n",
|
| 140 |
+
" \"criteria\": {\"billing\": \"๊ฒฐ์ ยทํ๋ถ\", \"delivery\": \"๋ฐฐ์ก\", \"account\": \"๊ณ์ ยท๋ก๊ทธ์ธ\", \"other\": \"๊ธฐํ\"},\n",
|
| 141 |
+
" },\n",
|
| 142 |
+
" \"๊ธด๊ธ\": {\n",
|
| 143 |
+
" \"instructions\": \"๊ณ ๊ฐ์ด ์ฆ์ ์ฒ๋ฆฌ๋ฅผ ์๊ตฌํ๋์ง ํ๋จํ๋ค.\",\n",
|
| 144 |
+
" \"criteria\": {\"urgent\": \"์ฆ์ ์ฒ๋ฆฌ ์๊ตฌ\", \"normal\": \"์ผ๋ฐ ๋ฌธ์\"},\n",
|
| 145 |
+
" },\n",
|
| 146 |
+
" },\n",
|
| 147 |
+
")"
|
| 148 |
+
]
|
| 149 |
+
},
|
| 150 |
+
{
|
| 151 |
+
"cell_type": "markdown",
|
| 152 |
+
"metadata": {},
|
| 153 |
+
"source": [
|
| 154 |
+
"## 3. ํ์ ์ด ๋ฎ์ผ๋ฉด ์ฌ๋์๊ฒ ๋๊ธฐ๊ธฐ\n",
|
| 155 |
+
"\n",
|
| 156 |
+
"๊ธฐ์ค๊ฐ(์ฌ๊ธฐ์๋ 0.7)์ ์ค์ ๋ก ์ธ ๋ฐ์ดํฐ์์ ๋ค์ ๋ง์ถ๋ ๊ฒ์ด ์ข์ต๋๋ค. ํ์ตํ์ง ์์ ๋ฐ์ดํฐ์์๋ ํ์ ์ด ์ ํ๋๋ณด๋ค ์กฐ๊ธ ๋๊ฒ ๋์ต๋๋ค."
|
| 157 |
+
]
|
| 158 |
+
},
|
| 159 |
+
{
|
| 160 |
+
"cell_type": "code",
|
| 161 |
+
"execution_count": null,
|
| 162 |
+
"metadata": {},
|
| 163 |
+
"outputs": [],
|
| 164 |
+
"source": [
|
| 165 |
+
"reviews = [\"๋ฐฐ์ก ์ฐธ ๋น ๋ฅด๋ค์. 2์ฃผ ๊ฑธ๋ ธ์ด์\", \"๊ฐ๊ฒฉ ๋๋น ๊ด์ฐฎ์์\", \"๋ค์๋ ์ ์ฝ๋๋ค\", \"๊ทธ๋ฅ ๊ทธ๋์\"]\n",
|
| 166 |
+
"for t, r in zip(reviews, judge.sentiment(reviews)):\n",
|
| 167 |
+
" print(f\"{r['choice']} {r['confidence']:.1%} {'์๋ ์ฒ๋ฆฌ' if r['confidence'] >= 0.7 else 'โ ์ฌ๋ ๊ฒํ ':<8} {t}\")"
|
| 168 |
+
]
|
| 169 |
+
},
|
| 170 |
+
{
|
| 171 |
+
"cell_type": "markdown",
|
| 172 |
+
"metadata": {},
|
| 173 |
+
"source": [
|
| 174 |
+
"## 4. ํ ์ค๋ก ์ง์ ํด ๋ณด๊ธฐ"
|
| 175 |
+
]
|
| 176 |
+
},
|
| 177 |
+
{
|
| 178 |
+
"cell_type": "code",
|
| 179 |
+
"execution_count": null,
|
| 180 |
+
"metadata": {},
|
| 181 |
+
"outputs": [],
|
| 182 |
+
"source": [
|
| 183 |
+
"judge(\"์ด ์ฑ ๋ก๊ทธ์ธ์ด ๊ณ์ ์ ๋ผ์. ๋น๋ฐ๋ฒํธ๋ฅผ ๋ฐ๊ฟ๋ ๋๊ฐ์์.\",\n",
|
| 184 |
+
" choices=[\"๊ฒฐ์ ยทํ๋ถ\", \"๋ฐฐ์ก\", \"๊ณ์ ยท๋ก๊ทธ์ธ\", \"์ ํ ๋ฌธ์\", \"๊ธฐํ\"],\n",
|
| 185 |
+
" instruction=\"๊ณ ๊ฐ ๋ฌธ์๋ฅผ ๋ด๋น ๋ถ์๋ก ๋ถ๋ฅํ๋ค.\")"
|
| 186 |
+
]
|
| 187 |
+
}
|
| 188 |
+
],
|
| 189 |
+
"metadata": {
|
| 190 |
+
"accelerator": "GPU",
|
| 191 |
+
"colab": {
|
| 192 |
+
"provenance": []
|
| 193 |
+
},
|
| 194 |
+
"kernelspec": {
|
| 195 |
+
"display_name": "Python 3",
|
| 196 |
+
"name": "python3"
|
| 197 |
+
},
|
| 198 |
+
"language_info": {
|
| 199 |
+
"name": "python"
|
| 200 |
+
}
|
| 201 |
+
},
|
| 202 |
+
"nbformat": 4,
|
| 203 |
+
"nbformat_minor": 0
|
| 204 |
+
}
|
space/README.md
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: KJH-Judge-4B-ko Showreel
|
| 3 |
+
emoji: ๐ฌ
|
| 4 |
+
colorFrom: indigo
|
| 5 |
+
colorTo: blue
|
| 6 |
+
sdk: static
|
| 7 |
+
app_file: index.html
|
| 8 |
+
pinned: false
|
| 9 |
+
license: cc-by-sa-4.0
|
| 10 |
+
models:
|
| 11 |
+
- coderecode95/KJH-Judge-4B-ko
|
| 12 |
+
short_description: ์ค์ ํ์ ๊ฒฐ๊ณผ๋ก ๋ง๋ KJH-Judge-4B-ko ์๊ฐ ์ผ๋ฆด
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# KJH-Judge-4B-ko ์ผ๋ฆด
|
| 16 |
+
|
| 17 |
+
[KJH-Judge-4B-ko](https://huggingface.co/coderecode95/KJH-Judge-4B-ko)๋ฅผ ์๊ฐํ๋ ์ฝ 2๋ถ์ง๋ฆฌ ์๋ ์ฌ์ ํ์ด์ง์
๋๋ค. ํ๋ฉด์ ์ซ์์ ํ์ ์ ๋ชจ๋ ์ด ๋ชจ๋ธ๋ก ๋ฏธ๋ฆฌ ๊ณ์ฐํด ์ ์ฅํ **์ค์ ์ถ๋ ฅ**์ด๋ฉฐ, ํ์ด์ง๊ฐ ๋ชจ๋ธ์ ์ง์ ๋๋ฆฌ์ง๋ ์์ต๋๋ค.
|
| 18 |
+
|
| 19 |
+
- ์กฐ์: `Space` ์ผ์์ ์ง ยท `โ` `โ` ์ฅ๋ฉด ์ด๋ ยท `1`~`0` ์ฅ๋ฉด ๋ฐ๋ก๊ฐ๊ธฐ ยท `R` ์ฒ์๋ถํฐ ยท `C` ์๋ง ยท `H` ์กฐ์๋ฐ ์จ๊น ยท `F` ์ ์ฒดํ๋ฉด
|
| 20 |
+
- ์ฃผ์ ์ต์
: `?s=3` 3๋ฒ ์ฅ๋ฉด๋ถํฐ ยท `?loop=1` ๋ฐ๋ณต ยท `?cap=0` ์๋ง ๋ ยท `?hold=1` ์๋ ๋๊น ๋
|
| 21 |
+
|
| 22 |
+
## ์ฃผ์
|
| 23 |
+
|
| 24 |
+
- ์์ ์ฅ๋ฉด์ ๋ค๋ฅธ ๋ชจ๋ธ ์ ์๋ Korean JEV Benchmark ๊ณต๊ฐ ํ(2026-10-09)์ 0-shot ๊ฒฐ๊ณผ์
๋๋ค. KJH-Judge-4B-ko๋ ๊ฐ์ ์ถ์ฒ ๋ฐ์ดํฐ์ ํ์ต ๋ถํ ๋ก ๋ฏธ์ธ์กฐ์ ํ์ผ๋ฏ๋ก ๊ฐ์ ์กฐ๊ฑด์ ๋น๊ต๊ฐ ์๋๋๋ค.
|
| 25 |
+
- ํ์ ์๊ฐ(์ฝ 0.08์ด)์ GPU 1์ฅ์์ ์๋ฒ ์ ๊ณ์ฐ ์๊ฐ์ด๋ฉฐ ๋คํธ์ํฌ ์๋ณต์ ํฌํจํ์ง ์์ต๋๋ค.
|
| 26 |
+
|
| 27 |
+
## ์ถ์ฒ
|
| 28 |
+
|
| 29 |
+
- ํ๊ตญ์ด ๋ฌธ์ 3๊ฐ: [KoBEST](https://huggingface.co/datasets/skt/kobest_v1) WiCยทCOPA, [KLUE](https://huggingface.co/datasets/klue/klue) YNAT โ CC BY-SA 4.0. ์ด ๋๋ฌธ์ ์ด Space๋ CC BY-SA 4.0์ผ๋ก ๊ณต๊ฐํฉ๋๋ค.
|
| 30 |
+
- ๋ฒค์น๋งํฌ: [Korean JEV Benchmark](https://huggingface.co/datasets/DaehanKim/korean-jev-benchmark)
|
| 31 |
+
- ๊ณ ๊ฐ ๋ฌธ์ยท๋ด์คยท๋ํ ์์๋ ์ง์ ๋ง๋ ๋ฌธ์ฅ์ด๋ฉฐ, ๋ด์ค์ ํ์ฌ๋ ๊ฐ์์
๋๋ค.
|
space/index.html
ADDED
|
@@ -0,0 +1,801 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
<!doctype html>
|
| 2 |
+
<html lang="ko">
|
| 3 |
+
<head>
|
| 4 |
+
<meta charset="utf-8">
|
| 5 |
+
<meta name="viewport" content="width=device-width, initial-scale=1">
|
| 6 |
+
<title>KJH-Judge-4B-ko ์ผ๋ฆด</title>
|
| 7 |
+
<!-- ์์ ์ดฌ์์ฉ ์๋ ์ฌ์ ํ์ด์ง ยท KJH-Judge-4B-ko
|
| 8 |
+
1920ร1080 ๋ฌด๋๋ฅผ ์ฐฝ ํฌ๊ธฐ์ ๋ง์ถฐ ๋๋ฆฌ๊ณ , ์ฅ๋ฉด๋ง๋ค ์ ์ฅ๋ '์ค์ ๋ชจ๋ธ ํ์ ๊ฒฐ๊ณผ'๋ง ์ฌ์ํ๋ค (์๋ฒ ๋ถํ์).
|
| 9 |
+
์กฐ์: Space ์ผ์์ ์ง ยท โ/โ ์ฅ๋ฉด ์ด๋ ยท 1~9,0 ์ฅ๋ฉด ๋ฐ๋ก๊ฐ๊ธฐ ยท R ์ฒ์๋ถํฐ ยท H ์กฐ์๋ฐ ์จ๊น ยท C ์๋ง ยท F ์ ์ฒดํ๋ฉด
|
| 10 |
+
์ฃผ์ ์ต์
: ?s=3 (3๋ฒ ์ฅ๋ฉด๋ถํฐ) ยท ?loop=1 (๋ฐ๋ณต) ยท ?cap=0 (์๋ง ๋) ยท ?clean=1 (์กฐ์๋ฐ ์จ๊ธฐ๊ณ ์์) ยท ?hold=1 (์๋ ๋๊น ๋) ยท ?at=4000 (์ฅ๋ฉด ์ 4์ด ์ง์ ๋ถํฐ) -->
|
| 11 |
+
<link rel="stylesheet" href="https://cdn.jsdelivr.net/gh/orioncactus/pretendard@v1.3.9/dist/web/variable/pretendardvariable-dynamic-subset.min.css">
|
| 12 |
+
<link rel="preconnect" href="https://fonts.googleapis.com"><link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
|
| 13 |
+
<link rel="stylesheet" href="https://fonts.googleapis.com/css2?family=JetBrains+Mono:wght@400;500;600;700&display=swap">
|
| 14 |
+
<style>
|
| 15 |
+
:root{
|
| 16 |
+
--bg:#04060b;--ink:#f4f6fb;--ink2:#cdd3df;--muted:#8b94a7;--faint:#566074;
|
| 17 |
+
--stroke:rgba(255,255,255,.085);--stroke2:rgba(255,255,255,.15);
|
| 18 |
+
--grad:linear-gradient(100deg,#b9a6ff 0%,#72b8ff 48%,#5ff0d2 100%);
|
| 19 |
+
--call:#6aa6ff;--ask:#ffb44d;--respond:#3ee0b0;--good:#4ade80;--bad:#ff6b5e;--hi:#ffd36b;
|
| 20 |
+
--sans:"Pretendard Variable","Pretendard",-apple-system,"Apple SD Gothic Neo","Malgun Gothic",sans-serif;
|
| 21 |
+
--mono:"JetBrains Mono","IBM Plex Mono",Consolas,monospace;
|
| 22 |
+
--ease:cubic-bezier(.2,.8,.2,1);
|
| 23 |
+
}
|
| 24 |
+
*{box-sizing:border-box}
|
| 25 |
+
html,body{margin:0;height:100%;background:#000;overflow:hidden}
|
| 26 |
+
body{color:var(--ink);font-family:var(--sans);-webkit-font-smoothing:antialiased;word-break:keep-all;font-feature-settings:"tnum" 0}
|
| 27 |
+
body.idle{cursor:none}
|
| 28 |
+
|
| 29 |
+
/* โโ ๋ฌด๋ โโ */
|
| 30 |
+
#stage{position:absolute;left:50%;top:50%;width:1920px;height:1080px;transform-origin:center;overflow:hidden;background:var(--bg);isolation:isolate}
|
| 31 |
+
#aurora{position:absolute;inset:0;z-index:0;overflow:hidden}
|
| 32 |
+
#aurora .b{position:absolute;border-radius:50%;filter:blur(150px);opacity:.42;transition:background-color 1.8s ease}
|
| 33 |
+
#aurora .b1{width:1100px;height:900px;left:-320px;top:-380px;animation:d1 22s ease-in-out infinite alternate}
|
| 34 |
+
#aurora .b2{width:1000px;height:900px;right:-360px;top:-200px;animation:d2 26s ease-in-out infinite alternate}
|
| 35 |
+
#aurora .b3{width:1300px;height:700px;left:320px;bottom:-560px;opacity:.3;animation:d3 30s ease-in-out infinite alternate}
|
| 36 |
+
@keyframes d1{to{transform:translate(180px,120px) scale(1.1)}}
|
| 37 |
+
@keyframes d2{to{transform:translate(-160px,160px) scale(.92)}}
|
| 38 |
+
@keyframes d3{to{transform:translate(-200px,-60px) scale(1.08)}}
|
| 39 |
+
#grid{position:absolute;inset:0;z-index:0;background-image:linear-gradient(rgba(255,255,255,.028) 1px,transparent 1px),linear-gradient(90deg,rgba(255,255,255,.028) 1px,transparent 1px);background-size:80px 80px;-webkit-mask-image:radial-gradient(ellipse 70% 60% at 50% 45%,#000 20%,transparent 75%);mask-image:radial-gradient(ellipse 70% 60% at 50% 45%,#000 20%,transparent 75%)}
|
| 40 |
+
#grain{position:absolute;inset:0;z-index:30;pointer-events:none;opacity:.07;mix-blend-mode:overlay;background-image:url("data:image/svg+xml;utf8,<svg xmlns='http://www.w3.org/2000/svg' width='240' height='240'><filter id='n'><feTurbulence type='fractalNoise' baseFrequency='.85' numOctaves='2' stitchTiles='stitch'/></filter><rect width='100%' height='100%' filter='url(%23n)'/></svg>")}
|
| 41 |
+
#vig{position:absolute;inset:0;z-index:29;pointer-events:none;background:radial-gradient(ellipse 85% 80% at 50% 48%,transparent 55%,rgba(0,0,0,.6))}
|
| 42 |
+
#fade{position:absolute;inset:0;z-index:40;background:#000;opacity:0;pointer-events:none}
|
| 43 |
+
|
| 44 |
+
/* โโ ์๋จยทํ๋จ ๊ณ ์ ์์ โโ */
|
| 45 |
+
.chrome{position:absolute;left:80px;right:80px;top:52px;z-index:20;display:flex;align-items:center;gap:18px}
|
| 46 |
+
.brand{display:flex;align-items:center;gap:14px}
|
| 47 |
+
.brand svg{width:44px;height:44px}
|
| 48 |
+
.brand b{font:750 27px/1 var(--sans);letter-spacing:-.03em}
|
| 49 |
+
.brand .pl{padding:6px 11px;border-radius:99px;border:1px solid var(--stroke2);font:600 15px/1 var(--mono);color:var(--ink2);letter-spacing:.04em}
|
| 50 |
+
.chap{margin-left:auto;display:flex;align-items:center;gap:14px;font:500 17px/1 var(--mono);color:var(--muted);letter-spacing:.06em}
|
| 51 |
+
.chap #chapn{color:var(--ink);font-weight:700}
|
| 52 |
+
.chap #chapt{font-family:var(--sans);font-weight:600;letter-spacing:0;color:var(--ink2);min-width:96px}
|
| 53 |
+
.segs{display:flex;gap:5px}
|
| 54 |
+
.segs span{width:26px;height:3px;border-radius:2px;background:rgba(255,255,255,.12);overflow:hidden}
|
| 55 |
+
.segs span i{display:block;height:100%;width:0;background:var(--grad)}
|
| 56 |
+
.live{position:absolute;left:80px;bottom:44px;z-index:20;display:flex;align-items:center;gap:10px;font:500 15px/1 var(--mono);color:var(--faint);letter-spacing:.04em}
|
| 57 |
+
.live i{width:8px;height:8px;border-radius:50%;background:var(--good);box-shadow:0 0 0 4px rgba(74,222,128,.15),0 0 14px var(--good);animation:pulse 2s ease-in-out infinite}
|
| 58 |
+
@keyframes pulse{50%{opacity:.45}}
|
| 59 |
+
|
| 60 |
+
/* โโ ์ฅ๋ฉด ยท ๋ฑ์ฅ โโ */
|
| 61 |
+
.scene{position:absolute;inset:0;z-index:10;animation:sIn 1s var(--ease)}
|
| 62 |
+
.scene.leaving{animation:sOut .55s ease forwards}
|
| 63 |
+
@keyframes sIn{from{opacity:0;filter:blur(16px);transform:scale(1.035)}}
|
| 64 |
+
@keyframes sOut{to{opacity:0;filter:blur(12px);transform:scale(.985)}}
|
| 65 |
+
.cam{position:absolute;inset:0;padding:156px 140px 200px;display:flex;flex-direction:column;transform-origin:50% 52%}
|
| 66 |
+
[data-in]{opacity:0;transform:translateY(34px);filter:blur(8px);transition:opacity .8s ease,transform .9s var(--ease),filter .8s ease}
|
| 67 |
+
[data-in].on{opacity:1;transform:none;filter:none}
|
| 68 |
+
.words[data-in]{opacity:1;transform:none;filter:none}
|
| 69 |
+
.words .w>span{display:inline-block;opacity:0;transform:translateY(.42em);filter:blur(12px);transition:opacity .8s ease,transform .9s var(--ease),filter .8s ease;transition-delay:calc(var(--d)*70ms)}
|
| 70 |
+
.words.on .w>span{opacity:1;transform:none;filter:none}
|
| 71 |
+
.acc{background:var(--grad);-webkit-background-clip:text;background-clip:text;color:transparent}
|
| 72 |
+
.draw{stroke-dasharray:1;stroke-dashoffset:1;transition:stroke-dashoffset 1.3s cubic-bezier(.6,0,.2,1)}
|
| 73 |
+
.on .draw,.draw.on{stroke-dashoffset:0}
|
| 74 |
+
.dot{transform-box:fill-box;transform-origin:center;transform:scale(0);transition:transform .7s cubic-bezier(.3,1.7,.5,1) .9s}
|
| 75 |
+
.on .dot{transform:none}
|
| 76 |
+
|
| 77 |
+
/* โโ ์๋ง โโ */
|
| 78 |
+
.cap{position:absolute;left:50%;bottom:92px;z-index:20;transform:translate(-50%,14px);width:max-content;max-width:1500px;padding:16px 34px;border-radius:18px;
|
| 79 |
+
background:rgba(6,8,14,.62);border:1px solid var(--stroke);backdrop-filter:blur(18px);box-shadow:0 20px 50px -20px rgba(0,0,0,.8);
|
| 80 |
+
font:600 34px/1.4 var(--sans);letter-spacing:-.02em;text-align:center;color:var(--ink);opacity:0;transition:opacity .7s,transform .7s var(--ease)}
|
| 81 |
+
.cap.on{opacity:1;transform:translate(-50%,0)}
|
| 82 |
+
body.nocap .cap{display:none}
|
| 83 |
+
|
| 84 |
+
/* โโ ๊ณตํต ๋ถํ โโ */
|
| 85 |
+
.kicker{display:flex;align-items:center;gap:16px;font:500 19px/1 var(--mono);letter-spacing:.16em;color:var(--muted)}
|
| 86 |
+
.kicker b{font-weight:700;background:var(--grad);-webkit-background-clip:text;background-clip:text;color:transparent}
|
| 87 |
+
.kicker i{width:46px;height:1px;background:var(--stroke2)}
|
| 88 |
+
.hl{margin:22px 0 0;font:800 80px/1.12 var(--sans);letter-spacing:-.045em}
|
| 89 |
+
.glass{position:relative;background:linear-gradient(180deg,rgba(255,255,255,.065),rgba(255,255,255,.018));border:1px solid var(--stroke);border-radius:28px;
|
| 90 |
+
box-shadow:inset 0 1px 0 rgba(255,255,255,.08),0 40px 90px -50px rgba(0,0,0,.95);backdrop-filter:blur(26px) saturate(1.25)}
|
| 91 |
+
.ic{width:1em;height:1em;flex:none}
|
| 92 |
+
.itile{flex:none;width:72px;height:72px;border-radius:20px;display:grid;place-items:center;color:var(--c);font-size:36px;
|
| 93 |
+
background:linear-gradient(180deg,color-mix(in srgb,var(--c) 22%,transparent),color-mix(in srgb,var(--c) 8%,transparent));border:1px solid color-mix(in srgb,var(--c) 42%,transparent);box-shadow:0 10px 30px -12px color-mix(in srgb,var(--c) 60%,transparent)}
|
| 94 |
+
.k-call{--c:var(--call)}.k-ask{--c:var(--ask)}.k-respond{--c:var(--respond)}.k-good{--c:var(--good)}.k-bad{--c:var(--bad)}.k-hi{--c:var(--hi)}.k-mute{--c:#7d879b}
|
| 95 |
+
.bar{position:relative;height:10px;border-radius:99px;background:rgba(255,255,255,.07);overflow:hidden}
|
| 96 |
+
.bar i{position:absolute;left:0;top:0;bottom:0;width:0;border-radius:inherit;background:linear-gradient(90deg,color-mix(in srgb,var(--c,var(--call)) 45%,transparent),var(--c,var(--call)));box-shadow:0 0 18px color-mix(in srgb,var(--c,var(--call)) 70%,transparent)}
|
| 97 |
+
.pct{font:600 34px/1 var(--mono);font-variant-numeric:tabular-nums;letter-spacing:-.03em}
|
| 98 |
+
.mono{font-family:var(--mono)}
|
| 99 |
+
mark{background:color-mix(in srgb,var(--hi) 18%,transparent);color:var(--hi);border-radius:8px;padding:0 8px;box-shadow:inset 0 0 0 1px color-mix(in srgb,var(--hi) 35%,transparent)}
|
| 100 |
+
.conn{width:96px;height:30px;color:rgba(255,255,255,.28);justify-self:center}
|
| 101 |
+
.conn path{stroke:currentColor;stroke-width:2;fill:none;stroke-linecap:round;stroke-linejoin:round}
|
| 102 |
+
.chipk{display:inline-flex;align-items:center;gap:10px;padding:10px 18px;border-radius:99px;border:1px solid var(--stroke2);background:rgba(255,255,255,.04);font:500 21px/1 var(--mono);color:var(--ink2);letter-spacing:.02em}
|
| 103 |
+
.chipk b{color:var(--ink);font-weight:700}
|
| 104 |
+
.badge{display:inline-flex;align-items:center;gap:8px;padding:9px 16px;border-radius:99px;font:700 21px/1 var(--sans);color:var(--c);background:color-mix(in srgb,var(--c) 14%,transparent);border:1px solid color-mix(in srgb,var(--c) 35%,transparent)}
|
| 105 |
+
.badge .ic{font-size:22px}
|
| 106 |
+
|
| 107 |
+
/* 1ยท2 ยท ํ์ */
|
| 108 |
+
.s-hook .who{font:500 20px/1 var(--mono);letter-spacing:.16em;color:var(--muted)}
|
| 109 |
+
.bubble{align-self:flex-start;margin-top:22px;padding:28px 44px;border-radius:44px 44px 44px 14px;font:650 62px/1.2 var(--sans);letter-spacing:-.035em}
|
| 110 |
+
.caret{display:inline-block;width:4px;height:.9em;margin-left:8px;border-radius:2px;background:var(--ink);vertical-align:-.08em;animation:blink 1s steps(2,start) infinite}
|
| 111 |
+
@keyframes blink{to{visibility:hidden}}
|
| 112 |
+
.s-hook .hl{margin-top:44px;font-size:76px}
|
| 113 |
+
.stats{display:flex;gap:14px;margin-top:26px}
|
| 114 |
+
.opts3{display:grid;grid-template-columns:repeat(3,1fr);gap:28px;margin-top:auto}
|
| 115 |
+
.opt3{padding:34px 36px 32px;transition:opacity .8s ease,transform .9s var(--ease),filter .8s ease,box-shadow .8s,border-color .8s}
|
| 116 |
+
.opt3 .tt{margin-top:26px;font:700 42px/1.2 var(--sans);letter-spacing:-.03em}
|
| 117 |
+
.opt3 .ds{margin-top:8px;font:500 25px/1.4 var(--sans);color:var(--muted)}
|
| 118 |
+
.opt3 .meter{margin-top:28px;display:grid;grid-template-columns:1fr auto;gap:20px;align-items:center}
|
| 119 |
+
.opt3 .vd{position:absolute;top:30px;right:30px;padding:9px 14px;border-radius:99px;background:var(--c);color:#090b10;font:700 16px/1 var(--mono);letter-spacing:.14em;opacity:0;transform:scale(.5);transition:opacity .4s,transform .6s cubic-bezier(.3,1.7,.5,1)}
|
| 120 |
+
.opt3.win{border-color:color-mix(in srgb,var(--c) 75%,transparent);transform:translateY(-14px) scale(1.025);box-shadow:0 0 0 1px var(--c),0 0 90px -20px var(--c),inset 0 1px 0 rgba(255,255,255,.12)}
|
| 121 |
+
.opt3.win .vd{opacity:1;transform:none}
|
| 122 |
+
.opt3.lose{opacity:.3;filter:saturate(.15) blur(1.5px)}
|
| 123 |
+
.opt3::after{content:"";position:absolute;inset:0;border-radius:inherit;pointer-events:none;opacity:0;background:linear-gradient(100deg,transparent 35%,rgba(255,255,255,.1) 50%,transparent 65%);background-size:260% 100%;background-position:130% 0}
|
| 124 |
+
.scan .opt3::after{opacity:1;animation:scan 1.1s linear infinite}
|
| 125 |
+
@keyframes scan{to{background-position:-130% 0}}
|
| 126 |
+
|
| 127 |
+
/* 3 ยท ๋ํ */
|
| 128 |
+
.turns{display:flex;flex-direction:column;gap:28px;margin-top:54px}
|
| 129 |
+
.turn{display:grid;grid-template-columns:minmax(0,.95fr) 120px minmax(0,1.1fr);align-items:center}
|
| 130 |
+
.turn .ub{justify-self:start;padding:22px 34px;border-radius:32px 32px 32px 10px;font:600 36px/1.3 var(--sans);letter-spacing:-.025em}
|
| 131 |
+
.dec{display:grid;grid-template-columns:auto minmax(0,1fr) auto;column-gap:24px;row-gap:14px;align-items:center;padding:22px 30px 24px;border-color:color-mix(in srgb,var(--c) 38%,var(--stroke))}
|
| 132 |
+
.dec .itile{grid-row:1/3;width:68px;height:68px;font-size:34px}
|
| 133 |
+
.dec .lb{font:700 35px/1.2 var(--sans);letter-spacing:-.025em;display:flex;align-items:center;gap:14px}
|
| 134 |
+
.dec .lb small{padding:6px 10px;border-radius:8px;font:700 15px/1 var(--mono);letter-spacing:.12em;color:var(--c);background:color-mix(in srgb,var(--c) 16%,transparent)}
|
| 135 |
+
.dec .pct{font-size:31px}
|
| 136 |
+
.dec .bar{grid-column:2/4}
|
| 137 |
+
.dec .nt{grid-column:1/-1;font:500 21px/1.45 var(--sans);color:var(--muted)}
|
| 138 |
+
|
| 139 |
+
/* 4ยท11 ยท ํ์ดํ */
|
| 140 |
+
.center{flex:1;display:flex;flex-direction:column;align-items:center;justify-content:center;text-align:center}
|
| 141 |
+
.markbig{width:148px;height:148px;filter:drop-shadow(0 20px 60px rgba(114,184,255,.35))}
|
| 142 |
+
.wm{margin-top:30px;font:820 170px/1 var(--sans);letter-spacing:-.06em;white-space:nowrap}
|
| 143 |
+
.wm .a{background:linear-gradient(180deg,#fff 25%,#c3ccff);-webkit-background-clip:text;background-clip:text;color:transparent}
|
| 144 |
+
.wm .b{font-weight:300;letter-spacing:-.04em;background:var(--grad);background-size:200% 100%;-webkit-background-clip:text;background-clip:text;color:transparent;animation:sheen 6s ease-in-out infinite alternate}
|
| 145 |
+
@keyframes sheen{to{background-position:100% 0}}
|
| 146 |
+
.tag{margin-top:26px;font:600 48px/1.3 var(--sans);letter-spacing:-.035em;color:var(--ink2)}
|
| 147 |
+
.facts{display:grid;grid-template-columns:repeat(3,400px);gap:24px;margin-top:58px}
|
| 148 |
+
.fact{display:grid;grid-template-columns:auto 1fr;column-gap:22px;align-items:center;padding:26px 30px;text-align:left}
|
| 149 |
+
.fact .itile{grid-row:1/3;width:64px;height:64px;font-size:31px}
|
| 150 |
+
.fact b{font:800 46px/1 var(--sans);letter-spacing:-.04em;font-variant-numeric:tabular-nums}
|
| 151 |
+
.fact span{margin-top:8px;font:500 20px/1.4 var(--sans);color:var(--muted)}
|
| 152 |
+
.try{margin-top:50px;display:flex;align-items:center;gap:14px;font:500 25px/1 var(--sans);color:var(--muted)}
|
| 153 |
+
.try b{color:var(--ink);font-weight:600}
|
| 154 |
+
|
| 155 |
+
/* 5 ยท ํ์ต ์ ํ */
|
| 156 |
+
.vs{display:grid;grid-template-columns:1fr 130px 1fr;margin-top:44px;flex:1;min-height:0}
|
| 157 |
+
.side{padding:32px 38px;display:flex;flex-direction:column}
|
| 158 |
+
.side.after{border-color:rgba(114,184,255,.35);box-shadow:inset 0 1px 0 rgba(255,255,255,.1),0 0 120px -40px rgba(114,184,255,.5)}
|
| 159 |
+
.lab{align-self:flex-start;padding:9px 16px;border-radius:99px;border:1px solid var(--stroke2);font:600 21px/1 var(--sans);color:var(--ink2)}
|
| 160 |
+
.tiles{display:grid;grid-template-columns:repeat(15,1fr);gap:6px;margin:26px 0 22px}
|
| 161 |
+
.tiles span{aspect-ratio:1;display:grid;place-items:center;border-radius:9px;font:700 19px/1 var(--mono);background:rgba(255,255,255,.045);color:#5d6678;opacity:0;transform:scale(.4);transition:opacity .4s,transform .5s cubic-bezier(.3,1.5,.5,1);transition-delay:calc(var(--i)*13ms)}
|
| 162 |
+
.tiles.on span{opacity:1;transform:none}
|
| 163 |
+
.after .tiles span{background:hsla(var(--h),90%,66%,.2);color:hsl(var(--h),95%,82%);box-shadow:inset 0 0 0 1px hsla(var(--h),90%,70%,.25)}
|
| 164 |
+
.side .note{font:500 23px/1.4 var(--sans);color:var(--muted)}
|
| 165 |
+
.side .note b{color:var(--ink)}
|
| 166 |
+
.bign{margin-top:auto;font:820 124px/1 var(--sans);letter-spacing:-.06em;font-variant-numeric:tabular-nums}
|
| 167 |
+
.before .bign{color:#8f97a8}
|
| 168 |
+
.after .bign{background:var(--grad);-webkit-background-clip:text;background-clip:text;color:transparent}
|
| 169 |
+
.side .sub{margin-top:10px;font:500 23px/1.4 var(--sans);color:var(--muted)}
|
| 170 |
+
.mid{display:flex;flex-direction:column;align-items:center;justify-content:center;gap:14px;font:600 16px/1.3 var(--mono);color:var(--muted);text-align:center;letter-spacing:.06em}
|
| 171 |
+
.mid .ring{width:68px;height:68px;border-radius:50%;display:grid;place-items:center;font-size:30px;color:var(--ink);background:rgba(255,255,255,.05);border:1px solid var(--stroke2)}
|
| 172 |
+
|
| 173 |
+
/* 6 ยท ํ๊ตญ์ด ๋ฌธ์ */
|
| 174 |
+
.qs{display:grid;grid-template-columns:repeat(3,1fr);gap:28px;margin-top:46px;flex:1;min-height:0}
|
| 175 |
+
.qc{padding:30px 32px 26px;display:flex;flex-direction:column}
|
| 176 |
+
.qtag{align-self:flex-start;display:inline-flex;align-items:center;gap:10px;padding:8px 14px;border-radius:99px;font:700 19px/1 var(--sans);color:var(--hi);background:color-mix(in srgb,var(--hi) 12%,transparent);border:1px solid color-mix(in srgb,var(--hi) 30%,transparent)}
|
| 177 |
+
.qb{margin:22px 0 18px;font:600 30px/1.48 var(--sans);letter-spacing:-.025em}
|
| 178 |
+
.qb p{margin:0 0 10px}
|
| 179 |
+
.qb small{display:block;margin-top:6px;font:500 21px/1.45 var(--sans);color:var(--muted);letter-spacing:-.01em}
|
| 180 |
+
.op{display:grid;grid-template-columns:minmax(0,1fr) auto;gap:10px 16px;align-items:center;padding:14px 0;border-top:1px solid var(--stroke);transition:opacity .6s}
|
| 181 |
+
.op .t{font:600 26px/1.3 var(--sans);letter-spacing:-.02em}
|
| 182 |
+
.op .pct{font-size:25px}
|
| 183 |
+
.op .bar{grid-column:1/-1;height:8px}
|
| 184 |
+
.op.dim{opacity:.4}
|
| 185 |
+
.qc .foot{margin-top:auto;padding-top:16px;display:flex;justify-content:space-between;align-items:center;font:500 19px/1 var(--mono);color:var(--muted)}
|
| 186 |
+
|
| 187 |
+
/* 7 ยท ๊ณ ๊ฐ ๋ฌธ์ */
|
| 188 |
+
.rows{display:flex;flex-direction:column;gap:28px;margin-top:50px}
|
| 189 |
+
.row{display:grid;grid-template-columns:minmax(0,1.15fr) minmax(0,1fr) 110px minmax(0,.62fr);align-items:center;gap:0 22px}
|
| 190 |
+
.msg{padding:24px 32px 28px}
|
| 191 |
+
.msg .h{display:flex;align-items:center;gap:10px;font:500 17px/1 var(--mono);letter-spacing:.12em;color:var(--muted)}
|
| 192 |
+
.msg .h i{width:8px;height:8px;border-radius:50%;background:var(--ask)}
|
| 193 |
+
.msg .t{margin-top:14px;font:600 31px/1.45 var(--sans);letter-spacing:-.025em}
|
| 194 |
+
.chips{display:flex;flex-direction:column;gap:12px}
|
| 195 |
+
.chip{display:grid;grid-template-columns:70px minmax(0,1fr) auto;gap:14px;align-items:center;padding:16px 22px;border-radius:18px}
|
| 196 |
+
.chip .k{font:600 16px/1 var(--mono);letter-spacing:.1em;color:var(--muted)}
|
| 197 |
+
.chip .v{font:700 27px/1.25 var(--sans);letter-spacing:-.025em}
|
| 198 |
+
.chip .pct{font-size:24px;color:var(--ink2)}
|
| 199 |
+
.route{display:flex;flex-direction:column;align-items:center;gap:14px;padding:26px 22px;text-align:center;border-color:color-mix(in srgb,var(--c) 55%,transparent);box-shadow:inset 0 1px 0 rgba(255,255,255,.1),0 0 80px -30px var(--c)}
|
| 200 |
+
.route .itile{width:62px;height:62px;font-size:30px}
|
| 201 |
+
.route .d{font:750 30px/1.2 var(--sans);letter-spacing:-.03em}
|
| 202 |
+
.route .u{padding:7px 18px;border-radius:99px;font:800 24px/1.1 var(--sans);background:var(--c);color:#090b10}
|
| 203 |
+
.route .s{font:500 15px/1 var(--mono);color:var(--muted);letter-spacing:.06em}
|
| 204 |
+
|
| 205 |
+
/* 8 ยท ํ์ */
|
| 206 |
+
.unsure{display:grid;grid-template-columns:minmax(0,1.08fr) minmax(0,.92fr);gap:36px;margin-top:40px;flex:1;min-height:0}
|
| 207 |
+
.ucol{display:flex;flex-direction:column;gap:18px}
|
| 208 |
+
.s-unsure .msg .t{font-size:29px}
|
| 209 |
+
.cands{padding:6px 30px}
|
| 210 |
+
.cands .op:first-child{border-top:0}
|
| 211 |
+
.calib{display:flex;align-items:center;gap:28px;padding:20px 30px}
|
| 212 |
+
.calib .n{font:800 54px/1 var(--sans);letter-spacing:-.05em;font-variant-numeric:tabular-nums}
|
| 213 |
+
.calib .l{margin-top:8px;font:500 18px/1.3 var(--sans);color:var(--muted)}
|
| 214 |
+
.calib .eq{font:300 46px/1 var(--sans);color:var(--faint)}
|
| 215 |
+
.calib .say{margin-left:auto;font:600 22px/1.45 var(--sans);color:var(--ink2);text-align:right}
|
| 216 |
+
.gauge{display:flex;flex-direction:column;align-items:center;padding:28px 34px 28px}
|
| 217 |
+
.gauge .lab2{align-self:flex-start;font:600 22px/1 var(--sans);color:var(--muted)}
|
| 218 |
+
.gwrap{position:relative;width:440px;height:250px;margin-top:14px}
|
| 219 |
+
.gwrap svg{position:absolute;inset:0;overflow:visible}
|
| 220 |
+
.gwrap .gnum{position:absolute;left:0;right:0;bottom:-6px;text-align:center;font:820 96px/1 var(--sans);letter-spacing:-.06em;color:var(--ask);font-variant-numeric:tabular-nums;text-shadow:0 0 50px rgba(255,180,77,.35)}
|
| 221 |
+
.gth{font:600 17px var(--mono);fill:var(--ink2)}
|
| 222 |
+
.hold{margin-top:30px;align-self:stretch;display:flex;align-items:center;justify-content:center;gap:16px;padding:18px 22px;border-radius:18px;background:color-mix(in srgb,var(--ask) 12%,transparent);border:1px solid color-mix(in srgb,var(--ask) 55%,transparent);font:750 29px/1.2 var(--sans);letter-spacing:-.025em;color:var(--ask)}
|
| 223 |
+
.hold .ic{font-size:30px}
|
| 224 |
+
.truth{margin-top:18px;font:500 22px/1.5 var(--sans);color:var(--muted);text-align:center}
|
| 225 |
+
.truth b{color:var(--ink);font-weight:650}
|
| 226 |
+
|
| 227 |
+
/* 9 ยท ์์ */
|
| 228 |
+
.board{margin-top:24px;display:flex;flex-direction:column;gap:1px}
|
| 229 |
+
.lr{display:grid;grid-template-columns:46px 500px 92px minmax(0,1fr) 150px;gap:20px;align-items:center;padding:3px 20px;border-radius:14px;border:1px solid transparent}
|
| 230 |
+
.lr .rk{font:600 18px/1 var(--mono);color:var(--faint)}
|
| 231 |
+
.lr .nm{font:600 27px/1.2 var(--sans);letter-spacing:-.02em;white-space:nowrap;overflow:hidden;text-overflow:ellipsis;color:var(--ink2)}
|
| 232 |
+
.lr .sz{justify-self:end;padding:5px 10px;border-radius:8px;font:600 16px/1 var(--mono);color:var(--muted);background:rgba(255,255,255,.05)}
|
| 233 |
+
.lr.small .sz{color:var(--ink);background:rgba(255,255,255,.1)}
|
| 234 |
+
.lr .bar{height:20px;border-radius:6px}
|
| 235 |
+
.lr .bar i{border-radius:6px;background:linear-gradient(90deg,#2a3243,#4a5468);box-shadow:none}
|
| 236 |
+
.lr .pct{font-size:27px;text-align:right;color:var(--ink2)}
|
| 237 |
+
.lr.me{background:linear-gradient(90deg,rgba(185,166,255,.13),rgba(95,240,210,.07));border-color:rgba(185,166,255,.38);box-shadow:0 0 70px -20px rgba(114,184,255,.45)}
|
| 238 |
+
.lr.me .nm{font-weight:750;color:var(--ink)}
|
| 239 |
+
.lr.me .rk,.lr.me .pct{color:var(--ink)}
|
| 240 |
+
.lr.me .bar i{background:var(--grad);box-shadow:0 0 22px rgba(114,184,255,.6)}
|
| 241 |
+
.fine{margin-top:16px;font:400 17px/1.5 var(--sans);color:var(--faint);max-width:1640px}
|
| 242 |
+
|
| 243 |
+
/* 10 ยท ์๋ */
|
| 244 |
+
.speed{display:grid;grid-template-columns:minmax(0,1.3fr) minmax(0,1fr);gap:36px;margin-top:40px;flex:1;min-height:0}
|
| 245 |
+
.ticker{overflow:hidden;padding:6px 0}
|
| 246 |
+
.ticker::after{content:"";position:absolute;left:0;right:0;bottom:0;height:140px;border-radius:0 0 28px 28px;background:linear-gradient(transparent,rgba(8,10,16,.92));pointer-events:none}
|
| 247 |
+
.tk{display:grid;grid-template-columns:44px minmax(0,1fr) 140px 36px;gap:16px;align-items:center;padding:14px 26px;border-bottom:1px solid var(--stroke);animation:tkIn .45s var(--ease)}
|
| 248 |
+
@keyframes tkIn{from{opacity:0;transform:translateY(-18px);filter:blur(6px)}}
|
| 249 |
+
.tk .tr{width:40px;height:40px;border-radius:12px;display:grid;place-items:center;font-size:22px;color:var(--c);background:color-mix(in srgb,var(--c) 15%,transparent)}
|
| 250 |
+
.tk .ti{font:600 24px/1.3 var(--sans);letter-spacing:-.02em;white-space:nowrap;overflow:hidden;text-overflow:ellipsis}
|
| 251 |
+
.tk .tg{justify-self:start;font:700 21px/1 var(--sans);color:var(--c)}
|
| 252 |
+
.tk .ck{font-size:24px;display:grid;place-items:center}
|
| 253 |
+
.up{--c:#ff7a6b}.dn{--c:#6aa6ff}.nn{--c:#8b94a7}
|
| 254 |
+
.spr{display:flex;flex-direction:column;gap:24px}
|
| 255 |
+
.spbox{padding:32px 36px}
|
| 256 |
+
.spbox .big{display:flex;align-items:baseline;gap:6px;font:820 150px/1 var(--sans);letter-spacing:-.06em;font-variant-numeric:tabular-nums;background:linear-gradient(180deg,#fff,#7ff3d9);-webkit-background-clip:text;background-clip:text;color:transparent}
|
| 257 |
+
.spbox .big small{font-size:60px;font-weight:600;letter-spacing:-.03em}
|
| 258 |
+
.spbox .l{margin-top:14px;font:500 22px/1.45 var(--sans);color:var(--muted)}
|
| 259 |
+
.cnt{display:flex;gap:30px;padding:26px 36px}
|
| 260 |
+
.cnt div b{display:block;font:800 64px/1 var(--sans);letter-spacing:-.05em;font-variant-numeric:tabular-nums}
|
| 261 |
+
.cnt div span{display:block;margin-top:10px;font:500 19px/1.35 var(--sans);color:var(--muted)}
|
| 262 |
+
.cnt .g b{color:var(--good)}
|
| 263 |
+
|
| 264 |
+
/* โโ ์กฐ์๋ฐ (๋ฌด๋ ๋ฐ) โโ */
|
| 265 |
+
#hud{position:fixed;left:50%;bottom:18px;transform:translateX(-50%);display:flex;align-items:center;gap:12px;padding:10px 14px;border-radius:14px;background:rgba(18,22,32,.9);border:1px solid #2a3344;color:#cfd6e3;font:13px/1 var(--sans);z-index:50;transition:opacity .4s;backdrop-filter:blur(6px)}
|
| 266 |
+
#hud button{border:0;background:#222b3b;color:#e8edf5;border-radius:8px;padding:8px 12px;font:600 13px/1 var(--sans);cursor:pointer}
|
| 267 |
+
#hud button:hover{background:#2e3a50}
|
| 268 |
+
#hud .dots{display:flex;gap:6px}
|
| 269 |
+
#hud .dots button{width:26px;padding:7px 0;font:600 11px/1 var(--mono);background:#1b2230;color:#7d889c}
|
| 270 |
+
#hud .dots button.cur{background:#72b8ff;color:#0b0e14}
|
| 271 |
+
#hud .help{color:#7d889c;font-size:12px;white-space:nowrap}
|
| 272 |
+
body.clean #hud,body.idle #hud{opacity:0;pointer-events:none}
|
| 273 |
+
#pausebadge{position:fixed;top:16px;left:50%;transform:translateX(-50%);padding:8px 16px;border-radius:10px;background:rgba(255,180,77,.94);color:#111;font:700 14px/1 var(--sans);z-index:50}
|
| 274 |
+
@media (max-width:900px){#hud .help{display:none}}
|
| 275 |
+
</style>
|
| 276 |
+
</head>
|
| 277 |
+
<body>
|
| 278 |
+
<svg width="0" height="0" style="position:absolute" aria-hidden="true"><defs>
|
| 279 |
+
<linearGradient id="gB" gradientUnits="userSpaceOnUse" x1="0" y1="0" x2="48" y2="48"><stop offset="0" stop-color="#b9a6ff"/><stop offset=".55" stop-color="#72b8ff"/><stop offset="1" stop-color="#5ff0d2"/></linearGradient>
|
| 280 |
+
<linearGradient id="gA" gradientUnits="userSpaceOnUse" x1="20" y1="0" x2="420" y2="0"><stop offset="0" stop-color="#ff8a4d"/><stop offset="1" stop-color="#ffd36b"/></linearGradient>
|
| 281 |
+
</defs></svg>
|
| 282 |
+
<div id="stage" aria-live="polite">
|
| 283 |
+
<div id="aurora"><div class="b b1"></div><div class="b b2"></div><div class="b b3"></div></div>
|
| 284 |
+
<div id="grid"></div>
|
| 285 |
+
<header class="chrome"><div class="brand" id="brand"></div>
|
| 286 |
+
<div class="chap"><span id="chapn">01</span><span>/ <span id="chapall">11</span></span><span id="chapt"></span><div class="segs" id="segs"></div></div></header>
|
| 287 |
+
<div class="live"><i></i>์ค์ ๋ชจ๋ธ ์ถ๋ ฅ ยท ์ ์ฅ๋ ํ์ ๊ฒฐ๊ณผ ์ฌ์</div>
|
| 288 |
+
<div class="cap" id="cap"></div>
|
| 289 |
+
<div id="vig"></div><div id="grain"></div><div id="fade"></div>
|
| 290 |
+
</div>
|
| 291 |
+
<div id="hud" role="toolbar" aria-label="์ฌ์ ์กฐ์">
|
| 292 |
+
<button id="prev" title="์ด์ ์ฅ๋ฉด (โ)">โ</button>
|
| 293 |
+
<button id="play" title="์ผ์์ ์งยท์ฌ์ (Space)">โโ</button>
|
| 294 |
+
<button id="next" title="๋ค์ ์ฅ๋ฉด (โ)">โถ</button>
|
| 295 |
+
<div class="dots" id="dots"></div>
|
| 296 |
+
<span class="help">Space ์ ์ง ยท โโ ์ฅ๋ฉด ยท R ์ฒ์ ยท C ์๋ง ยท H ์จ๊น ยท F ์ ์ฒดํ๋ฉด</span>
|
| 297 |
+
</div>
|
| 298 |
+
<div id="pausebadge" hidden>์ผ์์ ์ง</div>
|
| 299 |
+
|
| 300 |
+
<script>window.SHOW_TRY = "huggingface.co/coderecode95/KJH-Judge-4B-ko";</script>
|
| 301 |
+
<script>/* data.js */
|
| 302 |
+
window.JEV_DATA = {"pooled":{"n":25418,"acc":0.9037,"chance":0.2986,"mean_conf":0.8802,"ece":0.0265,"order_agree":0.9793},"base_pooled":{"n":25418,"acc":0.2956,"chance":0.2986,"mean_conf":0.9052,"ece":0.6096,"order_agree":0.0},"pred_letters":{"A":7553,"B":7618,"C":3284,"D":2113,"E":1645,"F":1529,"G":1544,"H":41,"I":34,"J":32,"K":25},"base_pred_letters":{"A":25349,"E":29,"I":40},"train":{"train_loss":0.2376677804889313,"eval_loss":0.1863497942686081,"steps":4430,"gpu_hours":3.483,"tokens":35464805.0}};
|
| 303 |
+
</script>
|
| 304 |
+
<script>/* live-example.js */
|
| 305 |
+
window.JEV_LIVE_EXAMPLE = {"meta":{"device":"cuda","temperature":1.7179,"made":"2026-11-09 11:31"},"state":{"enabled":["get_weather","call_taxi","create_event","send_money","track_parcel"],"log":[{"t":"user","text":"ํ์ ์ข ๋ถ๋ฌ์ค"},{"t":"decision","d":{"step":1,"kind":"ASK","tool":null,"text":"ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ","conf":0.9949,"ms":135,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ","RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด"],"probs":[0.001,0.0022,0.0004,0.0001,0.0004,0.9949,0.001]}},{"t":"user","text":"๊ฐ๋จ์ญ์์ ํ๊ต์ญ๊น์ง ๊ฐ ์ค"},{"t":"decision","d":{"step":1,"kind":"CALL","tool":"call_taxi","text":"CALL:call_taxi","conf":0.9962,"ms":140,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ","RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด"],"probs":[0.0004,0.9962,0.0005,0.0001,0.0002,0.0019,0.0007]}},{"t":"decision","d":{"step":2,"kind":"RESPOND","tool":null,"text":"RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด","conf":0.9603,"ms":148,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ","RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด"],"probs":[0.0028,0.0314,0.0014,0.0004,0.001,0.0026,0.9603]}},{"t":"user","text":"๋ด์ผ ๋ถ์ฐ ๋ ์จ ์ด๋?"},{"t":"decision","d":{"step":1,"kind":"CALL","tool":"get_weather","text":"CALL:get_weather","conf":0.9824,"ms":156,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ","RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด"],"probs":[0.9824,0.001,0.0007,0.0002,0.0002,0.0144,0.0011]}},{"t":"decision","d":{"step":2,"kind":"RESPOND","tool":null,"text":"RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด","conf":0.9688,"ms":163,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ","RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด"],"probs":[0.0153,0.0027,0.0015,0.0008,0.0017,0.0092,0.9688]}},{"t":"user","text":"์ผ์ฑ์ ์ ์ฃผ์ 10์ฃผ ์ฌ ์ค"},{"t":"decision","d":{"step":1,"kind":"RESPOND","tool":null,"text":"RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด","conf":0.9865,"ms":168,"choices":["CALL:get_weather","CALL:call_taxi","CALL:create_event","CALL:send_money","CALL:track_parcel","ASK: ๋ถ์กฑํ ํ์ ์ ๋ณด ์ง๋ฌธ","RESPOND: ์ง์ ์ค๋ช
ยท์๋ฃยท๋ฏธ์ง์ ์๋ด"],"probs":[0.0022,0.0011,0.0013,0.0011,0.0018,0.0061,0.9865]}}]}};
|
| 306 |
+
</script>
|
| 307 |
+
<script>/* quiz-data.js */
|
| 308 |
+
window.JEV_QUIZ = {"meta":{"made":"2026-11-09 13:27","device":"cuda","mode":"singleร8","seconds":18},"pool":[{"id":"kobest_wic:512","area":"kobest_wic","instruction":"๋ ๋ฌธ๋งฅ์์ ํ์๋ ๋จ์ด์ ์๋ฏธ๊ฐ ๊ฐ์์ง ํ๋จํ๋ค.","item":{"word":"์ด์","context_1":"ํค 158cm [์ด์]๋ง ๋์ด๊ธฐ๊ตฌ๋ฅผ ํ ์ ์๋ค.","context_2":"์ด๊ฒ์ด ๋ฐ๋ก ๋์ [์ด์]์ ํฅํ ์ด์ ์ด๋ค."},"choices":["์๋ก ๋ค๋ฅธ ์๋ฏธ","๊ฐ์ ์๋ฏธ"],"gold":0,"jev":{"pick":0,"conf":0.9875,"probs":[0.9875,0.0125],"ms":103}},{"id":"kobest_copa:226","area":"kobest_copa","instruction":"์๊ตฌ๋ ์์ธ ๋๋ ๊ฒฐ๊ณผ ์ค ๋ ์์ฐ์ค๋ฝ๊ณ ํ๋นํ ๊ฒ์ ๊ณ ๋ฅธ๋ค.","item":{"premise":"๋นํ๊ธฐ๊ฐ ๋๊ธฐ๋ฅ๋ฅผ ๋ง๋ฌ๋ค.","relation_to_select":"๊ฒฐ๊ณผ"},"choices":["๋นํ๊ธฐ๊ฐ ํ๋ค๋ ธ๋ค.","๋นํ๊ธฐ๊ฐ ์ํญํ๋ค."],"gold":0,"jev":{"pick":0,"conf":0.9725,"probs":[0.9725,0.0275],"ms":104}},{"id":"klue_ynat:1810","area":"klue_ynat","instruction":"ํ๊ตญ์ด ๋ด์ค ์ ๋ชฉ์ ์ค์ฌ ์ฃผ์ ๋ฅผ ๊ณ ๋ฅธ๋ค. ์ฌ๋ฌ ๋ถ์ผ๊ฐ ์ธ๊ธ๋์ด๋ ๊ธฐ์ฌ์ ์ฃผ๋ ์ฌ๊ฑด์ ์ฐ์ ํ๋ค.","item":{"headline":"K๋ฆฌ๊ทธ ๋ ๋์นด๋ ์์ถโฆVAR์ ๋ชป์์ฌ"},"choices":["๊ฒฝ์ ","IT๊ณผํ","์คํฌ์ธ ","์ํ๋ฌธํ","์ธ๊ณ","์ฌํ","์ ์น"],"gold":2,"jev":{"pick":2,"conf":0.9714,"probs":[0.002,0.0023,0.9714,0.0014,0.0023,0.0191,0.0015],"ms":107}}]};
|
| 309 |
+
</script>
|
| 310 |
+
<script>/* examples.js */
|
| 311 |
+
window.JEV_EXAMPLES = {"meta":{"device":"cuda","made":"2026-11-09 12:23"},"inbox":[{"text":"์ ๊ณ์ ์ ์ ๊ฐ ํ์ง ์์ ์ฃผ๋ฌธ์ด 3๊ฑด ์์ด์!! ํดํน๋นํ ๊ฒ ๊ฐ์์ ๋นจ๋ฆฌ ํ์ธํด์ฃผ์ธ์","axes":{"case":{"pick":0,"conf":0.8839,"ms":89,"probs":[0.8839,0.013,0.005,0.005,0.036,0.0044,0.0054,0.0021,0.025,0.0028,0.013,0.002,0.0012,0.0006,0.0006]},"mood":{"pick":0,"conf":0.9617,"ms":78,"probs":[0.9617,0.0338,0.0044]},"info":{"pick":1,"conf":0.7203,"ms":91,"probs":[0.2797,0.7203]}},"wall":2143},{"text":"์ฃผ๋ฌธ๋ฒํธ 20261102-5531 ์์ง๋ ๋ฐฐ์ก ์ค๋น์ค์ด๋ค์. ๋ค์ ์ฃผ ์ด์ฌ๋ผ ๊ทธ ์ ์ ๊ผญ ๋ฐ์์ผ ํด์.","axes":{"case":{"pick":5,"conf":0.8972,"ms":91,"probs":[0.0051,0.0023,0.0029,0.0031,0.0018,0.8972,0.0236,0.0041,0.0009,0.0038,0.0422,0.0025,0.0068,0.0011,0.0025]},"mood":{"pick":0,"conf":0.8983,"ms":103,"probs":[0.8983,0.0875,0.0142]},"info":{"pick":0,"conf":0.9807,"ms":105,"probs":[0.9807,0.0193]}},"wall":319},{"text":"๋ฐฐ์ก ์ฐธ ๋น ๋ฅด๋ค์. ์ฃผ๋ฌธํ๊ณ 2์ฃผ ๋ง์ ์์ด์.","axes":{"case":{"pick":13,"conf":0.9321,"ms":85,"probs":[0.004,0.0022,0.0017,0.0014,0.0011,0.0147,0.0046,0.0037,0.0006,0.0007,0.0032,0.0013,0.0127,0.9321,0.0158]},"mood":{"pick":2,"conf":0.9636,"ms":90,"probs":[0.0092,0.0273,0.9636]},"info":{"pick":0,"conf":0.9274,"ms":93,"probs":[0.9274,0.0726]}},"wall":286},{"text":"์นด๋์์ 39,800์์ด ๋ ๋ฒ ๊ฒฐ์ ๋์ด์. 11์ 7์ผ ์คํ 9์์ฏค์ด์์.","axes":{"case":{"pick":1,"conf":0.8685,"ms":117,"probs":[0.0212,0.8685,0.0066,0.0024,0.0032,0.0034,0.044,0.003,0.0018,0.0184,0.005,0.0197,0.0013,0.0009,0.0006]},"mood":{"pick":1,"conf":0.6906,"ms":73,"probs":[0.2884,0.6906,0.021]},"info":{"pick":0,"conf":0.59,"ms":91,"probs":[0.59,0.41]}},"wall":812},{"text":"ํ๋ถํด ์ฃผ์ธ์.","axes":{"case":{"pick":6,"conf":0.9599,"ms":88,"probs":[0.0059,0.0063,0.002,0.0025,0.001,0.0023,0.9599,0.0113,0.0007,0.0008,0.0028,0.0025,0.001,0.0005,0.0005]},"mood":{"pick":0,"conf":0.9095,"ms":77,"probs":[0.9095,0.0713,0.0192]},"info":{"pick":1,"conf":0.7994,"ms":75,"probs":[0.2006,0.7994]}},"wall":8234},{"text":"์๋ด์ฌ ๊น์ง์๋ ๋๋ถ์ ๋ฌธ์ ์ ํด๊ฒฐํ์ด์. ์ ๋ง ๊ฐ์ฌํฉ๋๋ค!","axes":{"case":{"pick":13,"conf":0.9845,"ms":83,"probs":[0.0018,0.0008,0.0011,0.0004,0.0005,0.0008,0.0014,0.0008,0.0002,0.0004,0.0027,0.0007,0.0018,0.9845,0.0019]},"mood":{"pick":2,"conf":0.9913,"ms":72,"probs":[0.0034,0.0053,0.9913]},"info":{"pick":0,"conf":0.9683,"ms":94,"probs":[0.9683,0.0317]}},"wall":608},{"text":"์ด ์์ดํ๋ผ์ด์ด ๋ฐ์ค์ผ ์๊ธฐ์ธ์ฒ๊ธฐ์ ๋ฃ์ด๋ ๋๋์?","axes":{"case":{"pick":12,"conf":0.9481,"ms":85,"probs":[0.0035,0.0017,0.0017,0.0009,0.001,0.002,0.0173,0.0084,0.0012,0.0021,0.0043,0.0017,0.9481,0.0028,0.0033]},"mood":{"pick":1,"conf":0.9245,"ms":68,"probs":[0.035,0.9245,0.0405]},"info":{"pick":0,"conf":0.9635,"ms":97,"probs":[0.9635,0.0365]}},"wall":611},{"text":"์ฑ ์
๋ฐ์ดํธ ํ๋ก ์ฅ๋ฐ๊ตฌ๋๊ฐ ๊ณ์ ๋น์ด ์์ด์. ๋ช ๋ฒ์ ๋ด์๋ ์ฌ๋ผ์ ธ์.","axes":{"case":{"pick":9,"conf":0.9538,"ms":84,"probs":[0.0035,0.0018,0.0073,0.0015,0.0013,0.002,0.0035,0.0014,0.0028,0.9538,0.0113,0.0015,0.002,0.0006,0.0059]},"mood":{"pick":0,"conf":0.9773,"ms":70,"probs":[0.9773,0.0207,0.002]},"info":{"pick":0,"conf":0.9169,"ms":94,"probs":[0.9169,0.0831]}},"wall":700},{"text":"์ด์ ๋ฐ์ ๋ํธ์ ๊ตฌ๋ฉ์ด ๋ ์์ด์. ๊ตํ ๋ง๊ณ ํ๋ถ๋ก ํด์ฃผ์ธ์. ์ฃผ๋ฌธ๋ฒํธ 20261105-2210","axes":{"case":{"pick":6,"conf":0.664,"ms":90,"probs":[0.0021,0.0013,0.001,0.0006,0.0008,0.0023,0.664,0.3208,0.0006,0.0008,0.003,0.0007,0.0012,0.0004,0.0005]},"mood":{"pick":0,"conf":0.9697,"ms":88,"probs":[0.9697,0.0274,0.0029]},"info":{"pick":0,"conf":0.9744,"ms":91,"probs":[0.9744,0.0256]}},"wall":1657},{"text":"๋น๋ฐ๋ฒํธ ์ฌ์ค์ ๋ฉ์ผ์ด ์ ์์. ์คํธํจ๋ ํ์ธํ์ด์.","axes":{"case":{"pick":8,"conf":0.8605,"ms":83,"probs":[0.0088,0.0022,0.0262,0.0012,0.0026,0.0019,0.0027,0.0018,0.8605,0.0405,0.0469,0.0015,0.0014,0.0008,0.001]},"mood":{"pick":0,"conf":0.9527,"ms":71,"probs":[0.9527,0.0448,0.0024]},"info":{"pick":0,"conf":0.7203,"ms":99,"probs":[0.7203,0.2797]}},"wall":610},{"text":"๋ฐํ ์ ์ํ๋๋ฐ ํ๋ฐฐ ๊ธฐ์ฌ๋์ด ์๊ฑฐ๋ฅผ ์ ์ค์
จ์ด์. 3์ผ์งธ ๋ฌธ ์์ ๋๊ณ ์์ด์.","axes":{"case":{"pick":6,"conf":0.6592,"ms":85,"probs":[0.0063,0.0035,0.0024,0.0018,0.0016,0.0359,0.6592,0.0232,0.0012,0.0023,0.256,0.0021,0.0026,0.0008,0.0011]},"mood":{"pick":0,"conf":0.9445,"ms":96,"probs":[0.9445,0.0514,0.004]},"info":{"pick":1,"conf":0.5182,"ms":105,"probs":[0.4818,0.5182]}},"wall":307},{"text":"์ค๋ ๊ฒฐ์ ๊ฐ ์ ๋๊ณ '์ผ์์ ์ค๋ฅ'๋ง ๋ ์. ๏ฟฝ๏ฟฝ๋ฅธ ์นด๋๋ ๋ง์ฐฌ๊ฐ์ง์์.","axes":{"case":{"pick":11,"conf":0.4996,"ms":92,"probs":[0.0073,0.0055,0.0203,0.0031,0.0023,0.0047,0.0059,0.0019,0.0055,0.4016,0.0364,0.4996,0.0025,0.0011,0.0023]},"mood":{"pick":0,"conf":0.7949,"ms":70,"probs":[0.7949,0.1995,0.0056]},"info":{"pick":0,"conf":0.877,"ms":92,"probs":[0.877,0.123]}},"wall":1131}],"news":[{"pick":0,"conf":0.9867,"ms":84,"probs":[0.9867,0.0081,0.0052]},{"pick":1,"conf":0.9616,"ms":80,"probs":[0.0091,0.9616,0.0293]},{"pick":2,"conf":0.8396,"ms":76,"probs":[0.0658,0.0946,0.8396]},{"pick":1,"conf":0.4258,"ms":79,"probs":[0.3183,0.4258,0.2559]},{"pick":0,"conf":0.3664,"ms":76,"probs":[0.3664,0.3168,0.3168]},{"pick":1,"conf":0.9515,"ms":79,"probs":[0.0174,0.9515,0.0311]},{"pick":1,"conf":0.9418,"ms":77,"probs":[0.0199,0.9418,0.0383]},{"pick":2,"conf":0.9502,"ms":77,"probs":[0.0311,0.0187,0.9502]},{"pick":0,"conf":0.9804,"ms":79,"probs":[0.9804,0.008,0.0116]},{"pick":1,"conf":0.8716,"ms":76,"probs":[0.0148,0.8716,0.1136]},{"pick":1,"conf":0.9736,"ms":76,"probs":[0.0086,0.9736,0.0178]},{"pick":0,"conf":0.9776,"ms":75,"probs":[0.9776,0.0124,0.01]},{"pick":2,"conf":0.8414,"ms":75,"probs":[0.1365,0.0221,0.8414]},{"pick":1,"conf":0.8097,"ms":77,"probs":[0.0682,0.8097,0.1221]},{"pick":0,"conf":0.6767,"ms":83,"probs":[0.6767,0.1964,0.1269]},{"pick":0,"conf":0.9565,"ms":81,"probs":[0.9565,0.0217,0.0217]},{"pick":1,"conf":0.9347,"ms":83,"probs":[0.0213,0.9347,0.044]},{"pick":2,"conf":0.7985,"ms":77,"probs":[0.1611,0.0404,0.7985]},{"pick":0,"conf":0.9098,"ms":78,"probs":[0.9098,0.0663,0.0239]},{"pick":1,"conf":0.8737,"ms":80,"probs":[0.0411,0.8737,0.0851]},{"pick":0,"conf":0.9791,"ms":83,"probs":[0.9791,0.0075,0.0134]},{"pick":1,"conf":0.9256,"ms":81,"probs":[0.0118,0.9256,0.0627]},{"pick":1,"conf":0.9623,"ms":75,"probs":[0.0141,0.9623,0.0235]},{"pick":2,"conf":0.5631,"ms":76,"probs":[0.4209,0.0159,0.5631]},{"pick":0,"conf":0.9558,"ms":74,"probs":[0.9558,0.0151,0.0291]},{"pick":1,"conf":0.9525,"ms":75,"probs":[0.014,0.9525,0.0335]},{"pick":0,"conf":0.959,"ms":75,"probs":[0.959,0.0235,0.0175]},{"pick":2,"conf":0.8156,"ms":71,"probs":[0.0855,0.0989,0.8156]},{"pick":1,"conf":0.7738,"ms":73,"probs":[0.0701,0.7738,0.1561]},{"pick":1,"conf":0.8369,"ms":79,"probs":[0.0816,0.8369,0.0816]},{"pick":0,"conf":0.9865,"ms":78,"probs":[0.9865,0.007,0.0065]},{"pick":1,"conf":0.9551,"ms":79,"probs":[0.0113,0.9551,0.0336]},{"pick":0,"conf":0.5673,"ms":83,"probs":[0.5673,0.0384,0.3943]},{"pick":1,"conf":0.9218,"ms":78,"probs":[0.0242,0.9218,0.054]},{"pick":0,"conf":0.9849,"ms":81,"probs":[0.9849,0.0081,0.007]},{"pick":1,"conf":0.8862,"ms":76,"probs":[0.0335,0.8862,0.0803]},{"pick":0,"conf":0.9561,"ms":80,"probs":[0.9561,0.0188,0.0251]},{"pick":2,"conf":0.898,"ms":76,"probs":[0.0654,0.0365,0.898]},{"pick":1,"conf":0.9377,"ms":83,"probs":[0.0148,0.9377,0.0475]},{"pick":0,"conf":0.9289,"ms":78,"probs":[0.9289,0.0304,0.0407]}],"drive":[{"text":"๋ฆ๊ฒ ๋ค ์ข ๋ฐ์๋ด","pick":0,"conf":0.8011,"ms":89,"probs":[0.8011,0.0583,0.0043,0.0057,0.0157,0.0034,0.0082,0.0406,0.0628]},{"text":"์ ํธ๋ญ ๋ค์ ๊ณ์ ์๊ธฐ ์ซ์ด","pick":4,"conf":0.4401,"ms":89,"probs":[0.024,0.0461,0.0065,0.4092,0.4401,0.0048,0.0155,0.0167,0.0371]},{"text":"์์ฐจ ๊ทธ๋ฅ ๋ค์ด๋ฐ์๋ฒ๋ ค","pick":8,"conf":0.4951,"ms":94,"probs":[0.1242,0.1788,0.0335,0.0251,0.0417,0.0068,0.0201,0.0747,0.4951]},{"text":"๋ฉ๋ฏธ ๋โฆ ์ฒ์ฒํ ๊ฐ์","pick":1,"conf":0.8667,"ms":92,"probs":[0.0118,0.8667,0.0077,0.0071,0.0264,0.0032,0.0071,0.0472,0.0228]}]};
|
| 312 |
+
</script>
|
| 313 |
+
<script>/* scenarios.js */
|
| 314 |
+
/* ์๋๋ฆฌ์ค ์ ์ โ ํ๋ฉด(inbox.html ยท contract.html)๊ณผ Node(make_examples.js)๊ฐ ๊ฐ์ ์ ์๋ฅผ ์ด๋ค.
|
| 315 |
+
* decide(req): {instruction, item, choices:[๋ฌธ๊ตฌโฆ]} โ ์๋ฒ /api/decide ์๋ต ({choice, probs{A:โฆ}, confidence, ms})
|
| 316 |
+
*/
|
| 317 |
+
(function (root) {
|
| 318 |
+
/* โโ ๋ฌธ์ ๋ถ๋ฅํจ โโ
|
| 319 |
+
* ๋ชจ๋ธ์ด ํ๋ ์ผ: ๋ฌธ์ ํ ๊ฑด์ ์ธ ๊ฐ์ง๋ก ๋์์ ํ์ (์ฌ์ 15๊ฐ์ง ยท ๊ณ ๊ฐ ๊ฐ์ ยท ์ฒ๋ฆฌ ์ ๋ณด).
|
| 320 |
+
* ๊ท์น์ด ํ๋ ์ผ: ์ฌ์ โ ๋ด๋น ๋ถ์ยท๊ธด๊ธ๋ (CASES ํ), ํ์ ์กฐํฉ โ ๋ค์ ์ฒ๋ฆฌ (route).
|
| 321 |
+
* ๊ธด๊ธ๋๋ฅผ ๋ชจ๋ธ์๊ฒ ์ง์ ๋ฌป๋ ๊ฒ๋ณด๋ค ์ฌ์์ ๊ณ ๋ฅด๊ฒ ํ๊ณ ๊ท์น์ผ๋ก ๊ธด๊ธ๋๋ฅผ ์ ํ๋ ์ชฝ์ด ์ ํํ๋ค
|
| 322 |
+
* (์์ 30๊ฑด: ์ฌ์ ๋ถ๋ฅ 24/30, ํ๋ฆฐ 6๊ฑด ์ค 5๊ฑด์ด ํ์ 70% ๋ฏธ๋ง). */
|
| 323 |
+
const CASES = [
|
| 324 |
+
["๊ณ์ ๋์ฉยท๋ฌด๋จ ์ฃผ๋ฌธ ์์ฌ", "๊ณ์ ยท๋ณด์", 0], ["์ด์ค ๊ฒฐ์ ยท๋๋ง ๋น ์ ธ๋๊ฐ", "๊ฒฐ์ ยท์ฒญ๊ตฌ", 0], ["๊ฒฐ์ ๋ ์ ์์ด ์์ ์ ๋๋ ์ฅ์ ", "๊ธฐ์ ์ฅ์ ", 0],
|
| 325 |
+
["์ถ๊ณ ์ ์ฃผ์ยท์ฃผ๋ฌธ ๋ณ๊ฒฝ", "๋ฐฐ์ก", 0], ["๊ฐ์ธ์ ๋ณด ์ ์ถ ๋ฌธ์", "๊ณ์ ยท๋ณด์", 0],
|
| 326 |
+
["๋ฐฐ์ก ์ง์ฐยท๋ฐฐ์ก ์์น ๋ฌธ์", "๋ฐฐ์ก", 1], ["๋ฐํยท๊ตํยทํ๋ถ ์์ฒญ", "ํ๋ถยท๋ฐํ", 1], ["๋ฐ์ ์ํ ๋ถ๋ยทํ์ยท์ค๋ฐฐ์ก", "ํ๋ถยท๋ฐํ", 1],
|
| 327 |
+
["๋ก๊ทธ์ธยท๋น๋ฐ๋ฒํธยทํ์ ์ ๋ณด", "๊ณ์ ยท๋ณด์", 1], ["์ฑยท์ฌ์ดํธ ์ผ๋ถ ๊ธฐ๋ฅ ์ค๋ฅ", "๊ธฐ์ ์ฅ์ ", 1], ["์๋ด ์ง์ฐยท์๋ ๋ถ๋ง", "๊ณ ๊ฐ ๊ฒฝํ", 1],
|
| 328 |
+
["์์์ฆยทํฌ์ธํธยท์ ๋ฆฝ๊ธยทํ ๋ถ ๋ฑ ๊ฒฐ์ ๋ฌธ์", "๊ฒฐ์ ยท์ฒญ๊ตฌ", 2], ["์ํ ์ฌ์ฉ๋ฒยท์ฌ๊ณ ยท๋ฐฐ์ก ๊ฐ๋ฅ ์ง์ญ ๋ฑ ์ด์ฉ ๋ฌธ์", "์ํ ๋ฌธ์", 2],
|
| 329 |
+
["์นญ์ฐฌยท๊ฐ์ฌ", "๊ณ ๊ฐ ๊ฒฝํ", 2], ["์๋น์ค ๊ฐ์ ์ ์", "๊ณ ๊ฐ ๊ฒฝํ", 2],
|
| 330 |
+
].map(([label, dept, urgency]) => ({ label, dept, urgency }));
|
| 331 |
+
const URGENCY = ["๊ธด๊ธ", "๋ณดํต", "๋ฎ์"];
|
| 332 |
+
const AXES = [
|
| 333 |
+
{ key: "case", label: "์ฌ์", instruction: "๊ณ ๊ฐ ๋ฌธ์๊ฐ ์ด๋ค ์ฌ์์ธ์ง ๊ณ ๋ฅธ๋ค. ์ฌ๋ฌ ๋ด์ฉ์ด ์์ฌ ์์ผ๋ฉด ๊ณ ๊ฐ์ด ์ง๊ธ ๊ฐ์ฅ ํด๊ฒฐ๋ฐ๊ณ ์ถ์ ์ผ์ ๊ณ ๋ฅธ๋ค. ๋ฐ์ด์ ๋ถ๋ง ํํ์ ๊ณ ๋ คํ๋ค.",
|
| 334 |
+
choices: CASES.map(c => c.label), short: CASES.map(c => c.label) },
|
| 335 |
+
{ key: "mood", label: "๊ณ ๊ฐ ๊ฐ์ ", instruction: "๊ณ ๊ฐ ๋ฌธ์์ ๋๋ฌ๋ ๊ณ ๊ฐ์ ๊ฐ์ ์ํ๋ฅผ ๊ณ ๋ฅธ๋ค. ๋ฐ์ด์ ๋ถ์ ํํ์ ๊ณ ๋ คํ๋ค.",
|
| 336 |
+
choices: ["ํ๋จยท๋ถ๋ง", "์ค๋ฆฝ", "๋ง์กฑยท๊ฐ์ฌ"], short: ["๋ถ๋ง", "์ค๋ฆฝ", "๋ง์กฑ"] },
|
| 337 |
+
{ key: "info", label: "์ฒ๋ฆฌ ์ ๋ณด", instruction: "๋ฌธ์๋ฅผ ์ฒ๋ฆฌํ๋ ค๋ฉด ํน์ ์ฃผ๋ฌธ์ ์ฐพ์์ผ ํ๋๋ฐ ์ฃผ๋ฌธ๋ฒํธยท์ด์ก์ฅ ๋ฒํธยท๊ฒฐ์ ์ผ์ ๊ฐ์ ์๋ณ ์ ๋ณด๊ฐ ๋น ์ ธ ์๋์ง ํ๋จํ๋ค. ์ผ๋ฐ์ ์ธ ์ง๋ฌธ์ด๋ ๊ณ์ ๋ฌธ์ ์ฒ๋ผ ์ฃผ๋ฌธ์ ์ฐพ์ ํ์๊ฐ ์์ผ๋ฉด ๋น ์ง ๊ฒ์ด ์๋ค.",
|
| 338 |
+
choices: ["๋น ์ง ์ ๋ณด ์์: ๋ฐ๋ก ์ฒ๋ฆฌ ๊ฐ๋ฅ", "์๋ณ ์ ๋ณด ๋ถ์กฑ: ๊ณ ๊ฐ์๊ฒ ๋๋ฌผ์ด์ผ ํจ"], short: ["์ ๋ณด ์ถฉ๋ถ", "์ ๋ณด ๋ถ์กฑ"] },
|
| 339 |
+
];
|
| 340 |
+
/* ์์ ๋ฌธ์ 30๊ฑด (์ง์ ๋ง๋ ๊ฒ) ยท gold = ์ฌ๋์ด ๋ถ์ธ ์ฌ์ ์ ๋ต (๋ ๋ค ๋ง๋ค๊ณ ๋ณผ ์ ์์ผ๋ฉด ๋ ๊ฐ) */
|
| 341 |
+
const SAMPLES = [
|
| 342 |
+
["์ ๊ณ์ ์ ์ ๊ฐ ํ์ง ์์ ์ฃผ๋ฌธ์ด 3๊ฑด ์์ด์!! ํดํน๋นํ ๊ฒ ๊ฐ์์ ๋นจ๋ฆฌ ํ์ธํด์ฃผ์ธ์", [0]],
|
| 343 |
+
["์ฃผ๋ฌธ๋ฒํธ 20261102-5531 ์์ง๋ ๋ฐฐ์ก ์ค๋น์ค์ด๋ค์. ๋ค์ ์ฃผ ์ด์ฌ๋ผ ๊ทธ ์ ์ ๊ผญ ๋ฐ์์ผ ํด์.", [5]],
|
| 344 |
+
["๋ฐฐ์ก ์ฐธ ๋น ๋ฅด๋ค์. ์ฃผ๋ฌธํ๊ณ 2์ฃผ ๋ง์ ์์ด์.", [5]],
|
| 345 |
+
["์นด๋์์ 39,800์์ด ๋ ๋ฒ ๊ฒฐ์ ๋์ด์. 11์ 7์ผ ์คํ 9์์ฏค์ด์์.", [1]],
|
| 346 |
+
["ํ๋ถํด ์ฃผ์ธ์.", [6]],
|
| 347 |
+
["์๋ด์ฌ ๊น์ง์๋ ๋๋ถ์ ๋ฌธ์ ์ ํด๊ฒฐํ์ด์. ์ ๋ง ๊ฐ์ฌํฉ๋๋ค!", [13]],
|
| 348 |
+
["์ด ์์ดํ๋ผ์ด์ด ๋ฐ์ค์ผ ์๊ธฐ์ธ์ฒ๊ธฐ์ ๋ฃ์ด๋ ๋๋์?", [12]],
|
| 349 |
+
["์ฑ ์
๋ฐ์ดํธ ํ๋ก ์ฅ๋ฐ๊ตฌ๋๊ฐ ๊ณ์ ๋น์ด ์์ด์. ๋ช ๋ฒ์ ๋ด์๋ ์ฌ๋ผ์ ธ์.", [9]],
|
| 350 |
+
["์ด์ ๋ฐ์ ๋ํธ์ ๊ตฌ๋ฉ์ด ๋ ์์ด์. ๊ตํ ๋ง๊ณ ํ๋ถ๋ก ํด์ฃผ์ธ์. ์ฃผ๋ฌธ๋ฒํธ 20261105-2210", [7, 6]],
|
| 351 |
+
["๋น๋ฐ๋ฒํธ ์ฌ์ค์ ๋ฉ์ผ์ด ์ ์์. ์คํธํจ๋ ํ์ธํ์ด์.", [8]],
|
| 352 |
+
["๋ฐํ ์ ์ํ๋๋ฐ ํ๋ฐฐ ๊ธฐ์ฌ๋์ด ์๊ฑฐ๋ฅผ ์ ์ค์
จ์ด์. 3์ผ์งธ ๋ฌธ ์์ ๋๊ณ ์์ด์.", [6]],
|
| 353 |
+
["์ค๋ ๊ฒฐ์ ๊ฐ ์ ๋๊ณ '์ผ์์ ์ค๋ฅ'๋ง ๋ ์. ๋ค๋ฅธ ์นด๋๋ ๋ง์ฐฌ๊ฐ์ง์์.", [2]],
|
| 354 |
+
["๋๋์ฒด ๋ช ๋ฒ์ ๋ฌธ์ํด์ผ ๋ต์ด ์ค๋์? ์ผ์ฃผ์ผ์งธ ๋ต์ด ์๋ค์. ์ ๋ง ์ค๋ง์
๋๋ค.", [10]],
|
| 355 |
+
["์ฌ์ด์ฆ 230 ์ฌ์
๊ณ ์๋ฆผ ์ ์ฒญํ๋๋ฐ ์ธ์ ์ฏค ๋ค์ด์ค๋์?", [12]],
|
| 356 |
+
["์ฃผ์๋ฅผ ์๋ชป ์
๋ ฅํ์ด์. ์์ง ์ถ๋ฐ ์ ์ด๋ฉด ๋ฐ๊ฟ์ฃผ์ธ์. ์ฃผ๋ฌธ๋ฒํธ 20261108-0912", [3]],
|
| 357 |
+
["ํ๊ธ์์์ฆ ๋ฐํ ๊ฐ๋ฅํ๊ฐ์? ์ฌ์
์ ๋ฒํธ๋ก ๋ฐ๊ณ ์ถ์ด์.", [11]],
|
| 358 |
+
["๊ฒฐ์ ๋ ๋๋๋ฐ ์ฃผ๋ฌธ ๋ด์ญ์ ์๋ฌด๊ฒ๋ ์์ด์. ๋๋ง ๋น ์ ธ๋๊ฐ์ด์.", [1]],
|
| 359 |
+
["๊ฐ์ธ์ ๋ณด๊ฐ ์ ์ถ๋๋ค๋ ๋ฌธ์๋ฅผ ๋ฐ์์ด์. ์ง์ง์ธ๊ฐ์? ์ ์ ๋ณด๋ ํฌํจ๋๋์ง ์๊ณ ์ถ์ด์.", [4]],
|
| 360 |
+
["๋ฐฐ์ก ๊ธฐ์ฌ๋์ด ๋๋ฌด ์น์ ํ์
จ์ด์. ๋น ์ค๋ ๋ ํ๊ด ์๊น์ง ๋ฃ์ด ์ฃผ์
จ์ด์.", [13]],
|
| 361 |
+
["๋ฐ์ ์ํ์ด ์ฃผ๋ฌธํ ์์ด๋ ๋ฌ๋ผ์. ๊ฒ์ ์์ผฐ๋๋ฐ ๋จ์์ด ์์ด์.", [7]],
|
| 362 |
+
["ํํดํ๊ณ ์ถ์๋ฐ ๋ฉ๋ด๋ฅผ ๋ชป ์ฐพ๊ฒ ์ด์.", [8]],
|
| 363 |
+
["ํฌ์ธํธ๊ฐ ์๋ฉธ๋๋ค๊ณ ๋์ค๋๋ฐ ์ ํจ๊ธฐ๊ฐ ์๋ด๋ฅผ ๋ฐ์ ์ ์ด ์์ด์.", [11]],
|
| 364 |
+
["ํ๋ฐฐ ์์๊ฐ ๋ค ์ ์ด์ ์์ด์. ์์ ๋ ์ฑ
๋ ์ ์์ด์.", [7]],
|
| 365 |
+
["๊ตํ ์ ์ฒญํ ์ง ์ดํ ๋๋๋ฐ ์๋ฌด ์ฐ๋ฝ์ด ์๋ค์. ๊ทธ๋ฅ ํ๋ถํด ์ฃผ์ธ์.", [6, 10]],
|
| 366 |
+
["์ฑ ๊ธ์จ๊ฐ ๋๋ฌด ์์์ ๋ถ๋ชจ๋์ด ์ฐ๊ธฐ ํ๋ค์ดํ์ธ์. ํฌ๊ฒ ๋ณผ ์ ์๋ ๊ธฐ๋ฅ์ด ์์ผ๋ฉด ์ข๊ฒ ์ด์.", [14]],
|
| 367 |
+
["ํ ๋ถ๋ก ๊ฒฐ์ ํ๋๋ฐ ์ผ์๋ถ๋ก ๋ฐ๊ฟ ์ ์๋์?", [11]],
|
| 368 |
+
["ํด์ธ ๋ฐฐ์ก๋ ๋๋์? ์ผ๋ณธ์ ์ฌ๋ ๋์ํํ
๋ณด๋ด๊ณ ์ถ์ด์.", [12]],
|
| 369 |
+
["์ฃผ๋ฌธ ์ทจ์ ๋ฒํผ์ด ์ ๋๋ ค์. ์์ง ๊ฒฐ์ ๋๊ธฐ ์ํ์์.", [9, 3]],
|
| 370 |
+
["๋ฆฌ๋ทฐ ์ฐ๋ฉด ์ ๋ฆฝ๊ธ ์ค๋ค๊ณ ํ๋๋ฐ ์์ง ์ ๋ค์ด์์ด์.", [11]],
|
| 371 |
+
["๋ก๊ทธ์ธํ ๋๋ง๋ค ์ธ์ฆ๋ฒํธ๋ฅผ ๋ฐ์์ผ ํ๋์? ๋๋ฌด ๋ฒ๊ฑฐ๋ก์์.", [8, 14]],
|
| 372 |
+
].map(([text, gold]) => ({ text, gold }));
|
| 373 |
+
async function classify(text, decide) {
|
| 374 |
+
const t0 = Date.now();
|
| 375 |
+
const res = await Promise.all(AXES.map(async ax => {
|
| 376 |
+
const r = await decide({ instruction: ax.instruction, item: { "๋ฌธ์": text }, choices: ax.choices });
|
| 377 |
+
const pick = r.choice.charCodeAt(0) - 65;
|
| 378 |
+
return [ax.key, { pick, conf: r.confidence, ms: r.ms, probs: ax.choices.map((_, i) => r.probs[String.fromCharCode(65 + i)] || 0) }];
|
| 379 |
+
}));
|
| 380 |
+
return { text, axes: Object.fromEntries(res), wall: Date.now() - t0 };
|
| 381 |
+
}
|
| 382 |
+
/* ํ์ ๊ฒฐ๊ณผ โ ๋ค์ ์ฒ๋ฆฌ (๋ชจ๋ธ์ด ์๋๋ผ ์ ํด ๋ ๊ท์น). ์ฌ์ ํ์ ์ด ๊ธฐ์ค๋ณด๋ค ๋ฎ์ผ๋ฉด ์ฌ๋์๊ฒ */
|
| 383 |
+
function route(r, threshold) {
|
| 384 |
+
const a = r.axes, c = CASES[a.case.pick];
|
| 385 |
+
if (a.case.conf < threshold) return { kind: "review", label: "์ฌ๋ ๊ฒํ ", why: `์ฌ์ ํ๋จ ํ์ ${Math.round(a.case.conf * 100)}%` };
|
| 386 |
+
if (c.urgency === 0) return { kind: "urgent", label: `${c.dept}ํ ์ฆ์ ๋ฐฐ์ `, why: "๊ธด๊ธ ์ฌ์ ยท ๋ด๋น์ ํธ์ถ" };
|
| 387 |
+
if (a.case.pick === 13) return { kind: "auto", label: "๊ฐ์ฌ ๋ต์ฅ ์๋ ๋ฐ์ก", why: "์นญ์ฐฌยท๊ฐ์ฌ" };
|
| 388 |
+
if (a.info.pick === 1 && a.info.conf >= threshold) return { kind: "auto", label: "์ฃผ๋ฌธ๋ฒํธ ๋๋ฌป๊ธฐ ์๋ ๋ฐ์ก", why: "์๋ณ ์ ๋ณด ๋ถ์กฑ" };
|
| 389 |
+
return { kind: "queue", label: `${c.dept}ํ ๋๊ธฐ์ด`, why: a.mood.pick === 0 && a.mood.conf >= threshold ? "๋ถ๋ง ๊ณ ๊ฐ ยท ์์ชฝ์ ๋ฐฐ์น" : `${URGENCY[c.urgency]} ยท ์์๋๋ก` };
|
| 390 |
+
}
|
| 391 |
+
|
| 392 |
+
/* โโ ๊ณ์ฝ์ ๊ฒํ โโ ์กฐํญ๋ง๋ค ์ฒดํฌ๋ฆฌ์คํธ๋ฅผ ์/์๋์ค๋ก, ๋ด ์ดํด(์ฃผ์ฅ)๋ ์กฐํญ๋ง๋ค ํจ์ยท๋ชจ์ยท๋ฌด๊ด์ผ๋ก */
|
| 393 |
+
const BOOL_INSTR = "๋ฌธ๋จ์ ๊ทผ๊ฑฐํ์ฌ ์ง๋ฌธ์ ์/์๋์ค๋ก ๋ตํ๋ค.";
|
| 394 |
+
const NLI_INSTR = "์ ์ ๋ฅผ ์ฐธ์ด๋ผ๊ณ ํ ๋ ๊ฐ์ค์ ๋ถ๋ฅํ๋ค. entailment: ์ ์ ๋ก๋ถํฐ ๊ฐ์ค์ด ๋ฐ๋ผ์จ๋ค. contradiction: ์ ์ ์ ๊ฐ์ค์ด ์๋ฆฝํ ์ ์๋ค. neutral: ๋ ๋ค ์๋๋ค. ์ ๋ณด๊ฐ ์๋ค๋ ์ด์ ๋ง์ผ๋ก contradiction์ ๊ณ ๋ฅด์ง ์๋๋ค. neutral์ ์ ์ ์ ๋ต์ด๋ฉฐ insufficient_context๊ฐ ์๋๋ค. ํต์์ ์ธ ๋ฌธ์ฅ ์๋ฏธ๋ก ํ๋จํ๋ฉฐ ํฌ๋ฐํ ๊ฐ์ ์ ๋ง๋ค์ด ๋ชจํธํ๋ค๊ณ ํ์ง ์๋๋ค. ์ ์ ์ ์ด๊ฑฐ ๋์๊ณผ ๊ฐ์ค์ ๋ฒ์๋ฅผ ๋น ์ง์์ด ๋์กฐํ๋ค. ๊ฐ์ค์ ๋ง/๋ฐ์/์ค์ง/๋ชจ๋ ๊ฐ์ ํํ์ด ์ ์ ์ ๋ช
์๋ ๋ค๋ฅธ ๋์์ด๋ ์ฌ๋ก๋ฅผ ๋ฐฐ์ ํ๋์ง ํ์ธํ๋ค. ์ ์ ์ ๋ฐฐํ ํํ์ด ์๋ค๋ ์ฌ์ค๋ง์ผ๋ก ์ค๋ฆฝ์ด๋ผ๊ณ ํ์ง ์๋๋ค. ํต์์ ์ธ ๋ฌธ๋งฅ์ด ๋ช
ํํ๋ฉด ๋ค๋ฅธ ์์ธยท์ํฉ์ ์์๋ก ์ถ๊ฐํ์ง ์๋๋ค.";
|
| 395 |
+
/* ์ฒดํฌ๋ฆฌ์คํธ๋ '์กฐํญ์ด ์ด ๋ฌธ์ฅ์ ๋ท๋ฐ์นจํ๋๊ฐ(entailment)'๋ก ํ์ ํ๋ค. ์/์๋์ค ๋ฐฉ์๋ณด๋ค ์ธ๊ธ ์๋ ์กฐํญ์ ์ ๊ฑธ๋ฌ ๋ธ๋ค
|
| 396 |
+
(์์ ๊ณ์ฝ์ 60์นธ ๋น๊ต: ๋ฌธ์ฅ ๊ด๊ณ 59/60, ์/์๋์ค 55/60) */
|
| 397 |
+
const QUESTIONS = [
|
| 398 |
+
{ short: "์๋ ์ฐ์ฅ", h: "์๋ฌด๋ ํด์ง๋ฅผ ์๋ฆฌ์ง ์์ผ๋ฉด ๊ณ์ฝ์ด ์๋์ผ๋ก ์ฐ์ฅ๋๋ค.", risk: "์ฃผ์" },
|
| 399 |
+
{ short: "์ค๋ ํด์ง ์์ฝ๊ธ", h: "์์ฐจ์ธ์ด ๊ณ์ฝ๊ธฐ๊ฐ ์ค์ ํด์งํ๋ฉด ์์ฝ๊ธ์ ๋ด์ผ ํ๋ค.", risk: "์ฃผ์" },
|
| 400 |
+
{ short: "์๋์ธ ์ผ๋ฐฉ ํด์ง", h: "์๋์ธ์ ํต์ง๋ง ํ๋ฉด ์ธ์ ๋ ์ง ๊ณ์ฝ์ ํด์งํ ์ ์๋ค.", risk: "์ํ" },
|
| 401 |
+
{ short: "๋ณด์ฆ๊ธ ๊ณต์ ", h: "์๋์ธ์ ๋ณด์ฆ๊ธ์์ ๋น์ฉ์ ๋นผ๊ณ ๋๋ ค์ค ์ ์๋ค.", risk: "์ฃผ์" },
|
| 402 |
+
{ short: "๋น์ฉ ์ ๋ถ ์ ๊ฐ", h: "์๋ฆฌ๋น๋ ์์ธ๊ณผ ๊ด๊ณ์์ด ์์ฐจ์ธ์ด ๋ชจ๋ ๋ถ๋ดํ๋ค.", risk: "์ํ" },
|
| 403 |
+
{ short: "์ฆ์ ํด์ง ์กฐ๊ฑด", h: "์์ฐจ์ธ์ด ์๋ฌด๋ฅผ ์ด๊ธฐ๋ฉด ์๋์ธ์ ์ฆ์ ๊ณ์ฝ์ ํด์งํ ์ ์๋ค.", risk: "์ฃผ์" },
|
| 404 |
+
];
|
| 405 |
+
const CONTRACT = `์ฃผํ ์์ธ ๊ณ์ฝ์ (์์)
|
| 406 |
+
์ 1์กฐ(๋ชฉ์ ๋ฌผ) ์๋์ธ ๋ฐ์์ค์ ์์ธํน๋ณ์ ๋งํฌ๊ตฌ ์ฑ๋ฏธ์ฐ๋ก 00, 302ํธ(์ ์ฉ 33ใก)๋ฅผ ์์ฐจ์ธ ์ดํ์์๊ฒ ์๋ํ๋ค.
|
| 407 |
+
์ 2์กฐ(๋ณด์ฆ๊ธ๊ณผ ์ฐจ์) ๋ณด์ฆ๊ธ์ 1,000๋ง์, ์ ์ฐจ์์ 65๋ง์์ผ๋ก ํ๋ฉฐ ์์ฐจ์ธ์ ๋งค์ 25์ผ๊น์ง ์๋์ธ ๊ณ์ข๋ก ์ง๊ธํ๋ค. ๊ด๋ฆฌ๋น ์ 7๋ง์์ ๋ณ๋๋ก ์ง๊ธํ๋ค.
|
| 408 |
+
์ 3์กฐ(๊ณ์ฝ๊ธฐ๊ฐ) ๊ณ์ฝ๊ธฐ๊ฐ์ 2026๋
3์ 1์ผ๋ถํฐ 2028๋
2์ 29์ผ๊น์ง 24๊ฐ์๋ก ํ๋ค. ๊ณ์ฝ ๋ง๋ฃ 2๊ฐ์ ์ ๊น์ง ์ด๋ ์ชฝ๋ ์๋ฉด์ผ๋ก ํด์ง๋ฅผ ํต์งํ์ง ์์ผ๋ฉด ๊ฐ์ ์กฐ๊ฑด์ผ๋ก 1๋
๊ฐ ์๋ ์ฐ์ฅ๋๋ค.
|
| 409 |
+
์ 4์กฐ(์ค๋ํด์ง) ์์ฐจ์ธ์ด ๊ณ์ฝ๊ธฐ๊ฐ ์ค์ ํด์งํ๋ ค๋ฉด 2๊ฐ์ ์ ์ ์๋ ค์ผ ํ๋ฉฐ, ์ด ๊ฒฝ์ฐ ์ ์ฐจ์ 2๊ฐ์๋ถ์ ์์ฝ๊ธ์ผ๋ก ์ง๊ธํ๋ค.
|
| 410 |
+
์ 5์กฐ(์๋์ธ์ ํด์ง) ์๋์ธ์ ํ์ํ๋ค๊ณ ํ๋จํ๋ ๊ฒฝ์ฐ 14์ผ ์ ํต์ง๋ง์ผ๋ก ์ธ์ ๋ ์ง ์ด ๊ณ์ฝ์ ํด์งํ ์ ์์ผ๋ฉฐ, ์์ฐจ์ธ์ ์ด์ ์ด์๋ฅผ ์ ๊ธฐํ์ง ์๋๋ค.
|
| 411 |
+
์ 6์กฐ(๋ณด์ฆ๊ธ ๋ฐํ) ์๋์ธ์ ๊ณ์ฝ์ด ๋๋๊ณ ์์ฐจ์ธ์ด ์ง์ ๋น์ด ๋ ๋ถํฐ 30์ผ ์ด๋ด์ ๋ณด์ฆ๊ธ์ ๋๋ ค์ค๋ค. ๋ค๋ง ๋ฐ๋ฆฐ ์ฐจ์, ๊ด๋ฆฌ๋น์ ์์๋ณต๊ตฌ ๋น์ฉ์ ๋นผ๊ณ ๋๋ ค์ค ์ ์๋ค.
|
| 412 |
+
์ 7์กฐ(์๋ฆฌ์ ์์๋ณต๊ตฌ) ๊ณ์ฝ๊ธฐ๊ฐ ์ค ๋ฐ์ํ๋ ๋ชจ๋ ์๋ฆฌ ๋น์ฉ์ ์์ธ๊ณผ ๊ด๊ณ์์ด ์์ฐจ์ธ์ด ๋ถ๋ดํ๋ฉฐ, ํด๊ฑฐ ์ ๋๋ฐฐยท์ฅํ์ ํฌํจํ์ฌ ์
์ฃผ ๋น์ ์ํ๋ก ์์๋ณต๊ตฌํ๋ค.
|
| 413 |
+
์ 8์กฐ(๋ฐ๋ ค๋๋ฌผ) ์์ฐจ์ธ์ ์๋์ธ์ ์๋ฉด ๋์ ์์ด ๋ฐ๋ ค๋๋ฌผ์ ๊ธฐ๋ฅผ ์ ์์ผ๋ฉฐ, ์ด๋ฅผ ์ด๊ธฐ๋ฉด ์๋์ธ์ ์ฆ์ ๊ณ์ฝ์ ํด์งํ ์ ์๋ค.
|
| 414 |
+
์ 9์กฐ(์ ๋ ๊ธ์ง) ์์ฐจ์ธ์ ์๋์ธ์ ๋์ ์์ด ๋ชฉ์ ๋ฌผ์ ๋ค๋ฅธ ์ฌ๋์๊ฒ ๋ค์ ๏ฟฝ๏ฟฝ๋ ค์ฃผ๊ฑฐ๋ ์์ฐจ๊ถ์ ๋๊ธธ ์ ์๋ค.
|
| 415 |
+
์ 10์กฐ(๋ถ์ ํด๊ฒฐ) ์ด ๊ณ์ฝ์ ๊ดํ ๋ถ์์ ์๋์ธ ์ฃผ์์ง ๊ดํ ๋ฒ์์์ ํด๊ฒฐํ๋ค.`;
|
| 416 |
+
const CLAIMS = ["๋ณด์ฆ๊ธ์ ์ง์ ๋น์ฐ๋ ๋ ๋ฐ๋ก ์ ์ก ๋๋ ค๋ฐ๋๋ค.", "๋ฐ๋ ค๋๋ฌผ์ ์ง์ฃผ์ธ ํ๋ฝ์ ๋ฐ์ผ๋ฉด ํค์ธ ์ ์๋ค.", "์์ธ๋ ๋งค๋ฌ ๋ง์ผ๊น์ง ๋ด๋ฉด ๋๋ค.", "์ง์ฃผ์ธ์ 2์ฃผ ์ ์ ์๋ฆฌ๊ธฐ๋ง ํ๋ฉด ๋๋ฅผ ๋ด๋ณด๋ผ ์ ์๋ค."];
|
| 417 |
+
|
| 418 |
+
/* ์กฐํญ ๋๋๊ธฐ: "์ n์กฐ"๋ก ์์ํ๋ ์ค๋ง๋ค ํ๋. ์์ผ๋ฉด ๋น ์คยท์ค๋ฐ๊ฟ ๋จ์ */
|
| 419 |
+
function splitClauses(text) {
|
| 420 |
+
const lines = text.split(/\r?\n/).map(s => s.trim()).filter(Boolean);
|
| 421 |
+
const out = []; let cur = null;
|
| 422 |
+
for (const ln of lines) {
|
| 423 |
+
const m = ln.match(/^์ \s*(\d+)\s*์กฐ\s*(?:\(([^)]*)\))?/);
|
| 424 |
+
if (m) { cur = { no: `์ ${m[1]}์กฐ`, title: m[2] || "", text: ln }; out.push(cur); }
|
| 425 |
+
else if (cur) cur.text += " " + ln;
|
| 426 |
+
}
|
| 427 |
+
if (out.length) return out;
|
| 428 |
+
return lines.filter(l => l.length > 12).map((l, i) => ({ no: `${i + 1}`, title: "", text: l }));
|
| 429 |
+
}
|
| 430 |
+
async function askClause(clause, h, decide) {
|
| 431 |
+
const r = await decide({ instruction: NLI_INSTR, item: { premise: clause.text, hypothesis: h }, choices: ["entailment", "contradiction", "neutral"] });
|
| 432 |
+
return { yes: r.probs.A, con: r.probs.B, ms: r.ms };
|
| 433 |
+
}
|
| 434 |
+
async function checkClaim(clause, claim, decide) {
|
| 435 |
+
const r = await decide({ instruction: NLI_INSTR, item: { premise: clause.text, hypothesis: claim }, choices: ["entailment", "contradiction", "neutral"] });
|
| 436 |
+
return { ent: r.probs.A, con: r.probs.B, neu: r.probs.C, ms: r.ms };
|
| 437 |
+
}
|
| 438 |
+
|
| 439 |
+
/* โโ ๋ง๋ก ์ด์ ํ๊ธฐ โโ ํ์น์ ๋ง โ ์ด์ ๋์. ๊ฑฐ๋ฆฌยท์๋ ๊ณ์ฐ ๊ฐ์ ๊ธฐ๋ณธ ์ฃผํ๊ณผ ์ถฉ๋ ๋ฐฉ์ง๋ ๊ท์น์ด ๋งก๋๋ค
|
| 440 |
+
* (์ํ 18๋ฌธ์ฅ: 15/18. ํ๋ฆฐ 3๊ฑด์ ํ์ ์ด ๋ฎ๊ฑฐ๋('๋นต ํด'โ๊ฐ์ 33%) ์์ ํ ์ชฝ('๋ฉ์ถฐ'โ๊ฐ์, '์ถ์ํด'โ๊ฑฐ์ )).
|
| 441 |
+
* ๋ชจ๋ธ์๊ฒ ์ง์ ์ฐจ๋ฅผ ๋ชฐ๊ฒ ํ๋ฉด(๊ฑฐ๋ฆฌยท์๋ ์ซ์๋ก ํ๋จ) 60๊ฐ ์ํฉ ์ค 9๊ฐ๋ง ์์ ๊ธฐ์ค๊ณผ ๋ง์์ ์ด ๋ฐฉ์์ ํํ๋ค */
|
| 442 |
+
const DRIVE_INSTR = "์์จ์ฃผํ์ฐจ ํ์น์์ ๋ง์ ๋ฃ๊ณ ์ฐจ๊ฐ ํ ์ด์ ๋์ ํ๋๋ฅผ ๊ณ ๋ฅธ๋ค. ๋๋ ค ๋งํ๊ฑฐ๋ ๊ฐ์ ์ ํํํ ๋ง๋ ํ์น์๊ฐ ์ํ๋ ๋์์ผ๋ก ํด์ํ๋ค. ๋ค๋ฅธ ์ฐจ์ ๋ถ๋ช์น๊ฑฐ๋, ์ ํธ๋ฅผ ๋ฌด์ํ๊ฑฐ๋, ์ ํ์๋๋ฅผ ํฌ๊ฒ ๋๊ธฐ๋ผ๋ ์์ฒญ์ ์ด๋ค ํํ์ด๋ ๊ฑฐ์ ํ๋ค. ์์ฐจ๋ฅผ ์์ง๋ฌ ๊ฐ๊ณ ์ถ๋ค๋ ๋ง์ ์ฐจ์ ๋ณ๊ฒฝ์ด๋ค.";
|
| 443 |
+
const DRIVE = [
|
| 444 |
+
{ key: "faster", text: "๊ฐ์: ์๋๋ฅผ ์ฌ๋ฆฐ๋ค", short: "๊ฐ์" }, { key: "slower", text: "๊ฐ์: ์๋๋ฅผ ์ค์ธ๋ค", short: "๊ฐ์" },
|
| 445 |
+
{ key: "stop", text: "์ ์ง: ์์ ํ๊ฒ ์ฐจ๋ฅผ ์ธ์ด๋ค", short: "์ ์ง" }, { key: "left", text: "์ผ์ชฝ ์ฐจ์ ์ผ๋ก ์ฎ๊ธด๋ค", short: "์ผ์ชฝ ์ฐจ์ " },
|
| 446 |
+
{ key: "right", text: "์ค๋ฅธ์ชฝ ์ฐจ์ ์ผ๋ก ์ฎ๊ธด๋ค", short: "์ค๋ฅธ์ชฝ ์ฐจ์ " }, { key: "hazard", text: "๋น์๋ฑ์ ์ผ ๋ค", short: "๋น์๋ฑ" },
|
| 447 |
+
{ key: "horn", text: "๊ฒฝ์ ์ ์ธ๋ฆฐ๋ค", short: "๊ฒฝ์ " }, { key: "keep", text: "๊ทธ๋๋ก ์ฃผํ: ์ด์ ๊ณผ ๊ด๊ณ์๋ ๋ง์ด๊ฑฐ๋ ์ง๊ธ์ฒ๋ผ ๊ฐ๋ผ๋ ๋ป", short: "๊ทธ๋๋ก" },
|
| 448 |
+
{ key: "refuse", text: "๊ฑฐ์ : ๋ค๋ฅธ ์ฐจ์ ๋ถ๋ช์น๊ธฐยท์ ํธ ์๋ฐยท๊ณผ์ยท๊ฐ๊ธธ ์ฃผํ์ฒ๋ผ ์ฌ๊ณ ๋ฅผ ๋ด๊ฑฐ๋ ๋ฒ์ ์ด๊ธฐ๋ ์์ฒญ", short: "๊ฑฐ์ " },
|
| 449 |
+
];
|
| 450 |
+
const DRIVE_SAMPLES = [["ํ๋ฒํ๊ฒ", ["์ข ๋ ๋นจ๋ฆฌ ๊ฐ์", "์ค๋ฅธ์ชฝ ์ฐจ์ ์ผ๋ก ๊ฐ ์ค", "๋ค์ฐจ๊ฐ ๋๋ฌด ๋ถ์ด, ๋น์๋ฑ ์ผ ์ค"]],
|
| 451 |
+
["๋๋ ค ๋งํ๊ธฐ", ["๋ฆ๊ฒ ๋ค ์ข ๋ฐ์๋ด", "๋ฉ๋ฏธ ๋โฆ ์ฒ์ฒํ ๊ฐ์", "์ ํธ๋ญ ๋ค์ ๊ณ์ ์๊ธฐ ์ซ์ด, ์ผ์ชฝ์ผ๋ก ๋น ์ ธ", "์ค๋ฅธ์ชฝ ์ฐจ์ ์ด ๋ ๋น ๋ฅธ ๊ฒ ๊ฐ์๋ฐ"]],
|
| 452 |
+
["์ํํ ๋ถํ", ["์์ฐจ ๊ทธ๋ฅ ๋ค์ด๋ฐ์๋ฒ๋ ค", "๋นจ๊ฐ๋ถ์ธ๋ฐ ๊ทธ๋ฅ ๊ฐ", "์์ 200์ผ๋ก ๋ฌ๋ ค๋ด"]],
|
| 453 |
+
["์ด์ ๊ณผ ๋ฌด๊ด", ["์ค๋ ํ๋ ์ง์ง ์์๋ค", "์์
์ข ํ์ด์ค"]]];
|
| 454 |
+
async function drive(text, decide, situation) {
|
| 455 |
+
const r = await decide({ instruction: DRIVE_INSTR, item: { "ํ์ฌ ์ํฉ": situation || "ํธ๋ 3์ฐจ์ ๋๋ก 2์ฐจ์ , ์์ 70km, ์์ฐจ์ 30m", "ํ์น์ ๋ง": text }, choices: DRIVE.map(d => d.text) });
|
| 456 |
+
const pick = r.choice.charCodeAt(0) - 65;
|
| 457 |
+
return { text, pick, conf: r.confidence, ms: r.ms, probs: DRIVE.map((_, i) => r.probs[String.fromCharCode(65 + i)] || 0) };
|
| 458 |
+
}
|
| 459 |
+
|
| 460 |
+
/* โโ AI ๋ด์ค ํธ๋ ์ด๋ โโ ๊ฐ์ ํ์ฌ ๋ด์ค โ ํธ์ฌ/์
์ฌ/์ํฅ ์ ์. ๊ฐ์ ์์ฅ์ ๋ด์ค์ ์ ๋ต ์ํฅ(impact)๋๋ก ์์ง์ธ๋ค
|
| 461 |
+
* (์ํ 18๊ฑด: 15/18, ํ๋ฆฐ 3๊ฑด์ ํ์ 43~68%) */
|
| 462 |
+
const NEWS_INSTR = "๋ด์ค ์ ๋ชฉ์ด ํด๋น ํ์ฌ์ ์ฃผ๊ฐ์ ์ด๋ค ์ํฅ์ ์ค์ง ๊ณ ๋ฅธ๋ค. ์ค์ ยท๊ณ์ฝยทํ๊ฐ์ฒ๋ผ ํ์ฌ ๊ฐ์น๋ฅผ ์ฌ๋ฆฌ๋ ์์์ ํธ์ฌ, ์ฌ๊ณ ยท์์กยท์์คยท์ฃผ์ ํฌ์์ฒ๋ผ ๊ฐ์น๋ฅผ ๋จ์ด๋จ๋ฆฌ๋ ์์์ ์
์ฌ, ์ฃผ๊ฐ์ ๊ด๋ จ์ด ์ ์ ์ผ์์ ์์์ ์ํฅ ์ ์์ด๋ค.";
|
| 463 |
+
const NEWS_CHOICES = ["ํธ์ฌ: ์ฃผ๊ฐ์ ์ข์ ์์", "์
์ฌ: ์ฃผ๊ฐ์ ๋์ ์์", "์ํฅ ์ ์: ์ฃผ๊ฐ์ ๊ด๋ จ์ด ์ ์ ์์"];
|
| 464 |
+
const COMPANIES = [{ name: "ํ๋น์ ์", sector: "๋ฐ๋์ฒด", price: 72000 }, { name: "๋๋ฆฌ๋ฐ์ด์ค", sector: "์ ์ฝ", price: 41000 },
|
| 465 |
+
{ name: "์ด๋ก์ํ", sector: "์ํ", price: 28500 }, { name: "๋ค์จ๋ชจ๋น๋ฆฌํฐ", sector: "์ ๊ธฐ์ฐจ", price: 115000 }];
|
| 466 |
+
// [ํ์ฌ ๋ฒํธ, ์ ๋ชฉ, ์ ๋ต ์ํฅ +1 ํธ์ฌ / -1 ์
์ฌ / 0 ์ํฅ ์ ์]
|
| 467 |
+
const NEWS_BANK = [
|
| 468 |
+
[0, "ํ๋น์ ์, 3๋ถ๊ธฐ ์์
์ด์ต ์์ฅ ์์์น 40% ์๋์", 1], [0, "ํ๋น์ ์ ๊ณต์ฅ ํ์ฌ๋ก ๋ฐ๋์ฒด ์์ฐ๋ผ์ธ 2์ฃผ๊ฐ ์ค๋จ", -1], [0, "ํ๋น์ ์ ๋ณธ์ฌ, ๊ฐ๋จ์์ ํ๊ต๋ก ์ด์ ๊ฒํ ", 0],
|
| 469 |
+
[0, "ํ๋น์ ์, ์์ฌ์ฃผ 1์กฐ์ ๋งค์
ํ ์๊ฐ ๊ฒฐ์ ", 1], [0, "ํ๋น์ ์ ๊ฒฝ์์ฌ, ์ฐจ์ธ๋ ์นฉ ์ถ์ 1๋
์ฐ๊ธฐ", 1], [0, "ํ๋น์ ์, ๋ฏธ๊ตญ์ ํนํ ์นจํด ์์ก ํจ์โฆ๋ฐฐ์๊ธ 8์ฒ์ต์", -1],
|
| 470 |
+
[0, "ํ๋น์ ์ ์ฃผ์ ๊ณ ๊ฐ์ฌ, ๋ด๋
์ฃผ๋ฌธ 30% ์ถ์ ํต๋ณด", -1], [0, "ํ๋น์ ์, ์ฌ๋ด ๋ง๋ผํค ๋ํ ๊ฐ์ต", 0], [0, "ํ๋น์ ์, AI ์๋ฒ์ฉ ๋ฉ๋ชจ๋ฆฌ ๋
์ ๊ณต๊ธ ๊ณ์ฝ ์ฒด๊ฒฐ", 1], [0, "ํ๋น์ ์ ๋
ธ์กฐ, ๋ค์ ์ฃผ ์ ๋ฉด ํ์
์๊ณ ", -1],
|
| 471 |
+
[1, "๋๋ฆฌ๋ฐ์ด์ค ์ ์ฝ, ์์ 3์์์ ํจ๊ณผ ์
์ฆ ์คํจ", -1], [1, "๋๋ฆฌ๋ฐ์ด์ค, ๋ฏธ๊ตญ FDA ์ ์ฝ ํ๋ชฉํ๊ฐ ํ๋", 1], [1, "๋๋ฆฌ๋ฐ์ด์ค, ์ฐฝ๋ฆฝ 20์ฃผ๋
๊ธฐ๋
ํ์ฌ ๊ฐ์ต", 0],
|
| 472 |
+
[1, "๋๋ฆฌ๋ฐ์ด์ค ์ต๋์ฃผ์ฃผ, ๋ณด์ ์ง๋ถ 30% ์ฅ๋ด ๋งค๋", -1], [1, "๋๋ฆฌ๋ฐ์ด์ค, ์ ์์ฆ์๋ก 2์ฒ์ต์ ์กฐ๋ฌโฆ์ฃผ์ ์ 25% ๋์ด", -1], [1, "๋๋ฆฌ๋ฐ์ด์ค, ๊ธ๋ก๋ฒ ์ ์ฝ์ฌ์ 1์กฐ์ ๊ท๋ชจ ๊ธฐ์ ์์ถ", 1],
|
| 473 |
+
[1, "๋๋ฆฌ๋ฐ์ด์ค ์ฃผ๋ ฅ ์์ฝํ, ์์ฝ์ฒ ํ๋งค ์ค์ง ์ฒ๋ถ", -1], [1, "๋๋ฆฌ๋ฐ์ด์ค, ์ ๊ท ์ฌ์ฅ ๋์์ธ ๊ณต๊ฐ", 0], [1, "๋๋ฆฌ๋ฐ์ด์ค, ํญ์์ ์์ 2์ ์ค๊ฐ ๊ฒฐ๊ณผ '์์ ๊ดํด' ๋ค์ ํ์ธ", 1], [1, "๋๋ฆฌ๋ฐ์ด์ค ๊ฐ์ฌ์ธ, ์ฌ๋ฌด์ ํ ๊ฐ์ฌ์๊ฒฌ '์๊ฒฌ๊ฑฐ์ '", -1],
|
| 474 |
+
[2, "์ด๋ก์ํ, ์ ์ ํ ๋ผ๋ฉด ์ถ์ ํ ๋ฌ ๋ง์ 1์ฒ๋ง ๊ฐ ํ๋งค", 1], [2, "์ด๋ก์ํ ๋ํ์ด์ฌ, ํ๊ณ ๋ถ์ ํ์๋ก ๊ฒ์ฐฐ ์กฐ์ฌ", -1], [2, "์ด๋ก์ํ, ์์ฌ๋ฃ ๊ฐ๊ฒฉ ๊ธ๋ฑ์ 3๋ถ๊ธฐ ์ ์ ์ ํ", -1],
|
| 475 |
+
[2, "์ด๋ก์ํ, ๊ณต์ ์ ํ๋ธ ์ฑ๋ ๊ตฌ๋
์ 10๋ง ๋ช
๋ํ", 0], [2, "์ด๋ก์ํ, ๋ฏธ๊ตญ ๋ํ๋งํธ 3์ฒ ๊ฐ ๋งค์ฅ ์
์ ํ์ ", 1], [2, "์ด๋ก์ํ ์ ํ์์ ์ด๋ฌผ์งโฆ์ ๋ ํ์ ์กฐ์น", -1],
|
| 476 |
+
[2, "์ด๋ก์ํ, ์ฃผ๋น ๋ฐฐ๋น๊ธ ๋ ๋ฐฐ๋ก ํ๋", 1], [2, "์ด๋ก์ํ, ๋ณธ์ฌ ๊ตฌ๋ด์๋น ๋ฉ๋ด ๊ฐํธ", 0], [2, "์ด๋ก์ํ ๊ฒฝ์์ฌ, ๊ฐ๊ฒฉ 20% ์ธ์ ๋ฐํ", 1], [2, "์ด๋ก์ํ, ๊ณต์ ์ ๋ดํฉ ๊ณผ์ง๊ธ 500์ต์ ๋ถ๊ณผ", -1],
|
| 477 |
+
[3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ, ๊ธ๋ก๋ฒ ์์ฑ์ฐจ ์
์ฒด์ 5์กฐ์ ๊ท๋ชจ ๋ฐฐํฐ๋ฆฌ ๊ณต๊ธ ๊ณ์ฝ", 1], [3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ ์ ๊ธฐ์ฐจ 10๋ง ๋ ๋ฆฌ์ฝโฆ๋ฐฐํฐ๋ฆฌ ๊ฒฐํจ", -1], [3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ ์ ์ CFO ์ ์", 0],
|
| 478 |
+
[3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ, ์ ๋ถ ๋ณด์กฐ๊ธ ๋์์์ ์ ์ธ๋ผ ํ๋งค ๊ฐ์ ์ฐ๋ ค", -1], [3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ, 3๋ถ๊ธฐ ์ ๊ธฐ์ฐจ ํ๋งค๋ ์ฌ์ ์ต๋", 1], [3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ ๊ณต์ฅ ์ฆ์ค ๊ณํ ๋ฐฑ์งํ", -1],
|
| 479 |
+
[3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ, ์์จ์ฃผํ ๊ธฐ์ ๊ตญ๋ด ์ต์ด ๋ ๋ฒจ4 ์ธ์ฆ", 1], [3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ, ํ์ฌ ๋ก๊ณ ๋ฆฌ๋ด์ผ", 0], [3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ ์ต๋ ๊ณ ๊ฐ์ฌ ํ์ฐ ์ ์ฒญ", -1], [3, "๋ค์จ๋ชจ๋น๋ฆฌํฐ, ์ ๋ฝ ์นํ๊ฒฝ์ฐจ ์ธ์ก๊ณต์ ๋์ ์ ์ ", 1],
|
| 480 |
+
].map(([co, title, impact]) => ({ co, title, impact }));
|
| 481 |
+
async function judgeNews(company, title, decide) {
|
| 482 |
+
const r = await decide({ instruction: NEWS_INSTR, item: { "ํ์ฌ": company, "๋ด์ค ์ ๋ชฉ": title }, choices: NEWS_CHOICES });
|
| 483 |
+
return { pick: r.choice.charCodeAt(0) - 65, conf: r.confidence, ms: r.ms, probs: [r.probs.A, r.probs.B, r.probs.C] };
|
| 484 |
+
}
|
| 485 |
+
|
| 486 |
+
const api = { DRIVE_INSTR, DRIVE, DRIVE_SAMPLES, drive, NEWS_INSTR, NEWS_CHOICES, COMPANIES, NEWS_BANK, judgeNews,
|
| 487 |
+
AXES, CASES, URGENCY, SAMPLES, classify, route, BOOL_INSTR, NLI_INSTR, QUESTIONS, CONTRACT, CLAIMS, splitClauses, askClause, checkClaim };
|
| 488 |
+
if (typeof module !== "undefined" && module.exports) module.exports = api; else root.Scenarios = api;
|
| 489 |
+
})(this);
|
| 490 |
+
|
| 491 |
+
</script>
|
| 492 |
+
<script>
|
| 493 |
+
/* โโโโโโโโโ ์ด๋ฆ โโโโโโโโโ */
|
| 494 |
+
const NAME = "KJH-Judge-4B-ko", SHORT = "KJH-Judge";
|
| 495 |
+
// ๋ง์ง๋ง ์ฅ๋ฉด์ '์ง์ ํด ๋ณด๊ธฐ' ๋ฌธ๊ตฌ (ํ๊น
ํ์ด์ค์ฉ ๋จ์ผ ํ์ผ์์๋ make_showreel.py ๊ฐ ์ฃผ์๋ก ๋ฐ๊ฟ ๋ฃ๋๋ค)
|
| 496 |
+
const TRY = window.SHOW_TRY || "๋ง์ ์ฝ๊ธฐ ยท ํ๊ตญ์ด ๋๊ฒฐ ยท ์์ด์ ํธ ๋ผ์ฐํฐ ยท ๋ฌธ์ ๋ถ๋ฅํจ";
|
| 497 |
+
|
| 498 |
+
/* โโโโโโโโโ ๋ฐ์ดํฐ (๋ชจ๋ ์ ์ฅ๋ ์ค์ ํ์ ๊ฒฐ๊ณผ) โโโโโโโโโ */
|
| 499 |
+
const D = window.JEV_DATA, LIVE = window.JEV_LIVE_EXAMPLE, QZ = window.JEV_QUIZ, EX = window.JEV_EXAMPLES, SN = window.Scenarios;
|
| 500 |
+
const esc = s => String(s).replace(/[&<>"']/g, c => ({ "&": "&", "<": "<", ">": ">", '"': """, "'": "'" }[c]));
|
| 501 |
+
const pct = (x, d = 1) => (x * 100).toFixed(d) + "%";
|
| 502 |
+
const sec = ms => (ms / 1000).toFixed(2) + "์ด";
|
| 503 |
+
|
| 504 |
+
const TURNS = []; { let u = null; for (const x of LIVE.state.log) { if (x.t === "user") u = x.text; else if (x.t === "decision" && x.d.step === 1) TURNS.push({ u, d: x.d }); } }
|
| 505 |
+
const prob = (d, name) => d.probs[d.choices.indexOf(name)] || 0;
|
| 506 |
+
const D1 = TURNS[0].d, ASKC = D1.choices.find(c => c.startsWith("ASK")), RESC = D1.choices.find(c => c.startsWith("RESPOND"));
|
| 507 |
+
const TOOL = { get_weather: ["cloud", "๋ ์จ ์กฐํ"], call_taxi: ["car", "ํ์ ํธ์ถ"], create_event: ["calendar", "์ผ์ ๋ฑ๋ก"], send_money: ["send", "์ก๊ธ"], track_parcel: ["package", "ํ๋ฐฐ ์กฐํ"] };
|
| 508 |
+
|
| 509 |
+
const qfind = f => QZ.pool.find(f);
|
| 510 |
+
const QWIC = qfind(q => q.item.word === "์ด์"), QCOPA = qfind(q => q.item.premise === "๋นํ๊ธฐ๊ฐ ๋๊ธฐ๋ฅ๋ฅผ ๋ง๋ฌ๋ค."), QNEWS = qfind(q => (q.item.headline || "").startsWith("K๋ฆฌ๊ทธ"));
|
| 511 |
+
|
| 512 |
+
const INB = t => EX.inbox.find(x => x.text.includes(t));
|
| 513 |
+
const IN_HACK = INB("ํดํน"), IN_THANK = INB("๊น์ง์"), IN_PAY = INB("์ผ์์ ์ค๋ฅ");
|
| 514 |
+
const GOLD_PAY = (SN.SAMPLES.find(s => s.text === IN_PAY.text) || { gold: [] }).gold;
|
| 515 |
+
|
| 516 |
+
const MS = [...EX.inbox.flatMap(x => Object.values(x.axes).map(a => a.ms)), ...EX.news.map(n => n.ms), ...EX.drive.map(d => d.ms)].sort((a, b) => a - b);
|
| 517 |
+
const MED = MS[MS.length >> 1];
|
| 518 |
+
// ๋ด์ค: ํ์ฌ๋ณ๋ก ๋ฌถ์ฌ ์์ผ๋ ๋ฒ๊ฐ์ ๋์ค๊ฒ (ํ์ฌ ์ ์๋ฒ โ ํ์ฌ ์)
|
| 519 |
+
const NEWS = (() => { const seen = {}; return SN.NEWS_BANK.map((n, i) => ({ ...n, r: EX.news[i], k: seen[n.co] = (seen[n.co] || 0) + 1 })).sort((a, b) => a.k - b.k || a.co - b.co); })();
|
| 520 |
+
|
| 521 |
+
/* โโโโโโโโโ ์์ด์ฝ ยท ๋งํฌ ยท ๊ธ์ ๋ฑ์ฅ โโโโโโโโโ */
|
| 522 |
+
const ICONS = {
|
| 523 |
+
car: '<path d="M19 17h2c.6 0 1-.4 1-1v-3c0-.9-.7-1.7-1.5-1.9C18.7 10.6 16 10 16 10s-1.3-1.4-2.2-2.3c-.5-.4-1.1-.7-1.8-.7H5c-.6 0-1.1.4-1.4.9l-1.4 2.9A3.7 3.7 0 0 0 2 12v4c0 .6.4 1 1 1h2"/><circle cx="7" cy="17" r="2"/><path d="M9 17h6"/><circle cx="17" cy="17" r="2"/>',
|
| 524 |
+
help: '<circle cx="12" cy="12" r="10"/><path d="M9.1 9a3 3 0 0 1 5.8 1c0 2-3 3-3 3"/><path d="M12 17h.01"/>',
|
| 525 |
+
chat: '<path d="M21 15a2 2 0 0 1-2 2H7l-4 4V5a2 2 0 0 1 2-2h14a2 2 0 0 1 2 2z"/>',
|
| 526 |
+
cloud: '<path d="M17.5 19H9a7 7 0 1 1 6.7-9h1.8a4.5 4.5 0 1 1 0 9Z"/>',
|
| 527 |
+
calendar: '<rect x="3" y="4" width="18" height="18" rx="2"/><path d="M16 2v4M8 2v4M3 10h18"/>',
|
| 528 |
+
send: '<path d="m22 2-7 20-4-9-9-4Z"/><path d="M22 2 11 13"/>',
|
| 529 |
+
package: '<path d="M21 16V8a2 2 0 0 0-1-1.7l-7-4a2 2 0 0 0-2 0l-7 4A2 2 0 0 0 3 8v8a2 2 0 0 0 1 1.7l7 4a2 2 0 0 0 2 0l7-4a2 2 0 0 0 1-1.7z"/><path d="M3.3 7 12 12l8.7-5M12 22V12"/>',
|
| 530 |
+
shield: '<path d="M12 22s8-4 8-10V5l-8-3-8 3v7c0 6 8 10 8 10z"/><path d="M12 8v4M12 16h.01"/>',
|
| 531 |
+
heart: '<path d="M19 14c1.5-1.5 3-3.2 3-5.5A5.5 5.5 0 0 0 16.5 3c-1.8 0-3 .5-4.5 2-1.5-1.5-2.7-2-4.5-2A5.5 5.5 0 0 0 2 8.5c0 2.3 1.5 4 3 5.5l7 7Z"/>',
|
| 532 |
+
pause: '<rect x="6" y="4" width="4" height="16" rx="1"/><rect x="14" y="4" width="4" height="16" rx="1"/>',
|
| 533 |
+
user: '<circle cx="12" cy="8" r="4"/><path d="M4 21v-1a6 6 0 0 1 6-6h4a6 6 0 0 1 6 6v1"/>',
|
| 534 |
+
check: '<path d="M20 6 9 17l-5-5"/>',
|
| 535 |
+
x: '<path d="M18 6 6 18M6 6l12 12"/>',
|
| 536 |
+
zap: '<path d="M13 2 3 14h9l-1 8 10-12h-9l1-8z"/>',
|
| 537 |
+
arrow: '<path d="M5 12h14M12 5l7 7-7 7"/>',
|
| 538 |
+
up: '<path d="m22 7-8.5 8.5-5-5L2 17"/><path d="M16 7h6v6"/>',
|
| 539 |
+
down: '<path d="m22 17-8.5-8.5-5 5L2 7"/><path d="M16 17h6v-6"/>',
|
| 540 |
+
minus: '<path d="M5 12h14"/>',
|
| 541 |
+
cpu: '<rect x="4" y="4" width="16" height="16" rx="2"/><rect x="9" y="9" width="6" height="6"/><path d="M15 2v2M15 20v2M2 15h2M2 9h2M20 15h2M20 9h2M9 2v2M9 20v2"/>',
|
| 542 |
+
clock: '<circle cx="12" cy="12" r="10"/><path d="M12 6v6l4 2"/>',
|
| 543 |
+
layers: '<path d="m12 2 10 5-10 5L2 7l10-5Z"/><path d="m2 17 10 5 10-5M2 12l10 5 10-5"/>',
|
| 544 |
+
target: '<circle cx="12" cy="12" r="10"/><circle cx="12" cy="12" r="6"/><circle cx="12" cy="12" r="2"/>',
|
| 545 |
+
play: '<path d="m6 3 14 9-14 9V3z"/>',
|
| 546 |
+
};
|
| 547 |
+
const I = n => `<svg class="ic" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="1.8" stroke-linecap="round" stroke-linejoin="round">${ICONS[n]}</svg>`;
|
| 548 |
+
// ๋งํฌ: ์ฌ๋ฌ ๋ณด๊ธฐ๊ฐ ํ๋์ ํ๋จ์ผ๋ก ๋ชจ์ธ๋ค
|
| 549 |
+
const MARK = cls => `<svg class="${cls}" viewBox="0 0 48 48" fill="none"><rect x="1" y="1" width="46" height="46" rx="14" fill="url(#gB)" fill-opacity=".13" stroke="url(#gB)" stroke-opacity=".55"/>
|
| 550 |
+
<path class="draw" pathLength="1" d="M13 14C22 14 24 24 34 24M13 24H34M13 34C22 34 24 24 34 24" stroke="url(#gB)" stroke-width="2.6" stroke-linecap="round"/>
|
| 551 |
+
<circle cx="13" cy="14" r="3" fill="#fff" fill-opacity=".55"/><circle cx="13" cy="24" r="3" fill="#fff" fill-opacity=".55"/><circle cx="13" cy="34" r="3" fill="#fff" fill-opacity=".55"/><circle class="dot" cx="35" cy="24" r="5.5" fill="url(#gB)"/></svg>`;
|
| 552 |
+
const CONN = d => `<svg class="conn" viewBox="0 0 96 30" data-in="${d}"><path class="draw" pathLength="1" d="M4 15H86"/><path class="draw" pathLength="1" d="M76 6 87 15 76 24"/></svg>`;
|
| 553 |
+
// ๋จ์ด ๋จ์ ๋ฑ์ฅ. *๊ฐ์กฐ* ๋ ๊ทธ๋ผ๋ฐ์ด์
|
| 554 |
+
function H(s) { let on = false; // '*'๋ฅผ ๋ง๋ ๋๋ง๋ค ๊ฐ์กฐ๋ฅผ ์ผ๊ณ ๋๋ค (์กฐ์ฌ๊ฐ ๋ถ์ด๋ ๋จ: *ํ๋*๋ฅผ)
|
| 555 |
+
return s.split(" ").map((tok, i) => { let h = "";
|
| 556 |
+
tok.split("*").forEach((p, k) => { if (k) on = !on; if (p) h += on ? `<span class="acc">${esc(p)}</span>` : esc(p); });
|
| 557 |
+
return `<span class="w"><span style="--d:${i}">${h}</span></span>`; }).join(" "); }
|
| 558 |
+
const K = (i, t) => `<div class="kicker" data-in="80"><b>${String(i + 1).padStart(2, "0")}</b><i></i>${t}</div>`;
|
| 559 |
+
const HL = (s, d = 250, cls = "") => `<h1 class="hl words ${cls}" data-in="${d}">${H(s)}</h1>`;
|
| 560 |
+
const TYPE = (s, d, sp = 85) => `<span data-type="${d}" data-sp="${sp}" data-full="${esc(s)}"><span class="tt"></span><i class="caret"></i></span>`;
|
| 561 |
+
|
| 562 |
+
/* โโโโโโโโโ ์ฅ๋ฉด โโโโโโโโโ */
|
| 563 |
+
const CARD3 = () => [
|
| 564 |
+
{ ic: "car", tt: "๋ฐ๋ก ํ์ ํธ์ถ", ds: "์ถ๋ฐ์งยท๋์ฐฉ์ง๋ ์์์?", k: "call", p: prob(D1, "CALL:call_taxi") },
|
| 565 |
+
{ ic: "help", tt: "๋จผ์ ๋๋ฌป๊ธฐ", ds: "โ์ด๋์ ์ด๋๋ก ๊ฐ์ธ์?โ", k: "ask", p: prob(D1, ASKC) },
|
| 566 |
+
{ ic: "chat", tt: "๋ง๋ก๋ง ๋ตํ๊ธฐ", ds: "โํ์ ์ฑ์ ์จ ๋ณด์ธ์โ", k: "respond", p: prob(D1, RESC) },
|
| 567 |
+
];
|
| 568 |
+
const BRAND = ["#6d5dfc", "#2b9fff", "#20d3ad"];
|
| 569 |
+
|
| 570 |
+
const SCENES = [
|
| 571 |
+
{ name: "์ํฉ", dur: 7600, aura: BRAND, cls: "s-hook", cap: "AI๊ฐ ์ผ์ ํ๋ ค๋ฉด, ๋จผ์ โ๋ฌด์์ ํ ์งโ ๊ณจ๋ผ์ผ ํฉ๋๋ค.",
|
| 572 |
+
html: () => `<div class="who" data-in="150">์ฌ์ฉ์๊ฐ AI ๋น์์๊ฒ</div>
|
| 573 |
+
<div class="bubble glass" data-in="350">โ${TYPE(TURNS[0].u, 700)}โ</div>
|
| 574 |
+
${HL("AI๋ ๋จผ์ *๋ฌด์์* ํด์ผ ํ ๊น์?", 2000)}
|
| 575 |
+
<div class="opts3">${CARD3().map((c, i) => `<div class="opt3 glass k-${c.k}" data-in="${3000 + i * 260}"><div class="itile">${I(c.ic)}</div><div class="tt">${c.tt}</div><div class="ds">${c.ds}</div></div>`).join("")}</div>` },
|
| 576 |
+
|
| 577 |
+
{ name: "ํ๋จ", dur: 8800, aura: ["#ff9a3d", "#6d5dfc", "#2b9fff"], cls: "s-hook", cap: "์ถ๋ฐ์ง๋ ๋์ฐฉ์ง๋ ๋ชจ๋ฅด๋, ๋ฉ๋๋ก ๋ถ๋ฅด์ง ์๊ณ ๋๋ฌป์ต๋๋ค.",
|
| 578 |
+
html: () => { const cs = CARD3(), other = 1 - cs.reduce((s, c) => s + c.p, 0);
|
| 579 |
+
return `<div class="who">${SHORT}์ ํ๋จ</div>
|
| 580 |
+
<div class="bubble glass">โ${esc(TURNS[0].u)}โ</div>
|
| 581 |
+
${HL(`๋ณด๊ธฐ ${D1.choices.length}๊ฐ ์ค *ํ๋*๋ฅผ ๊ณ ๋ฆ
๋๋ค`, 150)}
|
| 582 |
+
<div class="stats"><span class="chipk" data-in="3500">${I("zap")} ํ๋จ <b>${sec(D1.ms)}</b></span><span class="chipk" data-in="3700">๋๋จธ์ง ๋๊ตฌ ${D1.choices.length - 3}๊ฐ ํฉ <b>${pct(other)}</b></span></div>
|
| 583 |
+
<div class="opts3" id="o3">${cs.map((c, i) => `<div class="opt3 glass k-${c.k}" data-c="${i}"><span class="vd">DECISION</span><div class="itile">${I(c.ic)}</div><div class="tt">${c.tt}</div><div class="ds">${c.ds}</div>
|
| 584 |
+
<div class="meter"><div class="bar"><i data-w="${c.p}"></i></div><div class="pct" data-n="${c.p}">0.0%</div></div></div>`).join("")}</div>`; },
|
| 585 |
+
play(x) { x.at(700, () => x.$("#o3").classList.add("scan")); x.at(1800, () => x.$("#o3").classList.remove("scan"));
|
| 586 |
+
x.bars(1800, 1300); x.counts(1800, 1300, v => pct(v));
|
| 587 |
+
const cs = CARD3(), w = cs.reduce((b, c, i) => c.p > cs[b].p ? i : b, 0);
|
| 588 |
+
x.at(3200, () => x.$$("[data-c]").forEach((el, i) => el.classList.add(i === w ? "win" : "lose"))); } },
|
| 589 |
+
|
| 590 |
+
{ name: "๋ํ", dur: 10800, aura: ["#3f7dff", "#20d3ad", "#6d5dfc"], cap: "ํ์ํ ๋๊ตฌ๋ฅผ ๊ณ ๋ฅด๊ณ , ์๋ ๊ธฐ๋ฅ์ ์ง์ด๋ด์ง ์์ต๋๋ค.",
|
| 591 |
+
html: i => `${K(i, "๋ํ๊ฐ ์ด์ด์ง๋ฉด")}${HL("ํ ์ผ์ด๋ฉด ํ๊ณ , *๋ชป ํ๋ฉด ๋ชป ํ๋ค๊ณ *")}
|
| 592 |
+
<div class="turns">${TURNS.slice(1, 4).map((t, j) => { const d = t.d, b = 900 + j * 2900;
|
| 593 |
+
const [ic, lb, k] = d.kind === "CALL" ? [...TOOL[d.tool], "call"] : d.kind === "ASK" ? ["help", "๋๋ฌป๊ธฐ", "ask"] : ["chat", "ํ ์ ์๋ค๊ณ ์๋ด", "respond"];
|
| 594 |
+
const note = d.kind === "RESPOND" ? `<div class="nt">์ฐ๊ฒฐ๋ ๋๊ตฌ: ${LIVE.state.enabled.map(n => TOOL[n][1]).join(" ยท ")} โ ์ฃผ์ ๋งค๋งค ๋๊ตฌ๋ ์์</div>` : "";
|
| 595 |
+
return `<div class="turn"><div class="ub glass" data-in="${b}">โ${esc(t.u)}โ</div>${CONN(b + 500)}
|
| 596 |
+
<div class="dec glass k-${k}" data-in="${b + 900}"><div class="itile">${I(ic)}</div><div class="lb"><small>${d.kind}</small>${lb}</div><span class="pct" data-n="${d.conf}" data-t="${b + 1100}">0%</span>
|
| 597 |
+
<div class="bar"><i data-w="${d.conf}" data-t="${b + 1100}"></i></div>${note}</div></div>`; }).join("")}</div>`,
|
| 598 |
+
play(x) { x.bars(null, 1000); x.counts(null, 1000, v => pct(v)); } },
|
| 599 |
+
|
| 600 |
+
{ name: "์๊ฐ", dur: 8200, aura: BRAND, cap: "๊ธด ๊ธ์ ์ฐ๋ ๋์ , ์ฃผ์ด์ง ๋ณด๊ธฐ ์ค ํ๋๋ฅผ ๋น ๋ฅด๊ณ ์ ํํ๊ฒ ๊ณ ๋ฆ
๋๋ค.",
|
| 601 |
+
html: () => `<div class="center">
|
| 602 |
+
<div data-in="200">${MARK("markbig")}</div>
|
| 603 |
+
<div class="wm" data-in="900"><span class="a">KJH-Judge</span><span class="b">-4B-ko</span></div>
|
| 604 |
+
<div class="tag words" data-in="1700">${H("ํ๊ตญ์ด๋ก *ํ๋จ*๋ง ํ๋ ์์ ๋ชจ๋ธ")}</div>
|
| 605 |
+
<div class="facts">
|
| 606 |
+
<div class="fact glass k-call" data-in="2600"><div class="itile">${I("cpu")}</div><b>4B</b><span>40์ต ํ๋ผ๋ฏธํฐ ยท Qwen3-4B ๊ธฐ๋ฐ</span></div>
|
| 607 |
+
<div class="fact glass k-respond" data-in="2850"><div class="itile">${I("clock")}</div><b>${D.train.gpu_hours.toFixed(1)}์๊ฐ</b><span>GPU ํ์ต ยท ${D.train.steps.toLocaleString()}์คํ
</span></div>
|
| 608 |
+
<div class="fact glass k-hi" data-in="3100"><div class="itile">${I("target")}</div><b>2~26๊ฐ</b><span>๋ณด๊ธฐ ์ค ํ๋ + ํ๋ฅ </span></div>
|
| 609 |
+
</div></div>` },
|
| 610 |
+
|
| 611 |
+
{ name: "ํ์ต ์ ํ", dur: 11200, aura: ["#ff6b5e", "#3f7dff", "#6d5dfc"], cap: "ํ์ต ์ ์ ๊ฑฐ์ โAโ๋ง ์ฐ๋ ๋ชจ๋ธ์ด, ์ด ๋ฌธ์ ์ค ์ํ์ ๋งํ๋๋ค.",
|
| 612 |
+
html: i => { const N = 60, aShare = D.base_pred_letters.A / D.base_pooled.n, tot = D.pooled.n, L = Object.entries(D.pred_letters).sort((a, b) => b[1] - a[1]);
|
| 613 |
+
let cells = []; L.forEach(([l, c]) => { for (let k = 0; k < Math.round(c / tot * N); k++) cells.push(l); }); cells = cells.slice(0, N); while (cells.length < N) cells.push(L[0][0]);
|
| 614 |
+
cells = cells.map((c, j) => [c, (j * 37) % N]).sort((a, b) => a[1] - b[1]).map(c => c[0]);
|
| 615 |
+
return `${K(i, `๊ฐ์ ํ๊ตญ์ด ๋ฌธ์ ${D.pooled.n.toLocaleString()}๊ฐ ยท 22๊ฐ ๊ณผ๋ชฉ`)}${HL("โAโ๋ง ์ฐ๋ ๋ชจ๋ธ์ด, *์ด์ ์ํ*์ ๋งํ๊ธฐ๊น์ง")}
|
| 616 |
+
<div class="vs">
|
| 617 |
+
<div class="side glass before" data-in="500"><span class="lab">ํ์ต ์ ยท Qwen3-4B ๊ทธ๋๋ก</span>
|
| 618 |
+
<div class="tiles" data-tiles="1000">${Array.from({ length: N }, (_, j) => `<span style="--i:${j}">A</span>`).join("")}</div>
|
| 619 |
+
<div class="note">๋ต์ <b>${pct(aShare)}</b>๊ฐ ๊ทธ๋ฅ โAโ</div>
|
| 620 |
+
<div class="bign" data-n="${D.base_pooled.acc}" data-t="2000" data-d="900">0%</div><div class="sub">์ ๋ต๋ฅ ยท ๋ฌด์์๋ก ์ฐ๊ธฐ(${pct(D.pooled.chance)})์ ๊ฐ์ ์์ค</div></div>
|
| 621 |
+
<div class="mid" data-in="3300"><div class="ring">${I("arrow")}</div>๋ฏธ์ธ์กฐ์ <br>${D.train.steps.toLocaleString()}์คํ
</div>
|
| 622 |
+
<div class="side glass after" data-in="3700"><span class="lab">ํ์ต ํ ยท ${NAME}</span>
|
| 623 |
+
<div class="tiles" data-tiles="4200">${cells.map((c, j) => `<span style="--i:${j};--h:${255 - (c.charCodeAt(0) - 65) * 11}">${c}</span>`).join("")}</div>
|
| 624 |
+
<div class="note">๋ฌธ์ ๋ง๋ค ๋ด์ฉ์ ์ฝ๊ณ <b>A~K</b>๋ฅผ ๊ณ ๋ฃจ ๊ณ ๋ฆ</div>
|
| 625 |
+
<div class="bign" data-n="${D.pooled.acc}" data-t="5300" data-d="1900">0%</div><div class="sub">์ ๋ต๋ฅ ยท ์ด ๋ฌธ์ ์ค ์ํ</div></div>
|
| 626 |
+
</div>`; },
|
| 627 |
+
play(x) { x.$$("[data-tiles]").forEach(el => x.at(+el.dataset.tiles, () => el.classList.add("on"))); x.counts(null, null, v => pct(v)); } },
|
| 628 |
+
|
| 629 |
+
{ name: "ํ๊ตญ์ด", dur: 15200, aura: ["#ffd36b", "#20d3ad", "#3f7dff"], cap: "๋์์ด์์ด, ์์ธ๊ณผ ๊ฒฐ๊ณผ, ๋ด์ค ๋ถ์ผ๊น์ง โ ๋งฅ๋ฝ์ ์ฝ๊ณ ํ๋จํฉ๋๋ค.",
|
| 630 |
+
html: i => { const hl = s => esc(s).replace(/\[(.+?)\]/g, "<mark>$1</mark>");
|
| 631 |
+
const opts = (q, b, top) => { let idx = q.choices.map((_, j) => j); if (top) idx = idx.sort((a, c) => q.jev.probs[c] - q.jev.probs[a]).slice(0, top);
|
| 632 |
+
let h = idx.map(j => `<div class="op" data-op="${j === q.jev.pick ? "pick" : "rest"}" data-r="${b + 2700}"><span class="t">${esc(q.choices[j])}</span><span class="pct" data-n="${q.jev.probs[j]}" data-t="${b + 1300}">0%</span><div class="bar"><i data-w="${q.jev.probs[j]}" data-t="${b + 1300}" style="--c:${j === q.jev.pick ? "var(--good)" : "#59637a"}"></i></div></div>`).join("");
|
| 633 |
+
if (top && q.choices.length > top) { const rest = 1 - idx.reduce((s, j) => s + q.jev.probs[j], 0); h += `<div class="op" data-op="rest" data-r="${b + 2700}"><span class="t" style="color:var(--muted)">๊ทธ ์ธ ${q.choices.length - top}๊ฐ ๋ถ์ผ</span><span class="pct" style="color:var(--muted)" data-n="${rest}" data-t="${b + 1300}">0%</span></div>`; }
|
| 634 |
+
return h; };
|
| 635 |
+
const foot = (q, b) => `<div class="foot" data-in="${b + 2800}">${q.jev.pick === q.gold ? `<span class="badge k-good">${I("check")} ์ ๋ต</span>` : `<span class="badge k-bad">${I("x")} ์ค๋ต</span>`}<span>${I("zap")} ${sec(q.jev.ms)}</span></div>`;
|
| 636 |
+
const B = [700, 5300, 9900];
|
| 637 |
+
return `${K(i, "ํ๊ตญ์ด, ์ผ๋ง๋ ์์๋ค์๊น? ยท ๋ฌธ์ ์ถ์ฒ KoBESTยทKLUE (CC BY-SA 4.0)")}${HL("์ฌ๋๋ *์ ๊น ๋ฉ์นซํ๋* ๋ฌธ์ ๋ค")}
|
| 638 |
+
<div class="qs">
|
| 639 |
+
<div class="qc glass" data-in="${B[0]}"><span class="qtag">๊ฐ์ ๋จ์ด, ๊ฐ์ ๋ป์ผ๊น?</span><div class="qb"><p>โ ${hl(QWIC.item.context_1)}</p><p>โก ${hl(QWIC.item.context_2)}</p></div>${opts(QWIC, B[0])}${foot(QWIC, B[0])}</div>
|
| 640 |
+
<div class="qc glass" data-in="${B[1]}"><span class="qtag">๊ทธ ${esc(QCOPA.item.relation_to_select)}๋?</span><div class="qb"><p>${esc(QCOPA.item.premise)}</p><small>๋ ๊ทธ๋ด๋ฏํ ${esc(QCOPA.item.relation_to_select)}๋ฅผ ๊ณ ๋ฅด์ธ์</small></div>${opts(QCOPA, B[1])}${foot(QCOPA, B[1])}</div>
|
| 641 |
+
<div class="qc glass" data-in="${B[2]}"><span class="qtag">์ด๋ ๋ถ์ผ ๋ด์ค์ผ๊น?</span><div class="qb"><p>โ${esc(QNEWS.item.headline)}โ</p><small>๋ณด๊ธฐ ${QNEWS.choices.length}๊ฐ ยท ${QNEWS.choices.map(esc).join(" ยท ")}</small></div>${opts(QNEWS, B[2], 2)}${foot(QNEWS, B[2])}</div>
|
| 642 |
+
</div>`; },
|
| 643 |
+
play(x) { x.bars(null, 1000); x.counts(null, 1000, v => pct(v)); x.$$("[data-op=rest]").forEach(el => x.at(+el.dataset.r, () => el.classList.add("dim"))); } },
|
| 644 |
+
|
| 645 |
+
{ name: "๊ณ ๊ฐ์ผํฐ", dur: 12200, aura: ["#ff6b5e", "#20d3ad", "#6d5dfc"], cap: "AI๋ ์ฌ์๊ณผ ๊ฐ์ ์ ๊ณ ๋ฅด๊ณ , ๋ด๋น ๋ถ์์ ๊ธด๊ธ๋๋ ๊ณต๊ฐ๋ ๊ท์นํ๊ฐ ์ ํฉ๋๋ค.",
|
| 646 |
+
html: i => { const MOOD = SN.AXES.find(a => a.key === "mood").choices, UK = ["bad", "ask", "good"];
|
| 647 |
+
const row = (it, b, ic) => { const c = SN.CASES[it.axes.case.pick], m = it.axes.mood;
|
| 648 |
+
return `<div class="row"><div class="msg glass" data-in="${b}"><div class="h"><i></i>๊ณ ๊ฐ ๋ฌธ์</div><div class="t">โ${esc(it.text)}โ</div></div>
|
| 649 |
+
<div class="chips"><div class="chip glass" data-in="${b + 1100}"><span class="k">์ฌ์</span><span class="v">${esc(c.label)}</span><span class="pct" data-n="${it.axes.case.conf}" data-t="${b + 1200}">0%</span></div>
|
| 650 |
+
<div class="chip glass" data-in="${b + 1500}"><span class="k">๊ฐ์ </span><span class="v">${esc(MOOD[m.pick])}</span><span class="pct" data-n="${m.conf}" data-t="${b + 1600}">0%</span></div></div>
|
| 651 |
+
${CONN(b + 2200)}
|
| 652 |
+
<div class="route glass k-${UK[c.urgency]}" data-in="${b + 2700}"><div class="itile">${I(ic)}</div><div class="d">${esc(c.dept)}ํ</div><div class="u">${SN.URGENCY[c.urgency]}</div><div class="s">๊ท์นํ๋ก ๊ฒฐ์ </div></div></div>`; };
|
| 653 |
+
return `${K(i, "๊ณ ๊ฐ์ผํฐ๋ผ๋ฉด")}${HL("๋ฌธ์๋ฅผ ์ฝ๊ณ , ๋๋๊ณ , *๋ฐ๋ก ๋ณด๋
๋๋ค*")}
|
| 654 |
+
<div class="rows">${row(IN_HACK, 800, "shield")}${row(IN_THANK, 5600, "heart")}</div>`; },
|
| 655 |
+
play(x) { x.counts(null, 800, v => pct(v, 0)); } },
|
| 656 |
+
|
| 657 |
+
{ name: "ํ์ ", dur: 13200, aura: ["#ffb44d", "#ff6b5e", "#6d5dfc"], cls: "s-unsure", cap: "ํ์ ์ซ์๋ฅผ ๋ฏฟ์ ์ ์์ผ๋, ๋ฎ์ ๋๋ง ์ฌ๋์ด ๋ณด๋ฉด ๋ฉ๋๋ค.",
|
| 658 |
+
html: i => { const pr = IN_PAY.axes.case.probs, top = pr.map((p, j) => [p, j]).sort((a, b) => b[0] - a[0]).slice(0, 3), conf = IN_PAY.axes.case.conf, TH = 0.7;
|
| 659 |
+
const gold = GOLD_PAY.length ? SN.CASES[GOLD_PAY[0]].label : null, right = GOLD_PAY.includes(IN_PAY.axes.case.pick);
|
| 660 |
+
// ๋ฐ์ ๊ฒ์ด์ง: ์ค์ฌ (220,230), ๋ฐ์ง๋ฆ 190
|
| 661 |
+
const cx = 220, cy = 230, R = 190, ang = p => Math.PI * (1 - p), pt = (p, r) => [cx + r * Math.cos(ang(p)), cy - r * Math.sin(ang(p))];
|
| 662 |
+
const [t1x, t1y] = pt(TH, R - 26), [t2x, t2y] = pt(TH, R + 26), [lx, ly] = pt(TH, R + 52);
|
| 663 |
+
const arc = `M${cx - R} ${cy} A${R} ${R} 0 0 1 ${cx + R} ${cy}`;
|
| 664 |
+
return `${K(i, `${SHORT}๋ ํท๊ฐ๋ฆด ๋`)}${HL("๋ชจ๋ฅด๋ฉด, *๋ชจ๋ฅธ๋ค๊ณ * ๋งํฉ๋๋ค")}
|
| 665 |
+
<div class="unsure">
|
| 666 |
+
<div class="ucol"><div class="msg glass" data-in="500"><div class="h"><i></i>๊ณ ๊ฐ ๋ฌธ์</div><div class="t">โ${esc(IN_PAY.text)}โ</div></div>
|
| 667 |
+
<div class="cands glass" data-in="1100">${top.map(([p, j], k) => `<div class="op"><span class="t">${esc(SN.CASES[j].label)}</span><span class="pct" data-n="${p}" data-t="1300">0%</span><div class="bar"><i data-w="${p}" data-t="1300" style="--c:${k === 0 ? "var(--ask)" : "#59637a"}"></i></div></div>`).join("")}</div>
|
| 668 |
+
<div class="calib glass" data-in="7600"><div><div class="n" data-n="${D.pooled.mean_conf}" data-t="7800">0%</div><div class="l">๋ชจ๋ธ์ด ๋งํ ํ๊ท ํ์ </div></div><div class="eq">โ</div>
|
| 669 |
+
<div><div class="n" data-n="${D.pooled.acc}" data-t="7800">0%</div><div class="l">์ค์ ์ ๋ต๋ฅ ยท ${D.pooled.n.toLocaleString()}๋ฌธํญ</div></div>
|
| 670 |
+
<div class="say">ํ์ ์ซ์๊ฐ ์ค์ ์ ๊ฑฐ์ ๊ฐ์<br>๊ธฐ์ค์ ์ ๊ฑธ์ด ๋๊ณ ์ธ ์ ์์ต๋๋ค</div></div></div>
|
| 671 |
+
<div class="gauge glass" data-in="2200"><div class="lab2">1์์ ํ๋จ์ ํ์ </div>
|
| 672 |
+
<div class="gwrap"><svg viewBox="0 0 440 250"><path d="${arc}" stroke="rgba(255,255,255,.08)" stroke-width="30" fill="none" stroke-linecap="round"/>
|
| 673 |
+
<path id="arcv" d="${arc}" pathLength="100" stroke="url(#gA)" stroke-width="30" fill="none" stroke-linecap="round" stroke-dasharray="100" stroke-dashoffset="100" style="filter:drop-shadow(0 0 14px rgba(255,170,70,.55))"/>
|
| 674 |
+
<line x1="${t1x}" y1="${t1y}" x2="${t2x}" y2="${t2y}" stroke="#fff" stroke-width="3.5" stroke-linecap="round"/>
|
| 675 |
+
<text class="gth" x="${lx}" y="${ly}" text-anchor="middle">์๋ ์ฒ๋ฆฌ ๊ธฐ์ค ${pct(TH, 0)}</text></svg>
|
| 676 |
+
<div class="gnum" data-n="${conf}" data-t="2500" data-d="1200">0%</div></div>
|
| 677 |
+
<div class="hold" data-in="4100">${I("pause")} ์๋ ์ฒ๋ฆฌ ๋ณด๋ฅ ${I("arrow")} ${I("user")} ์ฌ๋ ์๋ด์ฌ</div>
|
| 678 |
+
${gold ? `<div class="truth" data-in="5600">${right ? "์ด๋ฒ 1์์๋ ๋ง์์ง๋ง, ์ค์ค๋ก ํ์ ์ด ๋ฎ๋ค๊ณ ์๋ ธ์ต๋๋ค." : `์ค์ ์ ๋ต์ <b>โ${esc(gold)}โ</b>.<br>1์์๋ ํ๋ ธ๊ณ , <b>๊ทธ๋์ ๋๊ธด ๊ฒ ๋ง์์ต๋๋ค.</b>`}</div>` : ""}</div>
|
| 679 |
+
</div>`; },
|
| 680 |
+
play(x) { x.bars(null, 1000); x.counts(null, 1000, v => pct(v)); const a = x.$("#arcv"), c = IN_PAY.axes.case.conf; x.tween(2500, 1200, p => a.setAttribute("stroke-dashoffset", 100 - c * 100 * p)); } },
|
| 681 |
+
|
| 682 |
+
{ name: "์์", dur: 12200, aura: ["#ffd36b", "#6d5dfc", "#2b9fff"], cap: "๊ณต๊ฐ ๋ฒค์น๋งํฌ ํ์ 4B ๋ชจ๋ธ ์ค ๊ฐ์ฅ ๋๊ณ , 27B๊ธ ๋ชจ๋ธ๊ณผ ๋๋ํ ์ญ๋๋ค.",
|
| 683 |
+
html: i => { const rows = [["Gemma 4 31B", "31B", 94.40], ["Decision 2.0 Vega 27B", "27B", 92.38], ["Gemma 4 26B-A4B", "26B", 90.37], ["Gemma 4 12B", "12B", 89.58], ["Cygnet ยท Gemma 12B", "12B", 89.18],
|
| 684 |
+
["Qwen3.8 27B", "27B", 89.02], ["JEV 1.13 ยท hosted API", "API", 88.93], ["K-Decision 4B", "4B", 85.41], ["Mica v0.1 4B", "4B", 81.47], ["Qwen3.5 4B", "4B", 78.77]];
|
| 685 |
+
rows.push([`${NAME} (์ด ๋ชจ๋ธ)`, "4B", D.pooled.acc * 100, true]); rows.sort((a, b) => b[2] - a[2] || (a[3] ? 1 : 0) - (b[3] ? 1 : 0)); // ๋์ ์ด๋ฉด ์ด ๋ชจ๋ธ์ ์๋์
|
| 686 |
+
return `${K(i, `๊ณต๊ฐ ํ๊ตญ์ด ํ๋จ ๋ฒค์น๋งํฌ ยท ${D.pooled.n.toLocaleString()}๋ฌธํญ`)}${HL("๋ฉ์น *7๋ฐฐ* ๋ชจ๋ธ๋ค๊ณผ ๊ฐ์ ์ค์")}
|
| 687 |
+
<div class="board">${rows.map((r, j) => `<div class="lr ${r[3] ? "me" : ""} ${r[1] === "4B" ? "small" : ""}" data-in="${600 + j * 110}"><span class="rk">${String(j + 1).padStart(2, "0")}</span><span class="nm">${esc(r[0])}</span><span class="sz">${r[1]}</span>
|
| 688 |
+
<div class="bar"><i data-w="${(r[2] - 70) / 30}" data-t="${1000 + j * 110}"></i></div><span class="pct" data-n="${r[2] / 100}" data-t="${1000 + j * 110}">0%</span></div>`).join("")}</div>
|
| 689 |
+
<div class="fine" data-in="2800">์ถ์ฒ: Korean JEV Benchmark ๊ณต๊ฐ ํ(2026-10-09)์ ํ๊ตญ์ด ์ ํ๋, ๋ง๋๋ 70~100% ๊ตฌ๊ฐ. ๋ค๋ฅธ ๋ชจ๋ธ์ ์ถ๊ฐ ํ์ต ์๋ ์ ๋ก์ท์ด๊ณ , ${NAME}์ ๊ฐ์ ์ถ์ฒ ๋ฐ์ดํฐ์ ํ์ต ๋ถํ ๋ก ๋ฏธ์ธ์กฐ์ ํ์ต๋๋ค โ ๊ฐ์ ์กฐ๊ฑด์ ๋น๊ต๊ฐ ์๋๋ฉฐ, ์์ด ์ฑ๋ฅ์ ์ธก์ ํ์ง ์์์ต๋๋ค.</div>`; },
|
| 690 |
+
play(x) { x.bars(null, 1300); x.counts(null, 1300, v => (v * 100).toFixed(2) + "%"); } },
|
| 691 |
+
|
| 692 |
+
{ name: "์๋", dur: 11200, aura: ["#20d3ad", "#2b9fff", "#6d5dfc"], cap: "๋ด์ค ์ ๋ชฉ์ด ๋จ์๋ง์, ํธ์ฌ์ธ์ง ์
์ฌ์ธ์ง ํ๋จํฉ๋๋ค.",
|
| 693 |
+
html: i => `${K(i, "์๋")}${HL(`ํ๋จ ํ ๋ฒ, *${(MED / 1000).toFixed(2)}์ด*`)}
|
| 694 |
+
<div class="speed"><div class="ticker glass" id="tick" data-in="400"></div>
|
| 695 |
+
<div class="spr"><div class="spbox glass" data-in="700"><div class="big"><span data-n="${MED}" data-t="900" data-d="1000">0</span><small>ms</small></div><div class="l">ํ๋จ 1๋ฒ ๊ณ์ฐ ์๊ฐ (๋คํธ์ํฌ ์๋ณต ์ ์ธ)<br>GPU 1์ฅ ยท ์ ์ฅ๋ ์์ ํ์ ${MS.length}๊ฑด์ ์ค์๊ฐ</div></div>
|
| 696 |
+
<div class="cnt glass" data-in="1100"><div><b id="tkn">0</b><span>๊ฐ์ ํ์ฌ ๋ด์ค<br>ํ์ ๊ฑด์</span></div><div class="g"><b id="tkh">0</b><span>๋ฏธ๋ฆฌ ์ ํด ๋<br>๋ต๊ณผ ์ผ์น</span></div></div></div></div>`,
|
| 697 |
+
play(x) { const box = x.$("#tick"), LAB = [["ํธ์ฌ", "up", "up"], ["์
์ฌ", "dn", "down"], ["์ํฅ ์ ์", "nn", "minus"]]; let hit = 0;
|
| 698 |
+
x.counts(null, null, v => Math.round(v));
|
| 699 |
+
NEWS.forEach((n, j) => x.at(1000 + j * 210, () => { const ok = [1, -1, 0][n.r.pick] === n.impact; if (ok) hit++; const L = LAB[n.r.pick];
|
| 700 |
+
const el = document.createElement("div"); el.className = "tk " + L[1];
|
| 701 |
+
el.innerHTML = `<span class="tr">${I(L[2])}</span><span class="ti">${esc(n.title)}</span><span class="tg">${L[0]}</span><span class="ck" style="color:var(--${ok ? "good" : "bad"})">${I(ok ? "check" : "x")}</span>`;
|
| 702 |
+
box.prepend(el); while (box.children.length > 10) box.lastChild.remove();
|
| 703 |
+
x.$("#tkn").textContent = j + 1; x.$("#tkh").textContent = hit; })); } },
|
| 704 |
+
|
| 705 |
+
{ name: "๋ง๋ฌด๋ฆฌ", dur: 9500, aura: BRAND, cap: "",
|
| 706 |
+
html: () => `<div class="center">
|
| 707 |
+
<div data-in="200">${MARK("markbig")}</div>
|
| 708 |
+
<div class="wm" data-in="900"><span class="a">KJH-Judge</span><span class="b">-4B-ko</span></div>
|
| 709 |
+
<div class="tag words" data-in="1700">${H("๊ณ ๋ฅด๋ ์ผ์, *KJH-Judge*์๊ฒ.")}</div>
|
| 710 |
+
<div class="facts">
|
| 711 |
+
<div class="fact glass k-call" data-in="2600"><div class="itile">${I("target")}</div><b>${pct(D.pooled.acc)}</b><span>ํ๊ตญ์ด ํ๋จ ์ ํ๋ ยท ${D.pooled.n.toLocaleString()}๋ฌธํญ</span></div>
|
| 712 |
+
<div class="fact glass k-respond" data-in="2850"><div class="itile">${I("zap")}</div><b>${(MED / 1000).toFixed(2)}์ด</b><span>ํ๋จ 1๋ฒ ๊ณ์ฐ ยท GPU 1์ฅ</span></div>
|
| 713 |
+
<div class="fact glass k-hi" data-in="3100"><div class="itile">${I("cpu")}</div><b>4B</b><span>์์์ ๋ด ์๋ฒ์์ ์ง์ ์ด์</span></div>
|
| 714 |
+
</div>
|
| 715 |
+
<div class="try" data-in="3900">${I("play")} ์ง์ ํด ๋ณด๊ธฐ ยท <b>${esc(TRY)}</b></div></div>` },
|
| 716 |
+
];
|
| 717 |
+
|
| 718 |
+
/* โโโโโโโโโ ์ฌ์ ์์ง (์์ฒด ์๊ณ: ์ผ์์ ์งยท์ฅ๋ฉด ์ด๋์ด ์ ํ) โโโโโโโโโ */
|
| 719 |
+
const $ = s => document.querySelector(s), stage = $("#stage");
|
| 720 |
+
const P = new URLSearchParams(location.search);
|
| 721 |
+
const LOOP = P.get("loop") === "1", HOLD = P.get("hold") === "1";
|
| 722 |
+
if (P.get("cap") === "0") document.body.classList.add("nocap");
|
| 723 |
+
if (P.get("clean") === "1") document.body.classList.add("clean");
|
| 724 |
+
let cur = 0, t = 0, paused = false, cues = [], tweens = [], sceneEl = null, camEl = null, last = performance.now();
|
| 725 |
+
const easeOut = p => 1 - Math.pow(1 - p, 3), lin = p => p;
|
| 726 |
+
|
| 727 |
+
$("#brand").innerHTML = MARK("on") + `<b>${SHORT}</b><span class="pl">4B ยท ko</span>`;
|
| 728 |
+
$("#chapall").textContent = String(SCENES.length).padStart(2, "0");
|
| 729 |
+
$("#segs").innerHTML = SCENES.map(() => "<span><i></i></span>").join("");
|
| 730 |
+
|
| 731 |
+
function makeCtx(root) {
|
| 732 |
+
const x = {
|
| 733 |
+
$: s => root.querySelector(s), $$: s => [...root.querySelectorAll(s)],
|
| 734 |
+
at(ms, fn) { cues.push({ ms, fn, done: false }); },
|
| 735 |
+
tween(ms, dur, fn, ease = easeOut) { tweens.push({ ms, dur, fn, ease, done: false }); },
|
| 736 |
+
bars(start, dur) { x.$$("[data-w]").forEach(el => { const s = el.dataset.t ? +el.dataset.t : start, d = el.dataset.d ? +el.dataset.d : dur, w = Math.max(0, Math.min(1, +el.dataset.w));
|
| 737 |
+
x.tween(s, d, p => el.style.width = w * p * 100 + "%"); }); },
|
| 738 |
+
counts(start, dur, fmt) { x.$$("[data-n]").forEach(el => { const s = el.dataset.t ? +el.dataset.t : start, d = el.dataset.d ? +el.dataset.d : dur, n = +el.dataset.n;
|
| 739 |
+
x.tween(s, d, p => el.textContent = fmt(n * p)); }); },
|
| 740 |
+
};
|
| 741 |
+
return x;
|
| 742 |
+
}
|
| 743 |
+
function go(i) {
|
| 744 |
+
cur = (i + SCENES.length) % SCENES.length; t = 0; cues = []; tweens = [];
|
| 745 |
+
if (sceneEl) { const old = sceneEl; old.classList.add("leaving"); setTimeout(() => old.remove(), 560); }
|
| 746 |
+
const sc = SCENES[cur], el = document.createElement("div"); el.className = "scene";
|
| 747 |
+
el.innerHTML = `<div class="cam ${sc.cls || ""}">${sc.html(cur)}</div>`;
|
| 748 |
+
stage.insertBefore(el, $("#cap")); sceneEl = el; camEl = el.firstChild;
|
| 749 |
+
const x = makeCtx(el);
|
| 750 |
+
x.$$("[data-in]").forEach(n => x.at(+n.dataset.in, () => n.classList.add("on")));
|
| 751 |
+
x.$$("[data-type]").forEach(n => { const full = n.dataset.full, tt = n.querySelector(".tt"), sp = +n.dataset.sp;
|
| 752 |
+
x.tween(+n.dataset.type, full.length * sp, p => tt.textContent = full.slice(0, Math.round(full.length * p)), lin); });
|
| 753 |
+
if (sc.play) sc.play(x);
|
| 754 |
+
const cap = $("#cap"); cap.classList.remove("on"); cap.textContent = sc.cap || ""; if (sc.cap) x.at(900, () => cap.classList.add("on"));
|
| 755 |
+
(sc.aura || BRAND).forEach((c, k) => $("#aurora .b" + (k + 1)).style.backgroundColor = c);
|
| 756 |
+
$("#chapn").textContent = String(cur + 1).padStart(2, "0"); $("#chapt").textContent = sc.name;
|
| 757 |
+
cues.sort((a, b) => a.ms - b.ms);
|
| 758 |
+
tick(0); renderHud();
|
| 759 |
+
}
|
| 760 |
+
function tick(dt) {
|
| 761 |
+
if (!paused) t += dt;
|
| 762 |
+
for (const c of cues) if (!c.done && t >= c.ms) { c.done = true; c.fn(); }
|
| 763 |
+
for (const w of tweens) if (!w.done && t >= w.ms) { const p = Math.min(1, (t - w.ms) / w.dur); w.fn(w.ease(p)); if (p >= 1) w.done = true; }
|
| 764 |
+
const dur = SCENES[cur].dur, prog = Math.min(1, t / dur);
|
| 765 |
+
if (camEl) camEl.style.transform = `scale(${1 + 0.022 * prog})`; // ์ฒ์ฒํ ๋ค๊ฐ๊ฐ๋ ์นด๋ฉ๋ผ
|
| 766 |
+
document.querySelectorAll("#segs i").forEach((s, k) => s.style.width = (k < cur ? 100 : k === cur ? prog * 100 : 0) + "%");
|
| 767 |
+
const lastScene = cur === SCENES.length - 1 && !LOOP && !HOLD;
|
| 768 |
+
$("#fade").style.opacity = lastScene ? Math.max(0, Math.min(1, (t - (dur - 1500)) / 1300)) : 0;
|
| 769 |
+
if (!paused && !HOLD && t >= dur) { if (cur < SCENES.length - 1) go(cur + 1); else if (LOOP) go(0); else t = dur; }
|
| 770 |
+
}
|
| 771 |
+
function loop(now) { const dt = Math.min(100, now - last); last = now; tick(dt); requestAnimationFrame(loop); }
|
| 772 |
+
|
| 773 |
+
function fit() { const s = Math.min(innerWidth / 1920, innerHeight / 1080); stage.style.transform = `translate(-50%,-50%) scale(${s})`; }
|
| 774 |
+
addEventListener("resize", fit); fit();
|
| 775 |
+
|
| 776 |
+
function setPause(v) { paused = v; $("#play").textContent = paused ? "โถ๏ธ ์ฌ์" : "โโ"; $("#pausebadge").hidden = !paused || document.body.classList.contains("clean"); }
|
| 777 |
+
function renderHud() { $("#dots").innerHTML = SCENES.map((s, i) => `<button class="${i === cur ? "cur" : ""}" data-g="${i}" title="${i + 1}. ${s.name}">${i + 1}</button>`).join(""); }
|
| 778 |
+
$("#dots").onclick = e => { const b = e.target.closest("[data-g]"); if (b) go(+b.dataset.g); };
|
| 779 |
+
$("#prev").onclick = () => go(cur - 1); $("#next").onclick = () => go(cur + 1); $("#play").onclick = () => setPause(!paused);
|
| 780 |
+
addEventListener("keydown", e => {
|
| 781 |
+
if (e.ctrlKey || e.metaKey || e.altKey) return;
|
| 782 |
+
const k = e.key;
|
| 783 |
+
if (k === " ") { e.preventDefault(); setPause(!paused); }
|
| 784 |
+
else if (k === "ArrowRight" || k === "PageDown") go(cur + 1);
|
| 785 |
+
else if (k === "ArrowLeft" || k === "PageUp") go(cur - 1);
|
| 786 |
+
else if (k === "r" || k === "R") { setPause(false); go(0); }
|
| 787 |
+
else if (k === "h" || k === "H") { document.body.classList.toggle("clean"); setPause(paused); }
|
| 788 |
+
else if (k === "c" || k === "C") document.body.classList.toggle("nocap");
|
| 789 |
+
else if (k === "f" || k === "F") { document.fullscreenElement ? document.exitFullscreen() : document.documentElement.requestFullscreen().catch(() => {}); }
|
| 790 |
+
else if (/^[0-9]$/.test(k)) { const n = k === "0" ? 9 : +k - 1; if (n < SCENES.length) go(n); }
|
| 791 |
+
});
|
| 792 |
+
let idleT; addEventListener("mousemove", () => { document.body.classList.remove("idle"); clearTimeout(idleT); idleT = setTimeout(() => document.body.classList.add("idle"), 2200); });
|
| 793 |
+
idleT = setTimeout(() => document.body.classList.add("idle"), 2200);
|
| 794 |
+
|
| 795 |
+
const start = Math.max(0, Math.min(SCENES.length - 1, (+P.get("s") || 1) - 1));
|
| 796 |
+
(document.fonts ? Promise.race([document.fonts.ready, new Promise(r => setTimeout(r, 1800))]) : Promise.resolve()).then(() => { go(start);
|
| 797 |
+
const at = +P.get("at") || 0; for (let k = 0; k < at; k += 50) tick(Math.min(50, at - k)); // ?at=ms : ์ฅ๋ฉด ์์ ๊ทธ ์์ ์ผ๋ก ์ด๋
|
| 798 |
+
last = performance.now(); requestAnimationFrame(loop); });
|
| 799 |
+
</script>
|
| 800 |
+
</body>
|
| 801 |
+
</html>
|