File size: 7,519 Bytes
cca00cc
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# KJH-Judge-4B-ko ๋น ๋ฅธ ํ…Œ์ŠคํŠธ\n",
    "\n",
    "ํ—ˆ๊น…ํŽ˜์ด์Šค์— ์˜ฌ๋ฆฐ ๋ชจ๋ธ์„ ๋‚ด๋ ค๋ฐ›์•„ ํŒ์ •ํ•ด ๋ด…๋‹ˆ๋‹ค.\n",
    "\n",
    "- **GPU ๋Ÿฐํƒ€์ž„**์—์„œ ์‹คํ–‰ํ•˜์„ธ์š” (Colab: ๋Ÿฐํƒ€์ž„ โ†’ ๋Ÿฐํƒ€์ž„ ์œ ํ˜• ๋ณ€๊ฒฝ โ†’ T4 GPU). CPU์—์„œ๋Š” ํŒ์ • ํ•œ ๋ฒˆ์— ์ˆ˜์‹ญ ์ดˆ ์ด์ƒ ๊ฑธ๋ฆฌ๊ณ  ๋ฉ”๋ชจ๋ฆฌ๋„ 16GB ๋„˜๊ฒŒ ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.\n",
    "- ๋ชจ๋ธ ๋‚ด๋ ค๋ฐ›๊ธฐ์— ๋ช‡ ๋ถ„ ๊ฑธ๋ฆฝ๋‹ˆ๋‹ค (์•ฝ 8GB).\n",
    "- ๊ฒฐ๊ณผ๋Š” ๋ชจ๋‘ `{'choice': ๊ณ ๋ฅธ ๋ณด๊ธฐ, 'confidence': ๊ทธ ํ™•๋ฅ , 'probabilities': ๋ณด๊ธฐ๋ณ„ ํ™•๋ฅ }` ๋ชจ์–‘์ž…๋‹ˆ๋‹ค."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "%pip install -q -U \"transformers>=5\" accelerate\n",
    "# Colab์—์„œ transformers ๊ฐ€ ์ด๋ฏธ 4.x ๋กœ ๊น”๋ ค ์žˆ์—ˆ๋‹ค๋ฉด, ์„ค์น˜ ํ›„ '๋Ÿฐํƒ€์ž„ โ†’ ์„ธ์…˜ ๋‹ค์‹œ ์‹œ์ž‘'์„ ํ•œ ๋ฒˆ ํ•˜๊ณ  ์•„๋ž˜ ์…€๋ถ€ํ„ฐ ์‹คํ–‰ํ•˜์„ธ์š”."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "์ €์žฅ์†Œ๊ฐ€ **๋น„๊ณต๊ฐœ**๋ผ๋ฉด ์•„๋ž˜ ์…€์˜ ์ฃผ์„์„ ํ’€๊ณ  ํ† ํฐ์œผ๋กœ ๋กœ๊ทธ์ธํ•˜์„ธ์š” (Colab์€ ์™ผ์ชฝ ์—ด์‡  ์•„์ด์ฝ˜์˜ ๋ณด์•ˆ ๋น„๋ฐ€์— `HF_TOKEN`์„ ๋„ฃ์–ด ๋‘๋ฉด ์ž๋™์œผ๋กœ ์”๋‹ˆ๋‹ค)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# from huggingface_hub import login\n",
    "# login()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "import torch\n",
    "from transformers import pipeline\n",
    "\n",
    "gpu = torch.cuda.is_available()\n",
    "print(\"GPU:\", torch.cuda.get_device_name(0) if gpu else \"์—†์Œ (CPU, ๋งค์šฐ ๋А๋ฆผ)\")\n",
    "\n",
    "judge = pipeline(model=\"coderecode95/KJH-Judge-4B-ko\", trust_remote_code=True,\n",
    "                 device=0 if gpu else -1, dtype=\"bfloat16\" if gpu else \"float32\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 1. ์ž์ฃผ ์“ฐ๋Š” ํŒ์ • โ€” ๋ฉ”์„œ๋“œ ํ•˜๋‚˜๋กœ\n",
    "\n",
    "ํ•™์Šต ๋•Œ์™€ ๊ฐ™์€ ์ง€์นจยท๋ณด๊ธฐ๊ฐ€ ์ž๋™์œผ๋กœ ๋“ค์–ด๊ฐ‘๋‹ˆ๋‹ค."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "judge.sentiment(\"๋ฐฐ์†ก์€ ๋А๋ ธ์ง€๋งŒ ๋ฌผ๊ฑด์€ ์ •๋ง ๋งˆ์Œ์— ๋“ค์–ด์š”\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "print(judge.nli(\"ํก์—ฐ์ž๋ถ„๋“ค์€ ๋ฐœ์ฝ”๋‹ˆ๊ฐ€ ์žˆ๋Š” ๋ฐฉ์ด๋ฉด ๋ฐœ์ฝ”๋‹ˆ์—์„œ ํก์—ฐ์ด ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค.\", \"์–ด๋–ค ๋ฐฉ์—์„œ๋„ ํก์—ฐ์€ ๊ธˆ์ง€๋ฉ๋‹ˆ๋‹ค.\"))\n",
    "print(judge.topic(\"์†ํฅ๋ฏผ, ์‹œ์ฆŒ 10ํ˜ธ๊ณจโ€ฆํ† ํŠธ๋„˜ 3์—ฐ์Šน ์ด๋Œ์–ด\"))\n",
    "print(judge.hate(\"์—ฐ๊ธฐ ์ง„์งœ ๋งŽ์ด ๋Š˜์—ˆ๋‹ค ๋‹ค์Œ ์ž‘ํ’ˆ๋„ ๊ธฐ๋Œ€๋จ\"))\n",
    "print(judge.yes_no(\"์ฝœ๋ผ๋…๋ฆฝ 815๋Š” ์ฝ”์นด์ฝœ๋ผ์—์„œ ๋งŒ๋“ค์—ˆ๋‚˜์š”?\",\n",
    "                   \"์ฝœ๋ผ๋…๋ฆฝ 815๋Š” ์ฝ”์นด์ฝœ๋ผ๋ฅผ ๋ผ์ด์„ ์Šค๋กœ ๋งŒ๋“ค์–ด ์˜ค๋˜ ๋ฒ”์–‘์‹ํ’ˆ์ด 1998๋…„์— ์ถœ์‹œํ•œ ํƒ„์‚ฐ์Œ๋ฃŒ๋‹ค.\"))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# ์—์ด์ „ํŠธ์˜ ๋‹ค์Œ ํ–‰๋™: ํ•„์ˆ˜ ์ •๋ณด๊ฐ€ ๋น ์กŒ์œผ๋ฉด ASK, ๋‹ค ์žˆ์œผ๋ฉด CALL, ๋„๊ตฌ๊ฐ€ ํ•„์š” ์—†์œผ๋ฉด RESPOND\n",
    "tools = [\n",
    "    {\"type\": \"function\", \"function\": {\"name\": \"call_taxi\", \"description\": \"ํƒ์‹œ๋ฅผ ํ˜ธ์ถœํ•œ๋‹ค\",\n",
    "     \"parameters\": {\"type\": \"object\", \"properties\": {\"pickup\": {\"type\": \"string\"}, \"destination\": {\"type\": \"string\"}}, \"required\": [\"pickup\", \"destination\"]}}},\n",
    "    {\"type\": \"function\", \"function\": {\"name\": \"get_weather\", \"description\": \"์ง€์—ญ์˜ ํ˜„์žฌ ๋‚ ์”จ๋ฅผ ์•Œ๋ ค์ค€๋‹ค\",\n",
    "     \"parameters\": {\"type\": \"object\", \"properties\": {\"city\": {\"type\": \"string\"}}, \"required\": [\"city\"]}}},\n",
    "]\n",
    "for msg in [\"ํƒ์‹œ ์ข€ ๋ถˆ๋Ÿฌ์ค˜\", \"๊ฐ•๋‚จ์—ญ์—์„œ ์„œ์šธ์—ญ๊นŒ์ง€ ํƒ์‹œ ๋ถˆ๋Ÿฌ์ค˜\", \"๋ถ€์‚ฐ ๋‚ ์”จ ์–ด๋•Œ?\", \"๊ณ ๋งˆ์›Œ!\"]:\n",
    "    r = judge.next_action(msg, tools)\n",
    "    print(f\"{r['choice']:<18} {r['confidence']:.1%}  โ† {msg}\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "# ๋ฆฌ์ŠคํŠธ๋ฅผ ๋„ฃ์œผ๋ฉด ์—ฌ๋Ÿฌ ๊ฐœ๋ฅผ ํ•œ ๋ฒˆ์—\n",
    "headlines = [\"์†ํฅ๋ฏผ, ์‹œ์ฆŒ 10ํ˜ธ๊ณจโ€ฆํ† ํŠธ๋„˜ 3์—ฐ์Šน ์ด๋Œ์–ด\", \"์ฝ”์Šคํ”ผ 2,700 ๋ŒํŒŒโ€ฆ์™ธ๊ตญ์ธ ์ˆœ๋งค์ˆ˜\", \"์ƒˆ ์Šค๋งˆํŠธํฐ ๊ณต๊ฐœ, AI ๊ธฐ๋Šฅ ๊ฐ•ํ™”\", \"๊ตญํšŒ ๋ณธํšŒ์˜์„œ ์˜ˆ์‚ฐ์•ˆ ํ†ต๊ณผ\"]\n",
    "for h, r in zip(headlines, judge.topic(headlines)):\n",
    "    print(f\"{r['choice']:<5} {r['confidence']:.1%}  {h}\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 2. ๋‚ด ํŒ์ • ๋งŒ๋“ค๊ธฐ โ€” JEV ํ˜•์‹\n",
    "\n",
    "์ƒํ™ฉ(`state`) ํ•˜๋‚˜์— ์ด๋ฆ„ ๋ถ™์ธ ์งˆ๋ฌธ ์—ฌ๋Ÿฌ ๊ฐœ๋ฅผ ํ•œ ๋ฒˆ์— ๋ฌป์Šต๋‹ˆ๋‹ค. `criteria`์˜ ํ‚ค(ID)๊ฐ€ ๊ฒฐ๊ณผ๋กœ ๋Œ์•„์˜ต๋‹ˆ๋‹ค."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "judge.decide(\n",
    "    state={\"๊ณ ๊ฐ ๋ฌธ์˜\": \"์ง€๋‚œ๋‹ฌ ์š”๊ธˆ์ด ๋‘ ๋ฒˆ ๋น ์ ธ๋‚˜๊ฐ”์–ด์š”. ์˜ค๋Š˜ ์•ˆ์— ์ฒ˜๋ฆฌํ•ด ์ฃผ์„ธ์š”.\"},\n",
    "    questions={\n",
    "        \"๋ถ€์„œ\": {\n",
    "            \"instructions\": \"๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.\",\n",
    "            \"criteria\": {\"billing\": \"๊ฒฐ์ œยทํ™˜๋ถˆ\", \"delivery\": \"๋ฐฐ์†ก\", \"account\": \"๊ณ„์ •ยท๋กœ๊ทธ์ธ\", \"other\": \"๊ธฐํƒ€\"},\n",
    "        },\n",
    "        \"๊ธด๊ธ‰\": {\n",
    "            \"instructions\": \"๊ณ ๊ฐ์ด ์ฆ‰์‹œ ์ฒ˜๋ฆฌ๋ฅผ ์š”๊ตฌํ•˜๋Š”์ง€ ํŒ๋‹จํ•œ๋‹ค.\",\n",
    "            \"criteria\": {\"urgent\": \"์ฆ‰์‹œ ์ฒ˜๋ฆฌ ์š”๊ตฌ\", \"normal\": \"์ผ๋ฐ˜ ๋ฌธ์˜\"},\n",
    "        },\n",
    "    },\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 3. ํ™•์‹ ์ด ๋‚ฎ์œผ๋ฉด ์‚ฌ๋žŒ์—๊ฒŒ ๋„˜๊ธฐ๊ธฐ\n",
    "\n",
    "๊ธฐ์ค€๊ฐ’(์—ฌ๊ธฐ์„œ๋Š” 0.7)์€ ์‹ค์ œ๋กœ ์“ธ ๋ฐ์ดํ„ฐ์—์„œ ๋‹ค์‹œ ๋งž์ถ”๋Š” ๊ฒƒ์ด ์ข‹์Šต๋‹ˆ๋‹ค. ํ•™์Šตํ•˜์ง€ ์•Š์€ ๋ฐ์ดํ„ฐ์—์„œ๋Š” ํ™•์‹ ์ด ์ •ํ™•๋„๋ณด๋‹ค ์กฐ๊ธˆ ๋†’๊ฒŒ ๋‚˜์˜ต๋‹ˆ๋‹ค."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "reviews = [\"๋ฐฐ์†ก ์ฐธ ๋น ๋ฅด๋„ค์š”. 2์ฃผ ๊ฑธ๋ ธ์–ด์š”\", \"๊ฐ€๊ฒฉ ๋Œ€๋น„ ๊ดœ์ฐฎ์•„์š”\", \"๋‹ค์‹œ๋Š” ์•ˆ ์‚ฝ๋‹ˆ๋‹ค\", \"๊ทธ๋ƒฅ ๊ทธ๋ž˜์š”\"]\n",
    "for t, r in zip(reviews, judge.sentiment(reviews)):\n",
    "    print(f\"{r['choice']} {r['confidence']:.1%}  {'์ž๋™ ์ฒ˜๋ฆฌ' if r['confidence'] >= 0.7 else 'โ†’ ์‚ฌ๋žŒ ๊ฒ€ํ† ':<8}  {t}\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 4. ํ•œ ์ค„๋กœ ์ง์ ‘ ํ•ด ๋ณด๊ธฐ"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": [
    "judge(\"์ด ์•ฑ ๋กœ๊ทธ์ธ์ด ๊ณ„์† ์•ˆ ๋ผ์š”. ๋น„๋ฐ€๋ฒˆํ˜ธ๋ฅผ ๋ฐ”๊ฟ”๋„ ๋˜‘๊ฐ™์•„์š”.\",\n",
    "      choices=[\"๊ฒฐ์ œยทํ™˜๋ถˆ\", \"๋ฐฐ์†ก\", \"๊ณ„์ •ยท๋กœ๊ทธ์ธ\", \"์ œํ’ˆ ๋ฌธ์˜\", \"๊ธฐํƒ€\"],\n",
    "      instruction=\"๊ณ ๊ฐ ๋ฌธ์˜๋ฅผ ๋‹ด๋‹น ๋ถ€์„œ๋กœ ๋ถ„๋ฅ˜ํ•œ๋‹ค.\")"
   ]
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3",
   "name": "python3"
  },
  "language_info": {
   "name": "python"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}