iapyx-v3-exaone-deep-2.4b โ€” Iapyx v3 (LG AI ์—ฐ๊ตฌ์›)

2026 AI ๋ฃจํ‚ค ๊ฒฐ์„  Team Iapyx(AI ๋ผ์ดํ”„ ๊ฐ€๋””์–ธ, ๊ตญ๋‚ด AI ํŠธ๋ž™)๊ฐ€ ๋Œ€ํšŒ ์ง€๊ธ‰ A100 80GB ร—2์—์„œ LGAI-EXAONE/EXAONE-Deep-2.4B๋ฅผ ์ „์ฒด ๊ฐ€์ค‘์น˜ ํŒŒ์ธํŠœ๋‹(FSDP) ๋ฐฉ์‹์œผ๋กœ ๊ฐ€๋ฅด์นœ ๊ฒฐ๊ณผ๋‹ค. ํŒ์ •์€ ์ œํ’ˆ์˜ ๊ฒฐ์ •์  ๊ทœ์น™์ด ๋‚ด๋ฆฌ๊ณ , ์ด ๋ชจ๋ธ์€ ์ •ํ•ด์ง„ ์นธ(JSON)ยท๋„๊ตฌ ๊ณ ๋ฅด๊ธฐยท์„œ๋ฅ˜ ์นธ ์ฝ๊ธฐยท๊ฒ€์‚ฐยทํ‘œํ˜„ ๋‹ค๋“ฌ๊ธฐ๋ฅผ ๋ฐฐ์šด๋‹ค.

๊ณผ์—… 6์ข… (๊ฐ™์€ held-out, ๊ฐ™์€ ์ฑ„์  ์ฝ”๋“œ)

์ง€ํ‘œ ๊ฐ€๋ฅด์น˜๊ธฐ ์ „ ๊ฐ€๋ฅด์นœ ๋’ค
์œ„ํ—˜ ๋“ฑ๊ธ‰ macro-F1 0.000 1.000
๋„๊ตฌ ๊ณ ๋ฅด๊ธฐ ์ •ํ™•๋„ 0.270 1.000
์„œ๋ฅ˜ ์นธ F1 0.006 0.997
๊ฒ€์‚ฐ ์™„์ „ ์ผ์น˜์œจ 0.000 0.727
ํ‘œํ˜„ ์•ˆ์ „์œจ 0.220 0.965
๋ฒ•๋ฅ  ์šฉ์–ด chrF 0.048 0.091

์ข…ํ•ฉ(5๊ณผ์—… ํ‰๊ท , domain ์ œ์™ธ): ์ „ 0.09923583934088569 โ†’ ํ›„ 0.9378656173037798 ยท ํ•œ ๊ฑด ์ƒ์„ฑ ์ง€์—ฐ 0.1794s(๋ฐฐ์น˜, A100)

ํ•™์Šต ๊ตฌ์„ฑ

  • ์—ํฌํฌ 24.0 (๊ฐ€์žฅ ์ข‹์€ ์—ํฌํฌ 3.0, ํ‰๊ฐ€ ์†์‹ค 0.4689919948577881), lr 1e-05, ๋ฐฐ์น˜ 8ร—๋ˆ„์  2ร—GPU 1, ์ตœ๋Œ€ ๊ธธ์ด 2048
  • ํ•™์Šต ์‹œ๊ฐ„ 10810.3์ดˆ, ํ•™์Šต 11018๊ฑด / ํ‰๊ฐ€ 1130๊ฑด
  • ๋ฐ์ดํ„ฐ: ํ•ฉ์„ฑ SFT(์œ„ํ—˜ ํŒ์ •ยท๋„๊ตฌ ๊ณ ๋ฅด๊ธฐยท์„œ๋ฅ˜ ์ถ”์ถœยท๊ฒ€์‚ฐ)๋Š” ์ œํ’ˆ ๊ทœ์น™ ์ƒ์„ฑ๊ธฐ, ํ‘œํ˜„ ๊ณผ์—… ์ •๋‹ต์€ ๊ตญ๋‚ด API K-EXAONE(์ถ”๋ก  ๋”)์—์„œ ๋ฐ›์•„ ์ˆซ์žยท๊ธธ์ด ๊ฒ€์‚ฌ๋ฅผ ํ†ต๊ณผํ•œ ๊ฒƒ๋งŒ, ๋ฒ•๋ฅ  ์šฉ์–ด๋Š” JusWis/korean-legal-terminology(CC BY 4.0). ํ•ด์™ธ ๋ชจ๋ธ์€ ๋ฐ์ดํ„ฐยทํ•™์Šตยทํ‰๊ฐ€ ์–ด๋””์—๋„ ์“ฐ์ง€ ์•Š์•˜๋‹ค.
  • ์†์‹ค์€ assistant ํ† ํฐ์—๋งŒ. ์—ํฌํฌ๋งˆ๋‹ค ํ‰๊ฐ€ ์†์‹ค์„ ์žฌ๊ณ  ๊ฐ€์žฅ ๋‚ฎ์€ ์—ํฌํฌ๋ฅผ ๋‚จ๊ฒผ๋‹ค(๊ณผ์ ํ•ฉ ์ง€์  ํ™•์ธ์šฉ ๊ณก์„ ์€ W&B iapyx-finetune).
์—ํฌํฌ ํ‰๊ฐ€ ์†์‹ค
1 0.5243
2 0.4735
3 0.4690
4 0.4778
5 0.5037
6 0.5353
7 0.5604
8 0.5978
9 0.6222
10 0.6457
11 0.6662
12 0.6773
13 0.6987
14 0.7111
15 0.7242
16 0.7308
17 0.7376
18 0.7410
19 0.7433
20 0.7453
21 0.7464
22 0.7461
23 0.7464
24 0.7462

๋ผ์ด์„ ์Šคยท์šฉ๋„

๋ฐ”ํƒ• ๋ชจ๋ธ ๋ผ์ด์„ ์Šค: EXAONE AI Model License (์—ฐ๊ตฌ์šฉ). ๋Œ€ํšŒยท์—ฐ๊ตฌ ๋ชฉ์ ์œผ๋กœ๋งŒ ์ผ๋‹ค. ์ถ”๋ก ํ˜•

์žฌํ˜„: https://github.com/AIROOKIE-S/iapyx finetune-v3/ ยท ํ‰๊ฐ€ ์›๋ณธ https://huggingface.co/datasets/space1637/iapyx-finetune-report (v3/)

Downloads last month
13
Safetensors
Model size
2B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for space1637/iapyx-v3-exaone-deep-2.4b

Finetuned
(17)
this model