nari-router-4b

blackmallangcow/nari-decision-4b(v3.2, ์ปค๋ฐ‹ 029c4628a38859dce5b0db1742e9c97545aabe12)๋ฅผ ๊ต์‹ค ๊ณผํ•™ ์‹คํ—˜ ๋กœ๋ด‡(OpenArm SciEdu)์˜ ํ•œ๊ตญ์–ด ๋ง ๋ผ์šฐํ„ฐ๋กœ ๋ฏธ์„ธ์กฐ์ •ํ•œ ๋ชจ๋ธ์ด๋‹ค. ๋ฐ›์•„์“ด ํ•™์ƒยท์„ ์ƒ๋‹˜ ๋ง๊ณผ ๊ทธ๋•Œ์˜ ์ƒํ™ฉ ์นธ์„ ์—ดํ•œ ๊ฐˆ๋ž˜(pause, stop, proceed, retry, start_switch, leaf_side, hands, question, answer, chitchat, unclear) ๊ฐ€์šด๋ฐ ํ•˜๋‚˜๋กœ ๊ฐ€๋ฅธ๋‹ค. ๋ฐ”ํƒ• ๋ชจ๋ธ์˜ ์›๊ฒฉ ์ฝ”๋“œ(modeling_sysone.py)๋ฅผ ๊ทธ๋Œ€๋กœ ์“ฐ๊ณ  model.decide()๋กœ ๋ถ€๋ฅธ๋‹ค. LoRA๋Š” bf16 ๊ฐ€์ค‘์น˜์— ํ•ฉ์ณค๋‹ค.

  • ํ•™์Šต: ๋ฐฑ๋ณธ ๋ชจ๋“  ์„ ํ˜• ์ธต LoRA(๊ณ„์ˆ˜ 16, alpha 32.0) + ๊ฒฐ์ • ํ—ค๋“œ, ํ—ค๋“œ๋Š” ๋กœ๊ทธ ์†์‹ค + Brier, ๊ธ€์ž ๋‹ต์€ ๊ต์ฐจ ์—”ํŠธ๋กœํ”ผ, ๋ณด๊ธฐ ์ˆœ์„œ๋ฅผ ์ค„๋งˆ๋‹ค ์„ž์Œ, ํ•™์Šต๋ฅ  0.0002, ์—ํฌํฌ 3, ๋ฐฐ์น˜ 8, ์”จ์•— 2, ๋ฉˆ์ถคยท๊ทธ๋งŒ ๊ฐ€์ค‘ 2.0.
  • ์ฝ๊ธฐ: ๊ฒฐ์ • ํ—ค๋“œ์™€ ๊ธ€์ž ๋‹ต์˜ ๋กœ๊ทธ ํ™•๋ฅ ์„ lm_weight 0.0๋กœ ์„ž๋Š”๋‹ค. ๋ณด์ • ์˜จ๋„ choice:6+ = 2.01(๊ฒ€์ฆ + ๊ฐœ๋ฐœ ์„ธํŠธ๋กœ ๋‹ค์‹œ ๋งž์ถค).
  • ์ž…๋ ฅ: state๋Š” ๊ต์‹ค ๊ณผํ•™ ์‹คํ—˜ ๋กœ๋ด‡ ๊ณ์—์„œ ๋“ค๋ฆฐ ํ•œ๊ตญ์–ด ๋ง์„ ๋ฐ›์•„์“ด ๊ธ€๊ณผ ๊ทธ๋•Œ์˜ ์ƒํ™ฉ์ด๋‹ค. '||' ์•ž์€ ์ƒํ™ฉ ์นธ, ๋’ค๋Š” ๊ทธ ๋ง์ด๋‹ค. ๋’ค์— ์žฅ๋ฉด=โ€ฆ | ์‹คํ—˜=โ€ฆ | ๋‚˜๋ญ‡์žŽ ํ™œ๋™=โ€ฆ | AI ์ œ์•ˆ=โ€ฆ | ๋งํ•œ ์‚ฌ๋žŒ=โ€ฆ || <๋ง> ํ•œ ์ค„, ์งˆ๋ฌธ์€ utterance_kind ํ•˜๋‚˜(choice, ๋ณด๊ธฐ๋Š” ํ•™์Šตํ•œ ๊ธ€ ๊ทธ๋Œ€๋กœ). ๋ณด๊ธฐ ๊ธ€๊ณผ ์ง€์‹œ๋ฌธ์€ ์ €์žฅ์†Œ dialogue/routing/nari_route.py์˜ short_stop ํŒ์ด๋‹ค. ๋‹ค๋ฅธ ๊ธ€๋กœ ๋ฌผ์œผ๋ฉด ํ•™์Šตํ•œ ๋ถ„ํฌ์—์„œ ๋ฒ—์–ด๋‚œ๋‹ค.
  • ์ž๋ฃŒ์™€ ์ธก์ •: ๋น„๊ณต๊ฐœ ์ €์žฅ์†Œ์˜ ํ•™์Šต ์ž๋ฃŒ๋กœ ํ•™์Šตํ–ˆ๊ณ  ์ž๋ฃŒ๋Š” ์˜ฌ๋ฆฌ์ง€ ์•Š๋Š”๋‹ค. ์ˆซ์ž๋Š” ์ €์žฅ์†Œ docs/measurements/routing.md 12~15์ ˆ.
Downloads last month
80
Safetensors
Model size
4B params
Tensor type
BF16
ยท
F32
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for leapshared/nari-router-4b

Finetuned
Qwen/Qwen3.5-4B
Finetuned
(1)
this model