haru-e5-small-en-int8

HaruPet λ°μŠ€ν¬ν†± 펫의 μ˜μ–΄ 'CPU μ „μš© λŒ€ν™”'(λ‚΄μž₯ λŒ€ν™” λͺ¨λΈμ„ λͺ» μ“°λŠ” μ‚¬μš©μžμš© λ‹΅ κ³ λ₯΄κΈ°)에 μ“°λŠ” λ¬Έμž₯ μž„λ² λ”© λͺ¨λΈμ΄μ—μš”. μ–Έμ–΄λ§ˆλ‹€ λͺ¨λΈμ΄ λ”°λ‘œ μžˆμ–΄μš”(ν•œκ΅­μ–΄: haru-e5-small-int8). ν•œκ΅­μ–΄ ν•˜λ£¨ λͺ¨λΈμ—μ„œ μΆœλ°œν•΄ μ˜μ–΄ μ§ˆλ¬Έβ†”λ‹΅ 쌍으둜 μ΄μ–΄μ„œ ν•™μŠ΅ν–ˆμ–΄μš”(MultipleNegativesRanking, 3에폭). ν•™μŠ΅ λ°μ΄ν„°λŠ” κ³΅κ°œν•˜μ§€ μ•Šμ•„μš”.

  • onnx/model_quantized.onnx: int8 동적 μ–‘μžν™”(채널별 uint8), 118MB. 앱이 μ“°λŠ” νŒŒμΌμ΄μ—μš”.
  • onnx/model.onnx: fp32, 470MB
  • 384차원, mean pooling ν›„ μ •κ·œν™”. μž…λ ₯ μ•žμ— query: λ₯Ό λΆ™μ—¬μš”.

CPU μ „μš© λŒ€ν™” 묢음 (cpu-chat/)

  • cpu-chat/questions.f16: 곡용 질문 3,575개(μ˜μ–΄)의 벑터. 3,575Γ—384 float16, little-endian, μ •κ·œν™”λ¨. 2.7MB
  • cpu-chat/answers.json: answers.{haru,luna,mori,minako}[i], fallback.<캐릭터> 3개, threshold 0.5

졜고 점수 >= threshold λ©΄ κ·Έ 질문의 λ‹΅, μ•„λ‹ˆλ©΄ λ˜λ¬»λŠ” 말. CPU(WASM, 1μŠ€λ ˆλ“œ)μ—μ„œ ν•œ 번 κ³ λ₯΄λŠ” 데 μ•½ 15ms, 효율 μ½”μ–΄λ§Œ μ“°λ©΄ μ•½ 96ms.

Downloads last month
17
Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for ruddls030/haru-e5-small-en-int8

Quantized
(304)
this model