h0dson commited on
Commit
a3e353d
·
verified ·
1 Parent(s): 1c8fa0c

Model card

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: transformers.js
4
+ pipeline_tag: feature-extraction
5
+ base_model: intfloat/multilingual-e5-small
6
+ language: multilingual
7
+ tags:
8
+ - decidekit
9
+ - system-one
10
+ - text-classification
11
+ - onnx
12
+ ---
13
+
14
+ # Decide Multilingual
15
+
16
+ The sentence encoder behind Decide Multilingual, a System One model that picks one of your labels for a piece of text on the user's device. Many languages. About 118 MB at 8-bit. [decidekit](https://debuff.jp/decide/) adds the trained head and calibrated confidence.
17
+
18
+ ```ts
19
+ import { createDecider } from "decidekit";
20
+
21
+ const d = await createDecider({ model: "debuffjp/decide-multilingual" });
22
+ const { choice, confidence } = await d.decide("my card still hasn't arrived", ["card_arrival", "refund"]);
23
+ ```
24
+
25
+ - MASSIVE intents with all training data: 76% on Japanese and Chinese
26
+
27
+ Scripts: [eval/multilingual.ts](https://github.com/debuffjp/decidekit/blob/main/eval/multilingual.ts).
28
+
29
+ ## Where the weights come from
30
+
31
+ These files are an unmodified copy of [Xenova/multilingual-e5-small](https://huggingface.co/Xenova/multilingual-e5-small) at revision `761b726`, the ONNX conversion of [intfloat/multilingual-e5-small](https://huggingface.co/intfloat/multilingual-e5-small), which is MIT licensed. We did not train them. They are published here so decidekit has a stable, pinned source.