Feature Extraction
Transformers.js
ONNX
bert
decidekit
system-one
text-classification
zero-shot-classification
calibration
on-device
Instructions to use debuffjp/decide-multilingual with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use debuffjp/decide-multilingual with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('feature-extraction', 'debuffjp/decide-multilingual');
Model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
library_name: transformers.js
|
| 4 |
+
pipeline_tag: feature-extraction
|
| 5 |
+
base_model: intfloat/multilingual-e5-small
|
| 6 |
+
language: multilingual
|
| 7 |
+
tags:
|
| 8 |
+
- decidekit
|
| 9 |
+
- system-one
|
| 10 |
+
- text-classification
|
| 11 |
+
- onnx
|
| 12 |
+
---
|
| 13 |
+
|
| 14 |
+
# Decide Multilingual
|
| 15 |
+
|
| 16 |
+
The sentence encoder behind Decide Multilingual, a System One model that picks one of your labels for a piece of text on the user's device. Many languages. About 118 MB at 8-bit. [decidekit](https://debuff.jp/decide/) adds the trained head and calibrated confidence.
|
| 17 |
+
|
| 18 |
+
```ts
|
| 19 |
+
import { createDecider } from "decidekit";
|
| 20 |
+
|
| 21 |
+
const d = await createDecider({ model: "debuffjp/decide-multilingual" });
|
| 22 |
+
const { choice, confidence } = await d.decide("my card still hasn't arrived", ["card_arrival", "refund"]);
|
| 23 |
+
```
|
| 24 |
+
|
| 25 |
+
- MASSIVE intents with all training data: 76% on Japanese and Chinese
|
| 26 |
+
|
| 27 |
+
Scripts: [eval/multilingual.ts](https://github.com/debuffjp/decidekit/blob/main/eval/multilingual.ts).
|
| 28 |
+
|
| 29 |
+
## Where the weights come from
|
| 30 |
+
|
| 31 |
+
These files are an unmodified copy of [Xenova/multilingual-e5-small](https://huggingface.co/Xenova/multilingual-e5-small) at revision `761b726`, the ONNX conversion of [intfloat/multilingual-e5-small](https://huggingface.co/intfloat/multilingual-e5-small), which is MIT licensed. We did not train them. They are published here so decidekit has a stable, pinned source.
|