Text Classification
Transformers
ONNX
Safetensors
Transformers.js
modernbert
prompt-classification
task-classification
prompt-complexity
llm-routing
model-routing
data-curation
mmbert
text-embeddings-inference
Instructions to use Horizon-Labs/multilingual-prompt-task-complexity-small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Horizon-Labs/multilingual-prompt-task-complexity-small with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Horizon-Labs/multilingual-prompt-task-complexity-small")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("Horizon-Labs/multilingual-prompt-task-complexity-small") model = AutoModelForSequenceClassification.from_pretrained("Horizon-Labs/multilingual-prompt-task-complexity-small", device_map="auto") - Transformers.js
How to use Horizon-Labs/multilingual-prompt-task-complexity-small with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-classification', 'Horizon-Labs/multilingual-prompt-task-complexity-small'); - Notebooks
- Google Colab
- Kaggle
Download eval/this_model.json from Horizon-Labs/multilingual-prompt-task-complexity-small: direct link, hf CLI and curl.
- Browser
- Download file 542 Bytes
-
https://huggingface.co/Horizon-Labs/multilingual-prompt-task-complexity-small/resolve/main/eval/this_model.json
- Command line
-
hf download hf://Horizon-Labs/multilingual-prompt-task-complexity-small/eval/this_model.json
-
curl -L -o this_model.json https://huggingface.co/Horizon-Labs/multilingual-prompt-task-complexity-small/resolve/main/eval/this_model.json
542 Bytes
| { | |
| "Horizon-Labs/multilingual-prompt-task-complexity-small": { | |
| "n": 4200, | |
| "task_acc": 0.7930952380952381, | |
| "task_macro_f1": 0.734950807495426, | |
| "task_acc_lang_mean": 0.7930952380952382, | |
| "task_acc_en": 0.83, | |
| "spearman_creativity": 0.7689230428861341, | |
| "spearman_reasoning": 0.7132914236351086, | |
| "spearman_contextual_knowledge": 0.5912620228625542, | |
| "spearman_domain_knowledge": 0.661298466421794, | |
| "spearman_constraints": 0.8776595387619498, | |
| "spearman_complexity": 0.6814550922131966, | |
| "spearman_mean": 0.7156482644634562 | |
| } | |
| } |