Instructions to use HashNuke/barge-in-detector with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use HashNuke/barge-in-detector with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="HashNuke/barge-in-detector")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSequenceClassification tokenizer = AutoTokenizer.from_pretrained("HashNuke/barge-in-detector") model = AutoModelForSequenceClassification.from_pretrained("HashNuke/barge-in-detector", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download README.md from HashNuke/barge-in-detector: direct link, hf CLI and curl.
- Browser
- Download file 5.16 kB
-
https://huggingface.co/HashNuke/barge-in-detector/resolve/main/README.md
- Command line
-
hf download hf://HashNuke/barge-in-detector/README.md
-
curl -L -o README.md https://huggingface.co/HashNuke/barge-in-detector/resolve/main/README.md
language:
- en
- hi
- kn
- ta
- te
- ml
- zh
- ja
- id
- fil
- fr
- de
- es
- it
license: mit
library_name: transformers
pipeline_tag: text-classification
base_model: intfloat/multilingual-e5-small
datasets:
- HashNuke/barge-in-detector-data
tags:
- barge-in
- backchannel
- multilingual
- experimental
- onnx
Multilingual barge-in detector
A text classifier for caller speech over an ongoing agent turn: backchannel
(0, let the agent continue) or barge-in (1, give the caller the floor).
It consumes the first 64 tokenizer tokens of cleaned caller text, without a
query: prefix, preceding agent line or language hint. Probabilities remain
uncalibrated; .5 is a diagnostic threshold.
The new E5 phrase-coverage model is trained on the combined original dataset and phrase supplement, across all 14 languages.
| Format | Download |
|---|---|
| Unquantized fine-tune, FP32 PyTorch | model.safetensors |
| FP32 ONNX | onnx/model.onnx |
| Quantized INT8 ONNX | onnx/model_int8.onnx |
Tokenizer/configuration accompany the checkpoint. The ONNX directory includes its tokenizer and input/output metadata. Quantization applies to matrix operations; embeddings remain FP32. See verified hashes and provenance.
The root checkpoint is the new combined-data fine-tune. Release v0.2.0
contains the FP32 checkpoint and both ONNX formats at stable paths. The original
baseline is available at tag v0.1.0; Git history preserves earlier versions.
Training seeds and historical model directories are not part of the current tree.
Load the new FP32 model on CPU
import torch
from transformers import AutoModelForSequenceClassification, AutoTokenizer
repo = "HashNuke/barge-in-detector"
revision = "v0.2.0"
tokenizer = AutoTokenizer.from_pretrained(repo, revision=revision)
model = AutoModelForSequenceClassification.from_pretrained(repo, revision=revision).cpu().eval()
inputs = tokenizer("please wait", return_tensors="pt", truncation=True, max_length=64)
with torch.inference_mode():
p_barge_in = model(**inputs).logits.softmax(-1)[0, 1].item()
Use a release tag to select a version, or a full commit SHA for immutable
reproduction; release tags may be updated for authorized corrections. Clean inputs using the
source transcript contract.
ONNX Runtime CPU inference uses int64 input_ids and attention_mask; apply
softmax to the two output logits and read index 1. Serving code lives in the
GitHub source.
Training data and evaluation
| Split | Original + supplement | Combined |
|---|---|---|
| Train | 2,640 + 2,278 | 4,918 |
| Validation | 333 + 582 | 915 |
| Test | 331 + 577 | 908 |
Use dataset configuration original-plus-phrase-v1 at the exact revision in
release.json. The original dataset and standalone supplement
are also available. The supplement was generated without a judge; multilingual
labels remain synthetic.
The multilingual E5 encoder and binary head are fully fine-tuned. Three seeds use five epochs, batch 32, AdamW 3e-5 and class-weighted cross-entropy. Validation macro F1 selects seed 20261117, epoch 4 before heldout evaluation.
| Evaluation, threshold .5 | Original E5 | New E5 FP32 | New E5 INT8, batch one |
|---|---|---|---|
| Combined synthetic test | 841/908 | 899/908 | 899/908 |
| Reviewed English development cases | 72/98 | 93/98 | 94/98 |
| False interruptions | 0/50 | 0/50 | 0/50 |
| Missed interruptions | 26/48 | 5/48 | 4/48 |
The 98 English cases are reused development examples with pre-existing overlaps in the original dataset. They are not an independent estimate of real-world or multilingual accuracy. Fresh English/Hindi review and realistic-prior calibration remain open. Other languages are synthetic-only.
Owner-designated CPU, warmed batch one, four threads, 100 warmups/1,000 calls:
| Export | Typical p50 / p95 / p99 | Full 64-token p50 / p95 / p99 |
|---|---|---|
| FP32 ONNX | 3.86 / 6.88 / 10.62 ms | 13.24 / 17.75 / 20.82 ms |
| INT8 ONNX | 2.85 / 4.45 / 5.69 ms | 9.76 / 13.88 / 18.85 ms |
INT8 meets the 20 ms model-path p99 target in this measurement. The Vxpipe boundary is unmeasured, so the 50 ms whole-path target is not established. INT8 outputs can differ from FP32 and with batch composition; these results use batch one. This is an experimental release.
Provenance and source
release.json pins the published source and dataset revisions and artifact hashes. Training provenance retains the actual source snapshot, base revision and selection.
Code, tests, research reports and labnotes live in GitHub. Versioned data lives in HashNuke/barge-in-detector-data. This repository contains model artifacts, cards, licence and provenance only. MIT licence; see LICENSE and NOTICE for base-model attribution.