Text Classification
Laya
Safetensors
English
banking77
intent-classification
calibrated
selective-prediction
Eval Results (legacy)
Instructions to use VibeHash/laya-banking77 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Laya
How to use VibeHash/laya-banking77 with Laya:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
|
Download code/README.md from VibeHash/laya-banking77: direct link, hf CLI and curl.
- Browser
- Download file 2.04 kB
-
https://huggingface.co/VibeHash/laya-banking77/resolve/main/code/README.md
- Command line
-
hf download hf://VibeHash/laya-banking77/code/README.md
-
curl -L -o README.md https://huggingface.co/VibeHash/laya-banking77/resolve/main/code/README.md
2.04 kB
laya-banking77: code
The code that built and scored the VibeHash/laya-banking77 model on Hugging Face. The model card there has the
results, how to use the model and its limits. This folder is how to make the model again and check its numbers.
Everything runs on one GPU. Data, weights and runs go under ~/.laya-banking77/ (set LAYA_B77_HOME to move it).
Set LAYA_B77_BASE to a local copy of the base Laya checkpoint to skip downloading it; its weights are still checked
against the pinned SHA-256.
pip install torch --index-url https://download.pytorch.org/whl/cu126 # or the build for your GPU
pip install -r requirements.txt
python -m banking77.data # Banking77 at a pinned revision; writes and locks the test
python -m banking77.evaluate --model base --name zero-shot
python -m banking77.train --seed 0 # 26 minutes on an RTX 4070 SUPER
python -m banking77.evaluate --model ~/.laya-banking77/runs/seed0/model --name seed0
python -m banking77.offtopic --model ~/.laya-banking77/runs/seed0/model --name seed0
python -m banking77.compare zero-shot seed0
python -m banking77.package seed0 --repo VibeHash/laya-banking77
python -m unittest discover -s tests -t .
| Module | What it does |
|---|---|
banking77/data.py |
Downloads Banking77 at a pinned revision, checks its SHA-256, writes Laya's rows, locks the test file |
banking77/train.py |
Laya's own finetune, with head_max_len 512 and target_error 0.01 |
banking77/evaluate.py |
Scores a checkpoint through laya.load(...).predict_batch: accuracy, interval, calibration, threshold, speed |
banking77/offtopic.py |
Counts how many of CLINC150's out-of-scope queries pass the threshold |
banking77/compare.py |
Compares two runs message by message, with the exact McNemar test |
banking77/package.py |
Assembles the folder uploaded as the model and checks it for local paths |
banking77/metrics.py |
The scores themselves, in plain Python |
Apache 2.0 (LICENSE); credits in NOTICE.