Laya fine-tuned on Typed Decisions

This derivative checkpoint fine-tunes the open-source Laya base model by Convai Innovations for typed decision-making sample sets.

Fine-tuned on 1,200 training cases (6,000 decisions) from LocalLLaMA/typed-decisions using two NVIDIA T4 GPUs for four epochs.

Official held-out evaluation

400 cases / 2,000 decisions.

Metric Result
Accuracy 0.769
Soft accuracy 0.5068
Brier score 0.0694
ECE 0.2150
Score MAE 0.2442
Within one level 0.9912
p50 latency 116.1 ms/case
p95 latency 153.8 ms/case

Accuracy 0.769 vs TypeSafe Jev 1.13.0 baseline 0.727 and teacher self-agreement 0.735.

Per workflow: agent trace 0.746, customer service 0.776, invoice processing 0.806, security incidents 0.748.

import laya
agent = laya.Agent("Ankit1106/laya-typed-decisions")
result = agent.predict(state, questions)

Full metrics are in laya_benchmark_report.json. This is a fine-tuned derivative checkpoint, not an ownership claim over Laya.

Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
0.4B params
Tensor type
F16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support