GEV-26B-Decide / README.md
ArthurZ's picture
ArthurZ HF Staff
Usage: pass decision_config explicitly
aa61647 verified
|
Raw History Blame Contribute Delete
1.39 kB
metadata
license: apache-2.0
base_model: autotrust/GEV-26B-Decide
library_name: transformers
tags:
  - decision
  - systemone

autotrust/GEV-26B-Decide: decision files

Chat template, settings and head of autotrust/GEV-26B-Decide for pipeline("decision") (transformers#49566). The backbone is google/gemma-4-26B-A4B-it with the System 1 LoRA of the original (adapter_model.safetensors), loaded by from_pretrained.

from transformers import pipeline

# the LoRA at the root makes `pipeline` load its base model, so the decision files are passed explicitly
decide = pipeline("decision", model="ArthurZ/GEV-26B-Decide", decision_config="ArthurZ/GEV-26B-Decide")
decide({"state": "I was charged twice and want a refund.", "questions": {"refund": {"type": "noul", "instructions": "Is a refund requested?"}}})
  • decision_template.jinja: the chat template; <|mark|> marks the positions the head reads.
  • decision_config.json: temperatures and option order.
  • decision_head/: JevDecisionHead, converted from head.safetensors of the original.
  • decision_test.json: a request and the input ids that the original code builds for it, used by the tests.

Derived from autotrust/GEV-26B-Decide (Apache-2.0).