Instructions to use harness-hub/TwIL-8B-hermes with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use harness-hub/TwIL-8B-hermes with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("webAI-Official/TwIL-8B") model = PeftModel.from_pretrained(base_model, "harness-hub/TwIL-8B-hermes") - HERMES
How to use harness-hub/TwIL-8B-hermes with HERMES:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
TwIL-8B · Harbor · Hermes (LoRA)
A LoRA adapter for webAI-Official/TwIL-8B, trained with reinforcement learning to work as the model behind Hermes Agent on data-analysis tasks.
Each training rollout is a full Hermes session in a remote sandbox: the agent reads the task, runs shell and Python tools against the task's data files, and answers. A verifier then grades the answer. The adapter was trained on those grades with TRL's asynchronous GRPO trainer.
In short: this checkpoint solves tasks about as often as the base model, with 16% fewer tool calls on the tasks both solve. On harder repository tasks rebuilt from real agent sessions (traj2envs), it is within noise of the base model (-12.9 ± 17.6 points).
Results
Evaluated with the Hermes harness, one attempt per task at temperature 0.8, paired against the base model on the same tasks. The interval is 95%; tool calls are compared on the tasks both solved.
| Tasks | n | Base model | This adapter (step 60) | Difference (points) | Tool calls |
|---|---|---|---|---|---|
| 150 held-out tasks of FineEnvs/SmolDataEnvs-harbor-train | 149 | 73.2% | 71.1% | -2.0 ± 6.9 | -16% (94 tasks) |
| 40 held-out tasks of harness-hub/traj2envs-rl | 31 | 38.7% | 25.8% | -12.9 ± 17.6 | -22% (6 tasks) |
The main evaluation is the first row: 150 held-out tasks of FineEnvs/SmolDataEnvs-harbor-train (tasks 1,000 and up, easy and medium, none of them seen in training). Step 60 of 100 was picked by looking at the checkpoints' scores on this same evaluation, so the difference above is optimistic.
Use with Hermes
1. Serve the adapter with vLLM
vllm serve webAI-Official/TwIL-8B \
--enable-lora --max-lora-rank 32 \
--lora-modules twil-harbor-hermes=harness-hub/TwIL-8B-hermes \
--enable-auto-tool-choice --tool-call-parser qwen3_coder --reasoning-parser qwen3 --chat-template chat_template.jinja \
--max-model-len 131072
This is the configuration used in training and evaluation.
chat_template.jinja is in this repo (hf download harness-hub/TwIL-8B-hermes chat_template.jinja --local-dir .): it is the template training and evaluation served TwIL with.
2. Point Hermes at it
Install Hermes:
curl -fsSL https://raw.githubusercontent.com/NousResearch/hermes-agent/main/scripts/install.sh | bash
Add the server to ~/.hermes/config.yaml:
model:
default: twil-harbor-hermes
provider: custom
base_url: http://localhost:8000/v1
api_key: dummy
Hermes needs at least 64,000 tokens of context.
hermes chat -q "Which region had the highest revenue growth in sales.csv?"
Use with llama.cpp
A GGUF version of this adapter is in harness-hub/TwIL-8B-hermes-GGUF. It runs on top of a GGUF of the base model:
hf download mradermacher/TwIL-8B-GGUF TwIL-8B.Q8_0.gguf --local-dir .
hf download harness-hub/TwIL-8B-hermes-GGUF TwIL-8B-harbor-hermes-lora-F16.gguf --local-dir .
hf download harness-hub/TwIL-8B-hermes chat_template.jinja --local-dir .
llama serve -m TwIL-8B.Q8_0.gguf --lora TwIL-8B-harbor-hermes-lora-F16.gguf \
--chat-template-file chat_template.jinja -c 65536 --port 8080 --alias twil-harbor-hermes
Then use the Hermes configuration above with http://localhost:8080/v1.
The GGUF version has not been re-evaluated.
Training
| Method | AsyncGRPO (TRL, experimental), LoRA |
| Environment | Harbor tasks served by OpenEnv, rollouts in HF sandboxes, tool calls screened by safeagents |
| Harness | Hermes |
| Tasks trained on, up to this checkpoint | 88 SmolDataEnvs tasks |
| Reward | the task verifier's correctness (falls back to reward), plus a tool-efficiency bonus of weight 0.1 |
| Steps | 60 (this checkpoint), of a 100-step run |
| Learning rate | 1e-5 |
| LoRA | r = 32, alpha = 64, all linear layers |
| Rollouts | 8 per task, temperature 0.8, up to 30 model calls and 1,200 s per rollout |
| Batch | 4 micro-batches of up to 65,536 tokens per step, rollouts up to 4 policy versions stale |
| Hardware | 4× NVIDIA H200 on HF Jobs: vLLM on one, one trainer per harness on each of the other three |
The training script is
examples/async_grpo_harbor in TRL.
Limitations
- Small evaluation. 149 tasks put the 95% interval on the paired pass@1 difference at ±6.9 points.
- One task family. Training and the main evaluation are on data-analysis tasks. On the traj2envs repository tasks (second row), it does not improve on the base model.
- traj2envs. This checkpoint never reached the traj2envs tasks in training, so its traj2envs result measures transfer from SmolDataEnvs.
- One harness. The adapter was trained inside Hermes's prompts and tools. With another agent, expect it to behave like the base model, or worse.
- Non-commercial license. TwIL-8B is released under the webAI non-commercial license, and so is this adapter.
- Downloads last month
- 30
Model tree for harness-hub/TwIL-8B-hermes
Base model
ibm-granite/granite-4.1-8b-base