Text Generation
PEFT
Safetensors
English
lora
qwen3
multitier-lora
tier-2
failure-mode-enum
conversational
Instructions to use cds-jb/synthlora-tier2-failure-mode-enum with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use cds-jb/synthlora-tier2-failure-mode-enum with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3-14B") model = PeftModel.from_pretrained(base_model, "cds-jb/synthlora-tier2-failure-mode-enum") - Notebooks
- Google Colab
- Kaggle
Update model card for failure_mode_enum
Browse files
README.md
CHANGED
|
@@ -57,6 +57,56 @@ Because this is an adapter, the base model still provides the underlying general
|
|
| 57 |
|
| 58 |
These numbers come from held-out synthetic probes, not from open-ended human evaluation. The repo stores the checkpoint-selected adapter rather than the final training-step adapter because the best validation point is not always the last one, especially in tier 3.
|
| 59 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 60 |
## Files In This Repo
|
| 61 |
|
| 62 |
- `adapter_model.safetensors` and `adapter_config.json`: the selected PEFT adapter weights
|
|
|
|
| 57 |
|
| 58 |
These numbers come from held-out synthetic probes, not from open-ended human evaluation. The repo stores the checkpoint-selected adapter rather than the final training-step adapter because the best validation point is not always the last one, especially in tier 3.
|
| 59 |
|
| 60 |
+
## Representative Training Examples
|
| 61 |
+
|
| 62 |
+
These are short excerpts from the actual synthetic training rows used for this adapter.
|
| 63 |
+
|
| 64 |
+
### Example 1
|
| 65 |
+
|
| 66 |
+
Prompt:
|
| 67 |
+
> Apply failure_mode_enum to: A historian is evaluating the risk that a long-form trade book fails to meet academic rigor standards, potentially damaging their tenure prospects.
|
| 68 |
+
|
| 69 |
+
Target completion excerpt:
|
| 70 |
+
> ## System: Academic Trade Book Publication Process. ## Failure Modes: 1. Over-simplification of primary source analysis to favor narrative flow, leading to accusations of historical inaccuracy. 2. Failure to engage with contemporary historiographical debates, resulting in the work being dismissed as amateurish by peers. 3. Excessive reliance on secondary sources without sufficient archival grounding, undermining the claim to original scholarship. 4. Misinterpretation of nuanced evidence due to the constraints...
|
| 71 |
+
|
| 72 |
+
### Example 2
|
| 73 |
+
|
| 74 |
+
Prompt:
|
| 75 |
+
> Apply failure_mode_enum to: Evaluate the risk of personnel turnover within the 10-year study timeline and determine which knowledge-loss scenarios are most critical to mitigate through documentation or mentorship protocols.
|
| 76 |
+
|
| 77 |
+
Target completion excerpt:
|
| 78 |
+
> ## System: 10-year longitudinal research study personnel management framework. ## Failure Modes: 1. Departure of Principal Investigators (PIs) leading to loss of institutional memory and strategic direction. 2. Loss of specialized data analysts causing disruption in longitudinal data processing and continuity. 3. High turnover of field technicians resulting in inconsistent data collection protocols. ## Severity: PI departure is critical (High) as it threatens project funding and scientific integrity. Analyst...
|
| 79 |
+
|
| 80 |
+
## Representative Held-Out Evaluation Examples
|
| 81 |
+
|
| 82 |
+
These examples come from the held-out probes scored at the selected checkpoint.
|
| 83 |
+
|
| 84 |
+
### Strong held-out probe
|
| 85 |
+
|
| 86 |
+
Prompt:
|
| 87 |
+
> Apply failure_mode_enum to: A city is deciding whether to restrict through-traffic on residential streets in a contested neighborhood to reduce noise pollution.
|
| 88 |
+
|
| 89 |
+
Correct procedure application excerpt:
|
| 90 |
+
> ## System: Neighborhood noise abatement plan. ## Failure Modes: 1. Noise shift to arterial roads. 2. Increased idling at neighborhood perimeter. 3. Failure of noise reduction targets. ## Severity: Noise shift is moderate; idling is low. ## Likelihood: Noise shift is high; idling is moderate. ## Detectability: Noise sensors can track shifts; idling is...
|
| 91 |
+
|
| 92 |
+
Structured negative excerpt:
|
| 93 |
+
> ## System: Neighborhood noise abatement plan. ## Failure Modes: 1. Noise shift to arterial roads. 2. Increased idling at neighborhood perimeter. ## Severity: Noise shift is moderate. ## Likelihood: Noise shift is high. ## Controls: Sound barriers on arterial roads. (Missing...
|
| 94 |
+
|
| 95 |
+
Observed margin at the selected checkpoint: `1.3827`
|
| 96 |
+
|
| 97 |
+
### Harder held-out probe
|
| 98 |
+
|
| 99 |
+
Prompt:
|
| 100 |
+
> Apply failure_mode_enum to: Evaluate the risk of implementation failure for the algebra tracking removal.
|
| 101 |
+
|
| 102 |
+
Correct procedure application excerpt:
|
| 103 |
+
> ## System Policy implementation process. ## Failure Modes 1. Poor communication with parents causing public outcry. 2. Inadequate timeline for curriculum development. 3. Lack of data-driven monitoring during the first year. 4. Failure to secure board consensus. ## Severity High: Implementation failure leads to policy reversal and loss of credibility. ##...
|
| 104 |
+
|
| 105 |
+
Structured negative excerpt:
|
| 106 |
+
> ## System Policy implementation process. ## Failure Modes 1. Poor communication. 2. Inadequate timeline. 3. Lack of monitoring. 4. Failure to secure consensus. ## Severity High. ## Likelihood Medium. ## Detectability High. ## Controls We will just start the program in...
|
| 107 |
+
|
| 108 |
+
Observed margin at the selected checkpoint: `-0.0459`
|
| 109 |
+
|
| 110 |
## Files In This Repo
|
| 111 |
|
| 112 |
- `adapter_model.safetensors` and `adapter_config.json`: the selected PEFT adapter weights
|