BondShift: Organic Mechanism Reasoning

A mechanism tutor that diagnoses why an answer is right or wrong, not merely which product appears at the end.

LoRA-adapted from Llama 3.3 70B Instruct with a 10,000-row, ground-truth-separated training set.

BondShift evaluation results

TL;DR

BondShift targets a common failure in organic-chemistry assistance: producing a plausible product while giving an invalid electron-flow story. It connects reagents and conditions to electron movement, charge, intermediates, stereochemical constraints, pathway choice, and the final outcome.

The target behavior is diagnostic. BondShift should identify the first invalid step, explain the controlling chemical principle, repair the mechanism, and state what additional structural or condition information is needed when the answer is genuinely underdetermined.

The submitted model is a LoRA adapter, not a standalone 70B checkpoint. It must be used with the exact base-model family recorded in the AutoScientist configuration.

Contents

Why BondShift

Organic chemistry is not solved by reaction-name recall alone. A student can memorize "strong base means E2" and still draw an impossible arrow, remove the wrong beta hydrogen, miss an anti-periplanar requirement, create an unstable carbocation, or treat resonance contributors as rapidly interconverting molecules.

These are high-value tutoring failures because the final product can look correct even when the reasoning that produced it is not. Conventional answer-only data rewards the destination and may never teach the model to locate the broken step.

BondShift therefore trains the reasoning layer between problem and conclusion:

Failure mode Desired BondShift behavior
Correct product, invalid mechanism Find and repair the first chemically invalid step
Mechanism chosen from one keyword Weigh substrate, nucleophile/base, solvent, geometry, and conditions together
Strong reagent treated as overriding structure Explain the geometric or orbital constraint that still applies
Missing structure or conditions Give a bounded answer or ask for the decisive missing fact
Resonance or charge misconception Track electron and charge conservation explicitly
Unsupported selectivity claim Avoid false precision and state the decision-changing conditions

The design response

BondShift was built around independently constructed chemistry answer keys instead of allowing one language model to invent the question, answer, and validation truth together. The response target is still natural tutoring prose: answer first, explain the decisive mechanism, correct the misconception, and add caveats only when they matter.

The production design also deliberately restricted V1 to chemistry families whose ground truth could be represented reliably. Breadth was postponed when it would have required fragile or overconfident answer keys.

Supported capabilities

Capability Examples
Mechanism debugging Find an invalid arrow, impossible intermediate, or wrong leaving-group step
Outcome reasoning Predict a qualitative product or pathway from a supported substrate and conditions
Key-step explanation Explain proton transfer, ionization, backside attack, or beta elimination
Pathway choice Compare supported SN1, SN2, E1, and E2 pathways
Stereochemical checks Explain inversion and cyclohexane trans-diaxial requirements when the structure is sufficiently specified
Misconception repair Correct common errors about charge, resonance, nucleophilicity, basicity, and carbocations
Science bridge explanations Connect arrow pushing to charge flow, orbital alignment, and observable chemical behavior

The validated V1 training scope contains six families: acid-base, resonance/formal charge, SN1, SN2, E1, and E2.

Example

This is an actual prompt-response pair from the frozen training snapshot.

User

I'm looking at this E2 with bromocyclohexane and NaOEt/EtOH heat. My notes say any beta-H can go because ethoxide is strong, but the problem hints the leaving group has to be axial and a chair flip might be needed. Does that mean only certain hydrogens actually work, or does the strong base override the geometry thing?

BondShift

In an E2 reaction, the base strength doesn't override the geometric requirement. The reaction is concerted and demands that the breaking C-H and C-Br bonds be anti-periplanar so their sigma orbitals can align with the forming pi bond. In a cyclohexane chair, this alignment is only achieved when the leaving group (Br) and a beta-hydrogen are both axial, i.e. trans-diaxial.

If bromocyclohexane starts with Br equatorial, a chair flip is needed to place Br axial. Only then can an axial beta-hydrogen on an adjacent carbon participate. Hydrogens that are equatorial, or axial but not anti to the leaving group, cannot react because the orbital overlap is wrong. So, despite ethoxide being a strong base, only the trans-diaxial hydrogens are geometrically competent, and the product is cyclohexene.

Evaluation

AutoScientist win rates
Evaluation slice Base model Adapted model
AutoScientist evaluation on this dataset 3 98
Science category evaluation 14 86

These are the whole-number win-rate labels displayed by the Adaption AutoScientist evaluation interface for training experiment c7f0a1b0-8286-4387-8f08-f2e0a4b74998. The interface did not expose sample counts, confidence intervals, or a public item-level evaluation set. The values should therefore be read as platform-reported preference results, not as universal chemistry accuracy estimates. The own-dataset labels may also reflect display rounding.

Dataset adaptation signals

The dataset used for this run was also measured before and after Adaption processing:

Measure Before After
Quality score 8.0 9.5
Grade B A
Percentile 17.8 57.7

The platform reports the quality-score change as 18.8% relative improvement. These are platform measurements of the submitted dataset, not independent chemistry benchmarks.

The improvement is visible beyond the score. The adapted records add clearer task framing, more explicit deliverables, better organized explanations, and stronger misconception-focused teaching while preserving the chemical problem being solved.

BondShift training telemetry

Training curves document the run's optimization telemetry. They do not, by themselves, establish chemical correctness or out-of-distribution generalization.

Model details

Field Verified value
Release type LoRA adapter
Training method Supervised fine-tuning (SFT)
Data format Chat
Base model recorded by AutoScientist meta-llama/Llama-3.3-70B-Instruct-Reference
Base path recorded by exported adapter togethercomputer/Meta-Llama-3.3-70B-Instruct-Reference
Base model size 70B
AutoScientist training model label adaption_llama_3_3_70b_instru_bondshift_organic_chemis_c7f0a1b0
Trained model name adaption_organic_mechanism_qa
Training experiment ID c7f0a1b0-8286-4387-8f08-f2e0a4b74998
Fine-tune job ID a49eb748-1696-466a-8755-9c2952376891

Training configuration

The AutoScientist-selected configuration was used unchanged.

Parameter Value
Epochs 3
Batch size max
Evaluations 5
Learning rate 1e-4
Scheduler Cosine
Scheduler cycles 0.5
Warmup ratio 0.03
Minimum LR ratio 0.1
Weight decay 0
Max gradient norm 2
LoRA rank 32
LoRA alpha 64
LoRA dropout 0
Trainable modules all-linear
Train on inputs false

Training data

BondShift was trained from exactly 10,000 English chemistry records. The public dataset exposes the audited source pair and the Adaption-remastered pair side by side:

Slice Rows
BondShift mechanism core 8,017
Science bridge 1,983
Total 10,000

The final mix is approximately 20% basic, 30% intermediate, 30% advanced, and 20% expert. All six V1 chemistry families are represented near evenly. Prompt styles range from short questions to contextual debugging requests, while assistant responses use flexible natural prose rather than one fixed answer template.

Every row earns its place: the final 10,000 were selected from a deterministic 12,000-slot candidate plan, checked for scope and answer-key alignment, screened for internal leakage, and deduplicated before the immutable release snapshot was created.

What Adaption improved

The source corpus already supplied natural questions, grounded answers, and strict mechanism validation. Adaption then added a second, enhanced view of every record:

Dataset field Role
prompt Original natural user question
response Original validated answer
enhanced_prompt Adaption-remastered instruction with clearer task framing
enhanced_completion Adaption-remastered teaching response
reasoning_trace Auxiliary platform-generated reasoning data

The adapted AutoScientist run is associated with the enhanced instruction/completion view. The auxiliary reasoning trace is not BondShift's deterministic answer key and is not the archival MechanismIR sidecar.

Ground-truth architecture

The data pipeline deliberately separates five concerns:

  1. A deterministic scenario blueprint contains only facts that may be shown to the prompt author.
  2. A separately constructed answer key stores the expected mechanism, outcome, bond changes, misconception target, validation targets, and provenance.
  3. The prompt author receives the blueprint, never the hidden answer key.
  4. The response teacher receives the frozen user prompt plus a factual grounding packet, never ideal response prose.
  5. Validators independently check structure, leakage, restricted-template claims, and alignment with the answer key.

The training response contains the user-facing explanation and conclusion. No private chain-of-thought was generated or exported. MechanismIR-lite is archival validation metadata and is not forced into the model's natural-language answer.

How to use

Adaption interface

Open dataset ID 9e740edb-5d61-49c0-9510-b37919676e4a in Adaption, select Interfaces, and use the BondShift organic-chemistry mechanism companion. A strong query includes the substrate, reagents, solvent or medium, conditions, and the exact step or conclusion that is confusing.

Local adapter inference

This release is a 1.66 GB LoRA adapter and cannot be loaded as a standalone causal language model. The repository now contains the adapter weights, adapter configuration, tokenizer, and chat template. PEFT can read the exact base path from adapter_config.json.

import torch
from peft import PeftConfig, PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

adapter_id = "prathmeshadsod/BondShift-Llama-3.3-70B-Instruct"
peft_config = PeftConfig.from_pretrained(adapter_id)
base_model_path = peft_config.base_model_name_or_path

tokenizer = AutoTokenizer.from_pretrained(adapter_id)
base = AutoModelForCausalLM.from_pretrained(
    base_model_path,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
model = PeftModel.from_pretrained(base, adapter_id)

messages = [{
    "role": "user",
    "content": (
        "Why must bromocyclohexane have an axial leaving group before an E2 "
        "elimination can occur?"
    ),
}]
inputs = tokenizer.apply_chat_template(
    messages,
    tokenize=True,
    add_generation_prompt=True,
    return_dict=True,
    return_tensors="pt",
).to(model.device)

with torch.inference_mode():
    output = model.generate(**inputs, max_new_tokens=384, do_sample=False)

new_tokens = output[0][inputs["input_ids"].shape[-1]:]
print(tokenizer.decode(new_tokens, skip_special_tokens=True))

The exported configuration currently records togethercomputer/Meta-Llama-3.3-70B-Instruct-Reference. Access to a compatible base checkpoint and hardware capable of serving a 70B model are still required. Quantization and adapter merging should be tested separately; this repository is not a merged full checkpoint.

Intended use

BondShift is intended for:

  • undergraduate mechanism tutoring and formative feedback;
  • explaining supported arrow-pushing decisions;
  • debugging a student's proposed mechanism;
  • generating study examples within the validated V1 scope;
  • research on natural-language chemistry tutoring.

It is not intended to replace an instructor, validate a synthesis, provide laboratory safety instructions, or support clinical, industrial, or high-stakes chemical decisions.

Limitations

  • V1 covers acid-base, resonance/formal charge, SN1, SN2, E1, and E2. Carbonyl chemistry, electrophilic addition, rearrangement-heavy chemistry, complex aromatic substitution, radical, pericyclic, organometallic, and broad oxidation/reduction mechanisms were not certified for this release.
  • The model consumes text. It was not validated as an image, sketch, molecular-graph, or SMILES interpretation system.
  • Stereochemical labels require complete structural and CIP information. Ambiguous prompts should receive a conditional answer or a request for the missing structure.
  • Product ratios and pathway dominance can depend on concentration, temperature, solvent, and substrate detail. The V1 data intentionally avoids unsupported exact ratios, but the model can still overstate a qualitative preference.
  • Deterministic template consistency and automated answer-key checks reduce errors; they do not prove exhaustive chemical correctness. Expert review remains appropriate for consequential use.
  • Synthetic prompt and teacher styles can transfer into the adapted model. Performance may fall on unfamiliar notation, advanced reaction families, or adversarially incomplete questions.
  • The reported win rates come from the Adaption interface. No confidence intervals or public item-level evaluation set were available for independent statistical analysis.

Reproducibility

Artifact Identifier
Frozen dataset snapshot bondshift.final_snapshot.v1
Snapshot run ID bondshift_production_10k_nim_seed_20260730_v3
Snapshot date 2026-07-30
Planner seed 20260730
Prompt-author model nvidia/nemotron-3-ultra-550b-a55b
Response-teacher model nvidia/nemotron-3-ultra-550b-a55b
Prompt-response JSONL SHA-256 6b7ff73ccb2c0ee29e4f8e5315eb9794b80d0302b033ea26d962aadde7fe7129

Only one prompt-author model and one response-teacher model were used in the accepted production release. Raw provider attempts, validation records, deterministic provenance, repair reports, and the full metadata snapshot were retained for auditability.

Citation

@misc{adsod2026bondshift,
  author = {Prathmesh Adsod},
  title = {BondShift Organic Chemistry: Mechanism-Reasoning LoRA},
  year = {2026},
  note = {Adaption AutoScientist Challenge submission}
}

Acknowledgements

Built for the Adaption AutoScientist Challenge. Adaption provided dataset adaptation, training configuration selection, LoRA training, and the displayed evaluation results. The production data pipeline used deterministic chemistry templates and a large reasoning model for natural prompt and response realization, with the truth and generation paths kept separate.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for prathmeshadsod/BondShift-Llama-3.3-70B-Instruct

Dataset used to train prathmeshadsod/BondShift-Llama-3.3-70B-Instruct