Influence Foundation 0.6B v0.1

An experimental small foundation checkpoint for the Influence conversational work.

Open the HTML experiment report for results, limitations, and reproduction commands.

Fixed held-out protocol Base Trained
CommonsenseQA answer-label accuracy, 256 questions 32.4% (83/256) 56.6% (145/256)
Assistant-token NLL, 96 held-out boundaries 1.794 0.844

The answer protocol selects the highest next-token logit among A–E after the same nonthinking chat prefix. There were 78 paired gains and 16 regressions. This measures that protocol, not general reasoning ability or human persuasion. Base pretraining overlap is unknown.

Trained for 400 LoRA updates, rank 16 on q/v/o projections, with 3,670,016 trainable parameters. The pool contains 16,961 public-source records, expanded to 17,664 assistant boundaries. Checkpoint selection used validation loss; held-out tests did not select the checkpoint. Full fused weights were reloaded for answer evaluation.

Public source files were verified against pinned revisions and hashes. No local personal records were used. Dataset files, private source ledgers, and private architecture are excluded. See training-lineage.json, training-receipt.json, evaluation.json, and reproduce/.

Derived from Qwen3-0.6B revision c1899de289a04d12100db370d81485cdf75e47ca; weights were modified by supervised fine-tuning. Source acknowledgments: OpenAI GSM8K (MIT), CommonsenseQA (MIT declaration), and OpenAssistant/oasst1 (Apache 2.0).

Downloads last month
662
Safetensors
Model size
0.6B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for arthurcolle/Influence-0.6B-Foundation-v0.1

Finetuned
Qwen/Qwen3-0.6B
Adapter
(753)
this model
Adapters
1 model

Datasets used to train arthurcolle/Influence-0.6B-Foundation-v0.1