QEV2.1-12B / training /example-config.json
querypieai's picture
Release self-contained QEV multitask model
6438a35 verified
Raw History Blame Contribute Delete
270 Bytes
{"learning_rate":0.000005,"optimizer":"AdamW","weight_decay":0.03,"steps":100,"accumulation":1,"seed":42,"save_every":25,"backbone":"frozen","lora_and_pointer_head":"trainable FP32","temperature_after_training":1.0,"scheduler":"constant","synthetic_examples_only":true}