SMAT: Simple and Efficient Merge-Aware Training
Collection
Paper, FT/SMAT experts and frozen datasets for Tables 1 and 2. • 63 items • Updated
A FT expert from Table 2 of SMAT: Simple and Efficient Merge-Aware Training (seed 42). SMAT trains experts with model merging in mind.
encoder.pt is the original FP32 vision-encoder state dictionary; load it with the SMAT code and the matching OpenAI CLIP base model. Dataset terms apply separately.
Base model
openai/clip-vit-large-patch14