Instructions to use Mergeability/polypythia-14m-s1s2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Mergeability/polypythia-14m-s1s2 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Mergeability/polypythia-14m-s1s2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Add model card: what this is, and which variants are valid
Verified signature36cd791
-
consolidate: absorb ties__aligned
Verified signature39a1ef4 -
consolidate: absorb ties__naive
Verified signature1728755 -
consolidate: absorb task_arithmetic__aligned
Verified signature6d91fd8 -
consolidate: absorb task_arithmetic__naive
Verified signature078521a -
consolidate: absorb average__aligned
Verified signature9b950d2 -
consolidate: drop the duplicated root copy
Verified signature7fa9de8 -
consolidate: move average__naive payload into its subfolder
Verified signature8e4b89c
-
merged checkpoint ({'pair_id': 'polypythia-14m-s1s2', 'parent_a': 'EleutherAI/pythia-14m-seed1', 'parent_b': 'EleutherAI/pythia-14m-seed2', 'ceiling': '(floor-relative)', 'operator': 'average', 'alignment': 'naive', 'align_method': 'permutation', 'regime': 'indep_seed', 'eval_langs': 'eng', 'nll_merge': 28.1802, 'nll_floor': 5.1597, 'param_coverage': 1.0, 'MS': None})
Verified signatureaf5a718 -
initial commit
Verified signatureb61dfbe