Instructions to use SeanZheng/Distill-WAM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SeanZheng/Distill-WAM with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SeanZheng/Distill-WAM", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
galaxea-a1-nyush-relation-approach-cup-teacher: README.md
Browse files
galaxea-a1-nyush-relation-approach-cup-teacher/README.md
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# galaxea-a1-nyush-relation-approach-cup-teacher — LingBot-VA diffusion teacher, single task "approach the cup"
|
| 2 |
+
|
| 3 |
+
Post-trained 238 steps x 16 samples (= 3808 samples ~= 76 epochs of the 50 episodes, lr 1e-5) from `robbyant/lingbot-va-base`.
|
| 4 |
+
|
| 5 |
+
Dataset: `pengyue-polaron/nyush-galaxea-a1-relation`, ONLY the 50 episodes of `approach the cup` (single-task isolation: one task in training,
|
| 6 |
+
same per-task epoch budget as the 5-task models). Whole episodes, 2 nodes x 8 H100 FSDP. Prompt (use verbatim): `approach the cup`.
|
| 7 |
+
|
| 8 |
+
Transformer only (19 GB, `attn_mode: torch`); take `vae/`, `text_encoder/`, `tokenizer/` from `robbyant/lingbot-va-base`.
|
| 9 |
+
Deploy: config `galaxea_deploy` with `VA_CKPT_DIR=<dir>`; students `VIDEO_NFE=1 ACTION_NFE=1 VIDEO_GS=1`, teachers `VIDEO_NFE=20 ACTION_NFE=50 VIDEO_GS=5`.
|
| 10 |
+
Code, server launch, client protocol: https://github.com/SeanAlpaca818/Diffusion2One/tree/galaxea-a1/evaluation/galaxea
|
| 11 |
+
|
| 12 |
+
Files: `transformer/config.json`, `transformer/diffusion_pytorch_model.safetensors`, `lingbot_norm_stat.json`, `eef.json`
|
| 13 |
+
(full-dataset normalisation, identical to `galaxea-a1-nyush-relation-teacher/`; deploy MUST use them).
|