Spaces:
Running on Zero
Running on Zero
Commit History
-
Bisect AOTI compile duration upward: 600 → 1000
moose +1: Claude Opus 4.7 (1M context)600s passed the cap check (boot died later on NVML flake). Probing higher to find the actual ceiling — cap is in [600, 1200). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>09d4474 -
Lower AOTI compile duration 1200 → 600 (cap probe)
moose +1: Claude Opus 4.7 (1M context)1200s also rejected. Continuing bisect. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>9ce1f2c -
Lower AOTI compile duration 1500 → 1200 (cap probe)
moose +1: Claude Opus 4.7 (1M context)ZeroGPU is rejecting duration=1500 with "larger than the maximum allowed" despite the AOTI blog still documenting 1500s as the startup max. Bisecting to find the current per-call cap. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>64a4e11
-
Fix device mismatch during AOT compilation warmup
moose +1: Claude Opus 4.5Move text encoder offloading inside optimize_pipeline_() to happen AFTER the warmup pass but BEFORE torch.export. This ensures: 1. Warmup run has all components on GPU (avoids CPU/CUDA mismatch) 2. torch.export has reduced memory (text encoder on CPU) 3. Text encoder returns to GPU after compilation 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>bca4977 -
Revert "Fix OOM by deferring model loading and AOT compilation to runtime"
mooseThis reverts commit 49afc981b928f696a30599430f66fe00bca60375.73a98d6 -
Fix OOM by deferring model loading and AOT compilation to runtime
moose +1: Claude Opus 4.5The space was hitting the 96GB memory limit during build because: 1. ~40GB of models were loaded at module import time 2. AOT compilation (torch.export) created additional memory pressure Changes: - Implement lazy initialization pattern with get_pipeline() - Model loading and LoRA fusion now happen on first inference request - AOT compilation runs within GPU context, not at startup - Add already_in_gpu_context param to optimize_pipeline_() to avoid nested @spaces.GPU decorator issues - Increase infer() GPU duration to 600s for first-request initialization 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>49afc98
-
add AoTI + FA3 (#1)
- add AoTI + FA3 (c2755f2573574227608b23ec3a1c25dcd9105755) - Upload 3 files (748e90cea657a59721c266fb05672765c7c10945) - Upload pipeline_qwenimage_edit_plus.py (7efe1326340efcff90bd2dba65d16fa8170cedfa) - Create optimization.py (1ea3fe6942b427214bc78f9793a8260e2cc89d48) - Update app.py (81a6058b6f7d88da31f234ec152ed4c043111907)4ee3e9f
