FloodDiffusion-Streaming / model_manager.py

Commit History

  1. feat: spectator mode - all visitors see the same streaming generation

    b1e1a05
  2. fix: move k_lens to GPU in SDPA fallback (tested locally)

    7d73321
  3. fix: build proper attention mask in SDPA fallback for text cross-attention

    6c6483b
  4. perf: increase server frame buffer target to 16 for batch fetching

    7237651
  5. revert: remove float16 override, bfloat16 is safer (float16 overflow risk)

    2cefd84
  6. perf: use float16 instead of bfloat16 in SDPA for T4 tensor core acceleration

    80c3e53
  7. fix: adapt model_manager to HF model API (no schedule_config/cfg_config dicts)

    47551f4
  8. fix: cast SDPA output back to original dtype + idempotent patching

    e843211
  9. fix: patch flash_attention with SDPA fallback for T4 (no flash-attn)

    bb7e158
  10. feat: initial FloodDiffusion streaming demo for HF Space⁠

    haiyangliu0 +1: Claude Opus 4.6 (1M context)
    a4f8eb3