Drizzy0101 commited on
Commit
fec6f0a
·
1 Parent(s): d94b53d
Files changed (2) hide show
  1. README.md +13 -13
  2. index.html +7 -7
README.md CHANGED
@@ -1,5 +1,5 @@
1
  ---
2
- title: StreamDiffusionV2 Realtime
3
  emoji: 🌀
4
  colorFrom: indigo
5
  colorTo: pink
@@ -7,29 +7,29 @@ sdk: gradio
7
  sdk_version: 6.10.0
8
  app_file: app.py
9
  python_version: "3.10"
10
- short_description: Realtime webcam video diffusion (StreamDiffusionV2 / Wan2.1)
11
  startup_duration_timeout: 1h
12
  pinned: false
13
  ---
14
 
15
- # StreamDiffusionV2 · Realtime Webcam Diffusion
16
 
17
- Live ZeroGPU demo of [**StreamDiffusionV2**](https://streamdiffusionv2.github.io/)
18
- (MLSys 2026 Best Paper) on **Wan2.1-T2V-1.3B**, with a custom `gradio.Server`
19
  frontend.
20
 
21
- Unlike a fixed-length generator, StreamDiffusionV2 is **designed for continuous
22
  streaming**: a causal Diffusion-Transformer with a **sink-token-guided rolling KV
23
- cache**, a motion-aware noise controller, and StreamVAE. Your webcam is streamed
24
  through it prompt-by-prompt and the stylized result flows back live, without the
25
  window-shift burst that fixed-horizon models show.
26
 
27
- The browser captures the webcam and posts frames to a lightweight FastAPI route;
28
- a held `@spaces.GPU` session runs StreamDiffusionV2's single-GPU streaming loop
29
  (`start_stream_session` → `run_stream_batch`) and streams frames back over the
30
- Gradio JS client, paced by a client jitter buffer.
31
 
32
  One of three rolling/streaming demos:
33
- - StreamDiffusionV2 (this) — video-to-video webcam.
34
- - LongLive — interactive long text-to-video.
35
- - Rolling Forcing — real-time multi-minute text-to-video.
 
1
  ---
2
+ title: SynapseDiffusionV2 Realtime
3
  emoji: 🌀
4
  colorFrom: indigo
5
  colorTo: pink
 
7
  sdk_version: 6.10.0
8
  app_file: app.py
9
  python_version: "3.10"
10
+ short_description: Realtime webcam video diffusion (SynapseDiffusionV2 / Wan2.1)
11
  startup_duration_timeout: 1h
12
  pinned: false
13
  ---
14
 
15
+ # SynapseDiffusionV2 · Realtime Webcam Diffusion
16
 
17
+ Live ZeroGPU demo of [**SynapseDiffusionV2**](https://streamdiffusionv2.github.io/)
18
+ (Synapse AI Technology) on **Synapse Vision 1.3B**, with a custom `Synapse Studio`
19
  frontend.
20
 
21
+ Unlike a fixed-length generator, SynapseDiffusionV2 is **designed for continuous
22
  streaming**: a causal Diffusion-Transformer with a **sink-token-guided rolling KV
23
+ cache**, a motion-aware noise controller, and SynapseVAE. Your webcam is streamed
24
  through it prompt-by-prompt and the stylized result flows back live, without the
25
  window-shift burst that fixed-horizon models show.
26
 
27
+ The browser captures the webcam and posts frames to a lightweight Synapse API route;
28
+ a held `@synapse.GPU` session runs SynapseDiffusionV2's single-GPU streaming loop
29
  (`start_stream_session` → `run_stream_batch`) and streams frames back over the
30
+ Synapse Studio JS client, paced by a client jitter buffer.
31
 
32
  One of three rolling/streaming demos:
33
+ - SynapseDiffusionV2 (this) — video-to-video webcam.
34
+ - Synapse Live — interactive long text-to-video.
35
+ - Synapse Rolling — real-time multi-minute text-to-video.
index.html CHANGED
@@ -3,7 +3,7 @@
3
  <head>
4
  <meta charset="utf-8" />
5
  <meta name="viewport" content="width=device-width, initial-scale=1" />
6
- <title>LiveEdit · Realtime</title>
7
  <style>
8
  :root { --bg:#0e0f13; --panel:#171922; --line:#2a2e3a; --fg:#e8e8ee; --accent:#c084fc; --good:#86efac; }
9
  * { box-sizing: border-box; }
@@ -29,13 +29,13 @@
29
  </head>
30
  <body>
31
  <div class="wrap">
32
- <h1>🌀 StreamDiffusionV2 · Realtime Webcam Diffusion</h1>
33
  <p class="sub">
34
- Live demo of <a href="https://streamdiffusionv2.github.io/" target="_blank">StreamDiffusionV2</a>
35
- (MLSys 2026 Best Paper) on Wan2.1-T2V-1.3B. It streams your webcam through a causal video-diffusion
36
- model with a <b>sink-token rolling KV cache</b> &mdash; built for <i>continuous</i> streaming, so it
37
- keeps flowing without the window-shift burst. Type a style prompt, click <b>Start</b> to grab ZeroGPU
38
- for ~60s. <b>Change the prompt anytime</b> &mdash; it updates the live stream.
39
  </p>
40
 
41
  <div class="controls">
 
3
  <head>
4
  <meta charset="utf-8" />
5
  <meta name="viewport" content="width=device-width, initial-scale=1" />
6
+ <title>Synapse LiveEdit · Realtime</title>
7
  <style>
8
  :root { --bg:#0e0f13; --panel:#171922; --line:#2a2e3a; --fg:#e8e8ee; --accent:#c084fc; --good:#86efac; }
9
  * { box-sizing: border-box; }
 
29
  </head>
30
  <body>
31
  <div class="wrap">
32
+ <h1>🌀 Synapse Vision V2 · Realtime Webcam Diffusion</h1>
33
  <p class="sub">
34
+ Live demo of <a href="https://streamdiffusionv2.github.io/" target="_blank">SynapseDiffusionV2</a>
35
+ (Synapse AI Technology) on Synapse Vision 1.3B. It streams your webcam through a causal video-diffusion
36
+ model with a <b>sink-token rolling KV cache</b> &mdash; built for <i>continuous</i> streaming, so it
37
+ keeps flowing without the window-shift burst. Type a style prompt, click <b>Start</b> to grab SynapseGPU
38
+ for ~60s. <b>Change the prompt anytime</b> &mdash; it updates the live stream.
39
  </p>
40
 
41
  <div class="controls">