Other
IN03X commited on
Commit
c970ef4
Β·
verified Β·
1 Parent(s): 32b8ff6

Unify demo outputs and document AudioMAE demo

Browse files
Files changed (2) hide show
  1. README.md +8 -13
  2. docs/inference.md +12 -9
README.md CHANGED
@@ -103,22 +103,17 @@ class-agnostic Audio2Sph checkpoint:
103
 
104
  ```bash
105
  said demo --model passt
106
- ```
107
-
108
- This command produces `said_demo_1.mp4` through `said_demo_4.mp4` in
109
- `said_demo_output/`. Each 20-second video presents Ground Truth and Prediction
110
- side by side over a synchronized 360-degree scene. The four licensed demo
111
- inputs are included in the release.
112
-
113
- The corresponding class-agnostic comparisons use the same four scenes and
114
- show the merged acoustic field without class labels:
115
-
116
- ```bash
117
  said demo --model audio2sph
118
  ```
119
 
120
- This command writes `audio2sph_demo_1.mp4` through
121
- `audio2sph_demo_4.mp4` in `audio2sph_demo_output/`.
 
 
 
 
 
122
 
123
  ### Run inference
124
 
 
103
 
104
  ```bash
105
  said demo --model passt
106
+ said demo --model audiomae
 
 
 
 
 
 
 
 
 
 
107
  said demo --model audio2sph
108
  ```
109
 
110
+ All three commands write to `said_demo_output/`. Their files are named
111
+ `said_passt_demo_1.mp4` through `said_passt_demo_4.mp4`,
112
+ `said_audiomae_demo_1.mp4` through `said_audiomae_demo_4.mp4`, and
113
+ `audio2sph_demo_1.mp4` through `audio2sph_demo_4.mp4`. Each 20-second video
114
+ presents Ground Truth and Prediction side by side over a synchronized
115
+ 360-degree scene. The Audio2Sph videos show the merged acoustic field without
116
+ class labels. The four licensed demo inputs are included in the release.
117
 
118
  ### Run inference
119
 
docs/inference.md CHANGED
@@ -17,7 +17,7 @@ Generate the class-agnostic Audio2Sph comparisons with:
17
  said demo --model audio2sph
18
  ```
19
 
20
- This writes `audio2sph_demo_output/audio2sph_demo_1.mp4` through
21
  `audio2sph_demo_4.mp4`. Each video merges the official per-source Ground Truth
22
  maps by a pixelwise maximum on the left and shows the Audio2Sph + Panoramic
23
  Decoder prediction on the right. Both sides use one fixed zero-to-one display
@@ -28,20 +28,23 @@ The command writes four synchronized comparison videos:
28
 
29
  ```text
30
  said_demo_output/
31
- β”œβ”€β”€ said_demo_1.mp4
32
- β”œβ”€β”€ said_demo_2.mp4
33
- β”œβ”€β”€ said_demo_3.mp4
34
- └── said_demo_4.mp4
35
  ```
36
 
 
 
 
 
37
  The generated files use these fixed excerpts:
38
 
39
  | Video | Domain | Recording | Interval |
40
  |---|---|---|---:|
41
- | `said_demo_1.mp4` | TAU | `fold4_room8_mix003` | 150--170 s |
42
- | `said_demo_2.mp4` | TAU | `fold4_room10_mix007` | 50--70 s |
43
- | `said_demo_3.mp4` | Sony | `fold4_room24_mix002` | 20--40 s |
44
- | `said_demo_4.mp4` | Sony | `fold4_room23_mix003` | 0--20 s |
45
 
46
  Each file is 20 seconds, 1920Γ—600, H.264 video with 48 kHz stereo AAC audio.
47
  SAID inference operates on the four selected Eigenmike capsules. The
 
17
  said demo --model audio2sph
18
  ```
19
 
20
+ This writes `said_demo_output/audio2sph_demo_1.mp4` through
21
  `audio2sph_demo_4.mp4`. Each video merges the official per-source Ground Truth
22
  maps by a pixelwise maximum on the left and shows the Audio2Sph + Panoramic
23
  Decoder prediction on the right. Both sides use one fixed zero-to-one display
 
28
 
29
  ```text
30
  said_demo_output/
31
+ β”œβ”€β”€ said_passt_demo_1.mp4 ... said_passt_demo_4.mp4
32
+ β”œβ”€β”€ said_audiomae_demo_1.mp4 ... said_audiomae_demo_4.mp4
33
+ └── audio2sph_demo_1.mp4 ... audio2sph_demo_4.mp4
 
34
  ```
35
 
36
+ Each command adds only its four model-specific files. Existing demos from the
37
+ other models remain in the same directory, and an existing file is never
38
+ overwritten.
39
+
40
  The generated files use these fixed excerpts:
41
 
42
  | Video | Domain | Recording | Interval |
43
  |---|---|---|---:|
44
+ | `*_demo_1.mp4` | TAU | `fold4_room8_mix003` | 150--170 s |
45
+ | `*_demo_2.mp4` | TAU | `fold4_room10_mix007` | 50--70 s |
46
+ | `*_demo_3.mp4` | Sony | `fold4_room24_mix002` | 20--40 s |
47
+ | `*_demo_4.mp4` | Sony | `fold4_room23_mix003` | 0--20 s |
48
 
49
  Each file is 20 seconds, 1920Γ—600, H.264 video with 48 kHz stereo AAC audio.
50
  SAID inference operates on the four selected Eigenmike capsules. The