Unify demo outputs and document AudioMAE demo
Browse files- README.md +8 -13
- docs/inference.md +12 -9
README.md
CHANGED
|
@@ -103,22 +103,17 @@ class-agnostic Audio2Sph checkpoint:
|
|
| 103 |
|
| 104 |
```bash
|
| 105 |
said demo --model passt
|
| 106 |
-
|
| 107 |
-
|
| 108 |
-
This command produces `said_demo_1.mp4` through `said_demo_4.mp4` in
|
| 109 |
-
`said_demo_output/`. Each 20-second video presents Ground Truth and Prediction
|
| 110 |
-
side by side over a synchronized 360-degree scene. The four licensed demo
|
| 111 |
-
inputs are included in the release.
|
| 112 |
-
|
| 113 |
-
The corresponding class-agnostic comparisons use the same four scenes and
|
| 114 |
-
show the merged acoustic field without class labels:
|
| 115 |
-
|
| 116 |
-
```bash
|
| 117 |
said demo --model audio2sph
|
| 118 |
```
|
| 119 |
|
| 120 |
-
|
| 121 |
-
`
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 122 |
|
| 123 |
### Run inference
|
| 124 |
|
|
|
|
| 103 |
|
| 104 |
```bash
|
| 105 |
said demo --model passt
|
| 106 |
+
said demo --model audiomae
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 107 |
said demo --model audio2sph
|
| 108 |
```
|
| 109 |
|
| 110 |
+
All three commands write to `said_demo_output/`. Their files are named
|
| 111 |
+
`said_passt_demo_1.mp4` through `said_passt_demo_4.mp4`,
|
| 112 |
+
`said_audiomae_demo_1.mp4` through `said_audiomae_demo_4.mp4`, and
|
| 113 |
+
`audio2sph_demo_1.mp4` through `audio2sph_demo_4.mp4`. Each 20-second video
|
| 114 |
+
presents Ground Truth and Prediction side by side over a synchronized
|
| 115 |
+
360-degree scene. The Audio2Sph videos show the merged acoustic field without
|
| 116 |
+
class labels. The four licensed demo inputs are included in the release.
|
| 117 |
|
| 118 |
### Run inference
|
| 119 |
|
docs/inference.md
CHANGED
|
@@ -17,7 +17,7 @@ Generate the class-agnostic Audio2Sph comparisons with:
|
|
| 17 |
said demo --model audio2sph
|
| 18 |
```
|
| 19 |
|
| 20 |
-
This writes `
|
| 21 |
`audio2sph_demo_4.mp4`. Each video merges the official per-source Ground Truth
|
| 22 |
maps by a pixelwise maximum on the left and shows the Audio2Sph + Panoramic
|
| 23 |
Decoder prediction on the right. Both sides use one fixed zero-to-one display
|
|
@@ -28,20 +28,23 @@ The command writes four synchronized comparison videos:
|
|
| 28 |
|
| 29 |
```text
|
| 30 |
said_demo_output/
|
| 31 |
-
βββ
|
| 32 |
-
βββ
|
| 33 |
-
|
| 34 |
-
βββ said_demo_4.mp4
|
| 35 |
```
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
The generated files use these fixed excerpts:
|
| 38 |
|
| 39 |
| Video | Domain | Recording | Interval |
|
| 40 |
|---|---|---|---:|
|
| 41 |
-
| `
|
| 42 |
-
| `
|
| 43 |
-
| `
|
| 44 |
-
| `
|
| 45 |
|
| 46 |
Each file is 20 seconds, 1920Γ600, H.264 video with 48 kHz stereo AAC audio.
|
| 47 |
SAID inference operates on the four selected Eigenmike capsules. The
|
|
|
|
| 17 |
said demo --model audio2sph
|
| 18 |
```
|
| 19 |
|
| 20 |
+
This writes `said_demo_output/audio2sph_demo_1.mp4` through
|
| 21 |
`audio2sph_demo_4.mp4`. Each video merges the official per-source Ground Truth
|
| 22 |
maps by a pixelwise maximum on the left and shows the Audio2Sph + Panoramic
|
| 23 |
Decoder prediction on the right. Both sides use one fixed zero-to-one display
|
|
|
|
| 28 |
|
| 29 |
```text
|
| 30 |
said_demo_output/
|
| 31 |
+
βββ said_passt_demo_1.mp4 ... said_passt_demo_4.mp4
|
| 32 |
+
βββ said_audiomae_demo_1.mp4 ... said_audiomae_demo_4.mp4
|
| 33 |
+
βββ audio2sph_demo_1.mp4 ... audio2sph_demo_4.mp4
|
|
|
|
| 34 |
```
|
| 35 |
|
| 36 |
+
Each command adds only its four model-specific files. Existing demos from the
|
| 37 |
+
other models remain in the same directory, and an existing file is never
|
| 38 |
+
overwritten.
|
| 39 |
+
|
| 40 |
The generated files use these fixed excerpts:
|
| 41 |
|
| 42 |
| Video | Domain | Recording | Interval |
|
| 43 |
|---|---|---|---:|
|
| 44 |
+
| `*_demo_1.mp4` | TAU | `fold4_room8_mix003` | 150--170 s |
|
| 45 |
+
| `*_demo_2.mp4` | TAU | `fold4_room10_mix007` | 50--70 s |
|
| 46 |
+
| `*_demo_3.mp4` | Sony | `fold4_room24_mix002` | 20--40 s |
|
| 47 |
+
| `*_demo_4.mp4` | Sony | `fold4_room23_mix003` | 0--20 s |
|
| 48 |
|
| 49 |
Each file is 20 seconds, 1920Γ600, H.264 video with 48 kHz stereo AAC audio.
|
| 50 |
SAID inference operates on the four selected Eigenmike capsules. The
|