Test builds: Neural Engine-compilable conv-cache slices for M2 (FluidAudio #1141)

by alexwengg - opened about 22 hours ago

base: refs/heads/main

←

from: refs/pr/3

Discussion Files changed

+18412

-0

This PR is in draft mode

alexwengg

Fluid Inference Community org about 22 hours ago

Hugging Face CLI

Test builds only, for checking the Neural Engine compile on M1/M2/M3. main is unchanged.

Issue: https://github.com/FluidInference/FluidAudio/issues/1141
The shipped 560/1120/2240 ms multilingual encoders and the encoder-split/2240ms body halves, with slice_by_index(concat(cache, x)) rewritten to slice the concat's inputs. weight.bin is unchanged. Outputs are byte-identical to main on CPU and ANE (M5 Pro). See test-1141/README.md.

Test builds: Neural Engine-compilable conv-cache slices for M2 (FluidAudio #1141)dfc8e1cc

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Publish this branch

This branch is in draft mode, publish it to be able to merge.

· Sign up or log in to comment