gijl's picture
|
download
raw
942 Bytes

Fusion baselines

Per-device baselines for test-fusion, one CSV per backend (e.g. MTL.csv). Rows are arch,moe,mode,label,count. Regenerate a CSV whenever fusion patterns change.

Update a baseline

cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_METAL=ON   # enable the target backend
cmake --build build --config Release --target test-llama-archs --target test-fusion -j

rm -rf build-ci-models && mkdir -p build-ci-models
./build/bin/test-llama-archs -o build-ci-models

./build/bin/test-fusion --models build-ci-models --device MTL0 --record MTL.csv

Validate

./build/bin/test-fusion --models build-ci-models --device MTL0 --check MTL.csv

Non-zero exit means a row differs from the baseline. Use --model FILE to run a single architecture. --check also reports baseline rows that the run no longer produces, so a fusion that stops matching fails the run instead of silently dropping out of the CSV.

Xet Storage Details

Size:
942 Bytes
·
Xet hash:
8c02b6ee9257a1bf8b1398faa7460e4f13aaeaafc56423904768e72879f2293f

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.