gijl's picture
download
raw
703 Bytes
#pragma once
#include "ggml-backend.h"
struct tuner_opts {
const char * dtype_filter = nullptr; // comma-separated, e.g. "f16,q4_0"; null = all
const char * dk_filter = nullptr; // comma-separated dk values, e.g. "128,192"; null = all
int reps = 7;
unsigned seed = 1234;
bool cooldown = true;
double cool_drift = 0.10;
double cool_eps = 0.03;
int cool_max_wait = 120;
int cool_max_retry = 2;
};
// Returns false only when the required Metal proc bridges are unavailable.
bool tuner_fa_vec_run(ggml_backend_t backend, ggml_backend_dev_t dev, const tuner_opts & opts);

Xet Storage Details

Size:
703 Bytes
·
Xet hash:
ee6b19229203253ff69455edbba7680b3b08ee40d52790fe0095c137806f670f

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.