Parakon
/

parakon-runtime

parakon-runtime / src /llama-cparams.cpp

Parakon runtime: llama.cpp fork with fused 1-bit CUDA/Metal/CPU kernels (part 7)

d2816aa verified 19 days ago

100 Bytes

	#include "llama-cparams.h"

	size_t llama_max_parallel_sequences(void) {
	return LLAMA_MAX_SEQ;
	}