VladHong
/

llama-cpp-K2-FAST2

GGUF

llama.cpp

k2-horizon

sliding-window-attention

long-context

fast-inference

Model card Files Files and versions

xet

Community

llama-cpp-K2-FAST2 / examples /model-conversion /scripts /utils /curl-embedding-server.sh

VladHong

llama.cpp k2-fast2: MBZUAI model/K2Horizon + FAST2 sliding-window override

c59fd93 verified about 1 month ago

Raw History Blame Contribute Delete

193 Bytes

#!/usr/bin/env bash
curl --request POST \
    --url http://localhost:8080/embedding \
    --header "Content-Type: application/json" \
    --data '{"input": "Hello world today"}' \
    --silent

	#!/usr/bin/env bash
	curl --request POST \
	--url http://localhost:8080/embedding \
	--header "Content-Type: application/json" \
	--data '{"input": "Hello world today"}' \
	--silent