parakon-runtime / examples /model-conversion /scripts /utils /curl-embedding-server.sh
kat0012's picture
Parakon runtime: llama.cpp fork with fused 1-bit CUDA/Metal/CPU kernels (part 3)
7011d4a verified
Raw History Blame Contribute Delete
193 Bytes
#!/usr/bin/env bash
curl --request POST \
--url http://localhost:8080/embedding \
--header "Content-Type: application/json" \
--data '{"input": "Hello world today"}' \
--silent