Hugging Face's logo

HuggingFaceBio
/
Carbon-3B-GGUF

GGUF
Upper Grand Valley Dani
genomic
llama.cpp
hybriddna
Model card Files
xet
 Community
2

Update llama.cpp usage to the current CLI

#2
by kashif HF Staff - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+3
-16
kashif
 Hugging Face Biology Research org

Update the llama.cpp examples to the current llama.cpp CLI:

  • Use llama-completion for raw DNA prompts.
  • Speculative serving uses --spec-draft-n-max / --spec-draft-n-min.
  • Clarify that llama-perplexity scores the file as one stream in context-sized chunks.
  • Point to the Python score() for per-sequence log-likelihoods.
Update llama.cpp usage to the current CLI495732c2
kashif changed pull request status to merged

Sign up or log in to comment