How to use from
Pi
Start the llama.cpp server
# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf bartscheffer/deepkit-code-reranker-gguf:Q8_0
Configure the model in Pi
# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:9931/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "bartscheffer/deepkit-code-reranker-gguf:Q8_0"
        }
      ]
    }
  }
}
Run Pi
# Start Pi in your project directory:
pi
Quick Links

Deepkit Code โ€” Qwen3 Reranker 0.6B GGUF

Q8_0 and f16 conversions of the official Qwen3-Reranker-0.6B model, prepared for Deepkit Code. This repository hosts model artifacts; it does not contain the Deepkit Code executable.

Provenance

  • Official model revision: e61197ed45024b0ed8a2d74b80b4d909f1255473.
  • Unmodified official llama.cpp converter: e79e4bf660e19f2ad851e06c6913f7a8c5852621.
  • Formats: Q8_0 and f16. Exact sizes and SHA-256 are in artifact-manifest.json.
  • Model license: Apache-2.0. The original model is developed by Qwen; this is a project-maintained conversion, not an official Qwen GGUF release.

Conversion scripts and dependency lock record the preparation workflow. All upstream files were verified against pinned Git-blob/LFS hashes before offline conversion. Repeating Q8_0 conversion produced byte-identical output in the recorded environment.

Runtime contract

These are rerankers, not embedding models. Both contain cls.output.weight, Rank pooling, classifier labels [yes, no], and tokenizer.chat_template.rerank. Use the stored rerank template for the query/document pair. The recorded native Qwen3 Rank implementation already applies softmax: the first pooled value is P(yes). Do not apply a second softmax or L2-normalize the two probabilities.

Both artifacts pass actual CPU three-pair checks: a relevant answer scores above 0.999 and an irrelevant answer below 0.00002. Classifier rows were also compared against the original yes/no token weights. Details are in the manifest. These are artifact smoke tests, not a retrieval benchmark or a throughput guarantee. Deepkit Code's production search integration is still in development.

Downloads last month
25
GGUF
Model size
0.6B params
Architecture
qwen3
Hardware compatibility
Log In to add your hardware

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for bartscheffer/deepkit-code-reranker-gguf

Quantized
(93)
this model