model card
Browse files
README.md
ADDED
|
@@ -0,0 +1,29 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: mit
|
| 3 |
+
base_model: jhu-clsp/ettin-encoder-150m
|
| 4 |
+
library_name: onnx
|
| 5 |
+
pipeline_tag: feature-extraction
|
| 6 |
+
tags: [code-search, retrieval, onnx, anvesa]
|
| 7 |
+
---
|
| 8 |
+
|
| 9 |
+
# anvesa-code-150m
|
| 10 |
+
|
| 11 |
+
A code-search encoder for [anvesa](https://github.com/nimishph/anvesa): Ettin-encoder-150m (jhu-clsp, MIT) fine-tuned
|
| 12 |
+
on 105 MIT-licensed repositories, learning from the 1B fine-tune as a teacher. ONNX, fp32: `model.onnx` with its weights in `model.onnx_data`, and
|
| 13 |
+
`tokenizer.json`. Mean pooling over real tokens, L2-normalised, 512 tokens, no prefix. It embeds anvesa's symbol
|
| 14 |
+
cards without their WQL path line.
|
| 15 |
+
|
| 16 |
+
`ranker-noword.json` is the XGBoost ranker fit on this encoder's scores for anvesa's `experimental.learnedRanker`
|
| 17 |
+
(20 features, no word overlap).
|
| 18 |
+
|
| 19 |
+
| | corpus test (1,710 generated queries, 57 repos, 13 languages) | bench (241 hand-written queries, 8 repos) |
|
| 20 |
+
|---|---|---|
|
| 21 |
+
| first stage, hub penalty 0.3 | 0.301 | 0.626 |
|
| 22 |
+
| with the ranker | 0.322 | 0.632 |
|
| 23 |
+
|
| 24 |
+
CPU: 40 ms a card (ONNX Runtime, 12 threads). For comparison, all-MiniLM-L6-v2 scores 0.293 and 0.547 without a
|
| 25 |
+
ranker.
|
| 26 |
+
|
| 27 |
+
```bash
|
| 28 |
+
anvesa model install anvesa-code-150m --download
|
| 29 |
+
```
|