Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -14,11 +14,15 @@ facts the named person states about themselves, one short sentence per line,
|
|
| 14 |
or NONE. sourcedrecall runs them inside its own process on onnxruntime-genai,
|
| 15 |
on the CPU, with no server.
|
| 16 |
|
| 17 |
-
| file | base | download |
|
| 18 |
|---|---|---|---|---|
|
| 19 |
| `sourcedrecall-notes-en-0.6b.tar.gz` (small) | Qwen3-0.6B | 0.51 GB | 2-3 s | 1.9 GB |
|
| 20 |
| `sourcedrecall-notes-en-1.7b.tar.gz` (standard) | Qwen3-1.7B | 1.3 GB | about 4.5 s | 3.3 GB |
|
| 21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
They are optional. sourcedrecall stores and finds the user's own words
|
| 23 |
without them; with one, short notes are added, each kept only if its words
|
| 24 |
are in what the user wrote, and shown labelled as written by a model.
|
|
@@ -42,11 +46,11 @@ are in what the user wrote, and shown labelled as written by a model.
|
|
| 42 |
|
| 43 |
## Measured (local Qwen3-14B reader and judge for every system)
|
| 44 |
|
| 45 |
-
LoCoMo, conversations 2-9 (1,307 questions):
|
| 46 |
|
| 47 |
| | overall | multi-hop | temporal | single-hop |
|
| 48 |
|---|---|---|---|---|
|
| 49 |
-
| sourcedrecall, no notes | 64.7% |
|
| 50 |
| with the small model's notes | 68.2% | 55.2% | 58.9% | 79.0% |
|
| 51 |
| with the standard model's notes | 70.3% | 59.0% | 57.4% | 81.6% |
|
| 52 |
| with Qwen3-14B's notes (a server) | 73.1% | 62.3% | 57.4% | 85.4% |
|
|
@@ -65,8 +69,13 @@ published LoCoMo results, which use GPT-4-class models.
|
|
| 65 |
## Limits
|
| 66 |
|
| 67 |
English only. They sometimes give the user something the other person said
|
| 68 |
-
("has kids" from the other person's children)
|
| 69 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 70 |
|
| 71 |
## Attribution
|
| 72 |
|
|
|
|
| 14 |
or NONE. sourcedrecall runs them inside its own process on onnxruntime-genai,
|
| 15 |
on the CPU, with no server.
|
| 16 |
|
| 17 |
+
| file | base | download | a chat session (4 CPU threads) | peak memory |
|
| 18 |
|---|---|---|---|---|
|
| 19 |
| `sourcedrecall-notes-en-0.6b.tar.gz` (small) | Qwen3-0.6B | 0.51 GB | 2-3 s | 1.9 GB |
|
| 20 |
| `sourcedrecall-notes-en-1.7b.tar.gz` (standard) | Qwen3-1.7B | 1.3 GB | about 4.5 s | 3.3 GB |
|
| 21 |
|
| 22 |
+
A long coding session (eight parts of 12,000 characters) takes about 100 s
|
| 23 |
+
and up to 3.6 GB with the small model; sourcedrecall writes notes in the
|
| 24 |
+
background after the session ends.
|
| 25 |
+
|
| 26 |
They are optional. sourcedrecall stores and finds the user's own words
|
| 27 |
without them; with one, short notes are added, each kept only if its words
|
| 28 |
are in what the user wrote, and shown labelled as written by a model.
|
|
|
|
| 46 |
|
| 47 |
## Measured (local Qwen3-14B reader and judge for every system)
|
| 48 |
|
| 49 |
+
LoCoMo, conversations 2-9 (1,307 questions; used to choose between models, so not held out):
|
| 50 |
|
| 51 |
| | overall | multi-hop | temporal | single-hop |
|
| 52 |
|---|---|---|---|---|
|
| 53 |
+
| sourcedrecall, no notes | 64.7% | 52.3% | 53.5% | 75.5% |
|
| 54 |
| with the small model's notes | 68.2% | 55.2% | 58.9% | 79.0% |
|
| 55 |
| with the standard model's notes | 70.3% | 59.0% | 57.4% | 81.6% |
|
| 56 |
| with Qwen3-14B's notes (a server) | 73.1% | 62.3% | 57.4% | 85.4% |
|
|
|
|
| 69 |
## Limits
|
| 70 |
|
| 71 |
English only. They sometimes give the user something the other person said
|
| 72 |
+
("has kids" from the other person's children), or keep a note whose words
|
| 73 |
+
the user wrote but whose meaning differs (a negation, a number). The small
|
| 74 |
+
model often writes nothing for short sessions; standard does better there.
|
| 75 |
+
Neither closes sourcedrecall's multi-hop gap to Mem0. The held-out false
|
| 76 |
+
memory sets were run many times during development; v4 is no longer clean.
|
| 77 |
+
Known issues and fixes in progress: docs/REVIEW_2026-10-09.md in the
|
| 78 |
+
sourcedrecall repository.
|
| 79 |
|
| 80 |
## Attribution
|
| 81 |
|