synthiumjp commited on
Commit
dc3e9a9
·
verified ·
1 Parent(s): eef0eab

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +14 -5
README.md CHANGED
@@ -14,11 +14,15 @@ facts the named person states about themselves, one short sentence per line,
14
  or NONE. sourcedrecall runs them inside its own process on onnxruntime-genai,
15
  on the CPU, with no server.
16
 
17
- | file | base | download | per conversation (4 CPU threads) | peak memory |
18
  |---|---|---|---|---|
19
  | `sourcedrecall-notes-en-0.6b.tar.gz` (small) | Qwen3-0.6B | 0.51 GB | 2-3 s | 1.9 GB |
20
  | `sourcedrecall-notes-en-1.7b.tar.gz` (standard) | Qwen3-1.7B | 1.3 GB | about 4.5 s | 3.3 GB |
21
 
 
 
 
 
22
  They are optional. sourcedrecall stores and finds the user's own words
23
  without them; with one, short notes are added, each kept only if its words
24
  are in what the user wrote, and shown labelled as written by a model.
@@ -42,11 +46,11 @@ are in what the user wrote, and shown labelled as written by a model.
42
 
43
  ## Measured (local Qwen3-14B reader and judge for every system)
44
 
45
- LoCoMo, conversations 2-9 (1,307 questions):
46
 
47
  | | overall | multi-hop | temporal | single-hop |
48
  |---|---|---|---|---|
49
- | sourcedrecall, no notes | 64.7% | 53.6% | 56.2% | 74.8% |
50
  | with the small model's notes | 68.2% | 55.2% | 58.9% | 79.0% |
51
  | with the standard model's notes | 70.3% | 59.0% | 57.4% | 81.6% |
52
  | with Qwen3-14B's notes (a server) | 73.1% | 62.3% | 57.4% | 85.4% |
@@ -65,8 +69,13 @@ published LoCoMo results, which use GPT-4-class models.
65
  ## Limits
66
 
67
  English only. They sometimes give the user something the other person said
68
- ("has kids" from the other person's children). Neither closes
69
- sourcedrecall's multi-hop gap to Mem0.
 
 
 
 
 
70
 
71
  ## Attribution
72
 
 
14
  or NONE. sourcedrecall runs them inside its own process on onnxruntime-genai,
15
  on the CPU, with no server.
16
 
17
+ | file | base | download | a chat session (4 CPU threads) | peak memory |
18
  |---|---|---|---|---|
19
  | `sourcedrecall-notes-en-0.6b.tar.gz` (small) | Qwen3-0.6B | 0.51 GB | 2-3 s | 1.9 GB |
20
  | `sourcedrecall-notes-en-1.7b.tar.gz` (standard) | Qwen3-1.7B | 1.3 GB | about 4.5 s | 3.3 GB |
21
 
22
+ A long coding session (eight parts of 12,000 characters) takes about 100 s
23
+ and up to 3.6 GB with the small model; sourcedrecall writes notes in the
24
+ background after the session ends.
25
+
26
  They are optional. sourcedrecall stores and finds the user's own words
27
  without them; with one, short notes are added, each kept only if its words
28
  are in what the user wrote, and shown labelled as written by a model.
 
46
 
47
  ## Measured (local Qwen3-14B reader and judge for every system)
48
 
49
+ LoCoMo, conversations 2-9 (1,307 questions; used to choose between models, so not held out):
50
 
51
  | | overall | multi-hop | temporal | single-hop |
52
  |---|---|---|---|---|
53
+ | sourcedrecall, no notes | 64.7% | 52.3% | 53.5% | 75.5% |
54
  | with the small model's notes | 68.2% | 55.2% | 58.9% | 79.0% |
55
  | with the standard model's notes | 70.3% | 59.0% | 57.4% | 81.6% |
56
  | with Qwen3-14B's notes (a server) | 73.1% | 62.3% | 57.4% | 85.4% |
 
69
  ## Limits
70
 
71
  English only. They sometimes give the user something the other person said
72
+ ("has kids" from the other person's children), or keep a note whose words
73
+ the user wrote but whose meaning differs (a negation, a number). The small
74
+ model often writes nothing for short sessions; standard does better there.
75
+ Neither closes sourcedrecall's multi-hop gap to Mem0. The held-out false
76
+ memory sets were run many times during development; v4 is no longer clean.
77
+ Known issues and fixes in progress: docs/REVIEW_2026-10-09.md in the
78
+ sourcedrecall repository.
79
 
80
  ## Attribution
81