A useful stress test would be conflicting updates: after a schedule changes, does the assistant use the newer version consistently across a context reset? That separates retaining a fact from using it correctly. I'm a co-author of Harness RSI; our survey discusses how to evaluate whether retained experience improves later behavior: https://huggingface.co/spaces/lucas1026/harness-rsi-atlas . Have you tried a before/after-reset test with deliberately outdated facts?
Xin lucas-Yu PRO
lucas1026
AI & ML interests
None yet
Recent Activity
commentedon a paper about 5 hours ago
Self-Improvement Memory Enables Continual Recursive Self-Improvement submitted a paper about 5 hours ago
Self-Improvement Memory Enables Continual Recursive Self-Improvement updated a Space about 16 hours ago
lucas1026/harness-rsi-atlas