Benchmarks
Decision recall proof
Published decision-recall results on a pinned corpus: Neither vs naive pgvector vs mem0ai/oss.
Pinned corpus (v3)
Corpus hash: f1bb11060a3a59fb · Run: 20260710T114611Z
Neither
98%Naive pgvector
44%mem0ai/oss
44%Delta vs naive: +54pp · Delta vs mem0ai/oss: +54pp
By question category
| Category | Neither | Naive | mem0ai/oss |
|---|---|---|---|
| Flat Fact | 100% | 89% | 89% |
| Multi Hop Why | 100% | 11% | 11% |
| Rejected Approach | 100% | 14% | 14% |
| Bc Isolation Trap | 91% | 45% | 45% |
| Supersession | 100% | 22% | 22% |
| Partner Unseen | 100% | 100% | 100% |
Neither decision recall 98% vs naive pgvector 44% and mem0ai/oss 44% on pinned corpus f1bb11060a3a59fb.
Methodology
Reproduce the pinned corpus locally with pnpm benchmark:decision-recall and pnpm verify:decision-recall-benchmark. Published metrics appear here once validation completes.