Skip to content

Commit 62ce981

Browse files
authored
Update README.md
1 parent 0286bc6 commit 62ce981

1 file changed

Lines changed: 2 additions & 4 deletions

File tree

README.md

Lines changed: 2 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -53,14 +53,12 @@ Search hits Facts, graph discovers Episodes, traces back to source Sentences. SQ
5353

5454
## Benchmarks
5555

56-
> **What is F1?** F1 is the harmonic mean of precision (what fraction of the model's answer was correct) and recall (what fraction of the correct answer the model actually covered). A high F1 means the answer is both accurate and complete. Most memory system vendors report LLM-judge accuracy instead — a separate LLM scores each answer as correct or not, which is easier to run but less granular.
57-
5856
Tested on long-horizon memory benchmarks — hundreds of turns, real user details buried deep in history.
5957

6058
| System | LoCoMo | LongMemEval-S | DMR | F1 avg (LoCoMo)† | Search p95 | Total p95 |
6159
|--------|--------|---------------|-----|-----------------|-----------|----------|
62-
| Vektori | 66% | 73% |||| |
63-
| Mem0 | 66.88% ||| 41.0 | 0.200s | 1.440s |
60+
| Vektori | 66% | 73% |||| 1.48s |
61+
| Mem0 | 66.88% ||| 41.0 | 0.48s | 2.59s |
6462
| Zep | 75.14%‡ | 71.2% | 94.8% || 0.778s | 2.926s |
6563
| Supermemory || 81.6% |||||
6664
| Letta | 74.0% ||||||

0 commit comments

Comments
 (0)