Commit 97ede65
authored
Dedupe blog search results so a post appears only once (#8081)
Mixedbread returns chunk-level matches, and the search route mapped every
chunk to its own page result. A post matching a query in several chunks
(e.g. "Neon" for the Neon pricing post) showed up 2-4 times in the search
dialog. Keep only the first (highest-scoring) chunk per file_id; this also
frees up topK slots for more distinct posts.1 parent 3b39d56 commit 97ede65
1 file changed
Lines changed: 5 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
27 | 27 | | |
28 | 28 | | |
29 | 29 | | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
30 | 33 | | |
| 34 | + | |
| 35 | + | |
31 | 36 | | |
32 | 37 | | |
33 | 38 | | |
| |||
0 commit comments