|
2 | 2 |
|
3 | 3 | ## Overview |
4 | 4 | - Dataset Generator |
5 | | -- Embedding Model Evaluator |
6 | | -- Approximate Search Evaluator |
| 5 | +- Vector Search Doctor |
| 6 | + - Embedding Model Evaluator |
| 7 | + - Approximate Search Evaluator |
7 | 8 |
|
8 | 9 | ### [Dataset Generator](docs/dataset_generator/README.md) |
9 | 10 |
|
10 | 11 | This tool provides a flexible command-line tool to generate relevance datasets for search evaluation. It can retrieve |
11 | 12 | documents from a search engine, generate synthetic queries, and score the relevance of document-query pairs using LLMs. |
12 | 13 |
|
13 | | -### [Embedding Model Evaluator](docs/embedding_model_evaluator/README.md) |
| 14 | +### Vector Search Doctor |
14 | 15 |
|
15 | | -This tool extends MTEB benchmarking tool to test a HuggingFace embedding model performance on both Retrieval and Reranking |
| 16 | +This tool helps diagnose and optimize vector search performance by evaluating both embedding models and search |
| 17 | +configurations. It consists of two sub-tools that work together to identify bottlenecks and improve retrieval quality in |
| 18 | +your vector search pipeline. |
| 19 | + |
| 20 | +#### [Embedding Model Evaluator](docs/embedding_model_evaluator/README.md) |
| 21 | + |
| 22 | +This sub-tool extends MTEB benchmarking tool to test a HuggingFace embedding model performance on both Retrieval and Reranking |
16 | 23 | tasks based on custom datasets. |
17 | 24 |
|
18 | | -### [Approximate Search Evaluator](docs/approximate_search_evaluator/README.md) |
| 25 | +#### [Approximate Search Evaluator](docs/approximate_search_evaluator/README.md) |
19 | 26 |
|
20 | | -This tool provides a flexible tool to deply RRE and extract metrics to test your search engine collection given a |
| 27 | +This sub-tool provides a flexible tool to deply RRE and extract metrics to test your search engine collection given a |
21 | 28 | [template](https://github.com/SeaseLtd/rated-ranking-evaluator/wiki/What%20We%20Need%20To%20Provide#query-templates). |
22 | 29 |
|
23 | 30 | ## Quickstart: tools installation |
|
0 commit comments