Skip to content

DAGE-20: added ElasticSearch support#185

Merged
nicolo-rinaldi merged 9 commits into
dataset-generatorfrom
ticket/DAGE-20_elasticsearch-support
Aug 12, 2025
Merged

DAGE-20: added ElasticSearch support#185
nicolo-rinaldi merged 9 commits into
dataset-generatorfrom
ticket/DAGE-20_elasticsearch-support

Conversation

@nicolo-rinaldi

Copy link
Copy Markdown
Collaborator
  • updated SearchEngineFactory with elasticsearch support
  • created elasticsearch_search_engine.py file with the class needed for the integration and related unit test file
  • changed the names of the files used for test in the resources folder

Jira ticket

@nicolo-rinaldi nicolo-rinaldi force-pushed the ticket/DAGE-20_elasticsearch-support branch 3 times, most recently from e8d485f to 1448039 Compare July 25, 2025 15:13
Comment thread rre-dataset-generator/tests/integration/elasticsearch-init/Dockerfile Outdated
@nicolo-rinaldi nicolo-rinaldi force-pushed the ticket/DAGE-20_elasticsearch-support branch 2 times, most recently from 7fc74a3 to 882b665 Compare July 25, 2025 15:39
@nicolo-rinaldi nicolo-rinaldi changed the title [DAGE-20] added ElasticSearch support DAGE-20: added ElasticSearch support Jul 25, 2025
Comment thread rre-dataset-generator/src/search_engine/elasticsearch_search_engine.py Outdated
nseidan
nseidan previously approved these changes Jul 26, 2025

@Intrinsical-AI Intrinsical-AI left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd add parsing, typing, docstrings, and use pytests fixtures.

Also: I think it's needed to follow a general common implementation for the engines, as we're doing very diferent each one (further than syntax specifics)

Comment thread rre-dataset-generator/src/search_engine/elasticsearch_search_engine.py Outdated
Comment thread rre-dataset-generator/tests/mocks/elasticsearch.py Outdated
Comment thread rre-dataset-generator/src/search_engine/elasticsearch_search_engine.py Outdated
Comment thread rre-dataset-generator/tests/unit/test_solr_search_engine.py Outdated
Comment thread rre-dataset-generator/src/search_engine/elasticsearch_search_engine.py Outdated
@nicolo-rinaldi nicolo-rinaldi force-pushed the ticket/DAGE-20_elasticsearch-support branch from 3bec78d to 9dee1ca Compare July 30, 2025 08:30
Comment thread rre-dataset-generator/src/search_engine/solr_search_engine.py
Comment thread rre-dataset-generator/src/search_engine/solr_search_engine.py
Comment thread rre-dataset-generator/tests/mocks/solr.py
Comment thread rre-dataset-generator/tests/unit/test_solr_search_engine.py
Intrinsical-AI
Intrinsical-AI previously approved these changes Jul 30, 2025

@Intrinsical-AI Intrinsical-AI left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is a very good refactor! I'm glad you decided to add it, thanks for the openess! 💯

Intrinsical-AI
Intrinsical-AI previously approved these changes Jul 31, 2025
Comment thread rre-dataset-generator/src/search_engine/elasticsearch_search_engine.py Outdated
Comment thread rre-dataset-generator/src/search_engine/solr_search_engine.py

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I like it but, for the next time, please do refactoring and fixes in a separated Pr

Comment thread rre-dataset-generator/tests/unit/test_elasticsearch_search_engine.py Outdated
Comment thread rre-dataset-generator/tests/unit/test_elasticsearch_search_engine.py Outdated
- updated SearchEngineFactory with elasticsearch support
- created elasticsearch_search_engine.py file with the class needed for the integration and related unit test file
- changed the names of the files used for test in the resources folder
- added eleasticsearch-init folder with test environment for elasticsearch
@nicolo-rinaldi nicolo-rinaldi force-pushed the ticket/DAGE-20_elasticsearch-support branch from bfdfd94 to bb18fb2 Compare August 12, 2025 14:55
@nicolo-rinaldi nicolo-rinaldi merged commit 0a8277c into dataset-generator Aug 12, 2025
1 check passed
@nicolo-rinaldi nicolo-rinaldi deleted the ticket/DAGE-20_elasticsearch-support branch August 12, 2025 16:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants