Migrate ChromaDB and BM25 to Qdrant

[KarunyaChavan]

Goal

Replace ChromaDB and pickle-based BM25 storage with Qdrant.

Scope

Qdrant Deployment

• Deploy Qdrant via Docker
• Configure persistence
• Configure networking

Collection Design

• Create images collection
• Create texts collection
• Define payload schema
• Configure cosine similarity

Migration

• Create Chroma export script
• Create Qdrant import script
• Migrate image embeddings
• Migrate text embeddings
• Validate metadata integrity

Text Search

• Evaluate Qdrant full-text search
• Evaluate Bleve alternative
• Select final approach
• Replace BM25 implementation

Validation

• Compare search results
• Benchmark retrieval quality
• Benchmark latency
• Acceptance Criteria

All vectors migrated successfully
Existing search functionality preserved
ChromaDB dependency removable