Build Go Scanner and Google Drive Ingestion Service

[KarunyaChavan]

Goal

Move file discovery and Google Drive ingestion from Python into a dedicated Go service.

Scope

Go Service Setup

• Create cmd/scanner
• Initialize Go module
• Add configuration support

Local Media Discovery

• Implement filepath.WalkDir
• Detect supported media types
• Add worker pool processing
• Add cancellation and error handling

Google Drive Integration

• Port OAuth flow
• Implement token persistence
• Implement refresh handling
• Port pagination logic
• Fetch media metadata

gRPC Integration

• Generate Go protobuf stubs
• Connect to Python inference node
• Request embeddings
• Request OCR extraction

Acceptance Criteria

Local scanning works through Go
Google Drive ingestion works through Go
Embeddings obtained exclusively through gRPC