Skip to content

Release v0.2

Choose a tag to compare

@github-actions github-actions released this 04 Apr 17:21

chore: CI run for recent merged PRs (apurvsinghgautam#116, apurvsinghgautam#118)

PR apurvsinghgautam#116 — Harden scraping pipeline (Chintanpatel24)

  • Thread-local reusable HTTP sessions with retry + connection pooling
  • Response size limit (1MB cap) to prevent memory exhaustion
  • Content-type allowlist — only text/HTML responses parsed
  • Worker concurrency clamped to safe range

PR apurvsinghgautam#118 — Config, error UX, and scraper polish (Chintanpatel24)

  • _clean_env(): strips whitespace and accidental quotes from .env values
  • OpenRouter 401 error hints: specific guidance for invalid/expired keys
  • st.stop() when no models are configured — prevents silent continuation
  • scrape.py: deduplication, streaming download, URL scheme validation, debug logging