Skip to content

feat: respect robots.txt before fetching pages #18

feat: respect robots.txt before fetching pages

feat: respect robots.txt before fetching pages #18

Triggered via pull request April 23, 2026 21:42
@askalfaskalf
synchronize #8
feat/robots-txt
Status Success
Total duration 19s
Artifacts

ci.yml

on: pull_request
Matrix: build
Fit to window
Zoom out
Zoom in