All issues

Search results

Requesting to not report Zapier as bot/crawler

Status: Open.

#461 In monperrus/crawler-user-agents;

· RajatGarg97 opened on Aug 3, 2026

CI should validate on real production traffic.

Status: Open.

#438 In monperrus/crawler-user-agents;

· monperrus opened on Apr 20, 2026

adding IP ranges along with user-agent

Status: Open.

#394 In monperrus/crawler-user-agents;

· maxadamo opened on Mar 10, 2025

Disappeared reference URLs

Status: Open.

#384 In monperrus/crawler-user-agents;

· monperrus opened on Jan 7, 2025

Consider adding .mjs export

Status: Open.

#370 In monperrus/crawler-user-agents;

· DamianGlowala opened on Sep 18, 2024

when you add new crawler/s, is it possible to create a separated file with new instances

Status: Open.

#366 In monperrus/crawler-user-agents;

· petrospap opened on Sep 4, 2024

I noticed a recent bot which I believe is coming from Tencent but can't find documentation for - Ottabot

Status: Open.

#329 In monperrus/crawler-user-agents;

· daviddfm opened on Sep 6, 2023

add a script to generate robots.txt

Status: Open.

#265 In monperrus/crawler-user-agents;

· monperrus opened on Apr 27, 2020

Feature-Request: Difference between good and bad bots?

Status: Open.

#171 In monperrus/crawler-user-agents;

· Daijobou opened on Mar 20, 2019

Add a metadata property to reflect general purpose of the UA

Status: Open.

#169 In monperrus/crawler-user-agents;

· claytonrothschild opened on Mar 14, 2019

Ordering by most common

Status: Open.

#90 In monperrus/crawler-user-agents;

· plbowers opened on Mar 16, 2018