Add a site redirection check

[Alex-302]

Сheck to find live domains which redirect somewhere.

The most popular cases:

• a site just moved to a new domain
• a site is dead, but new domain owner uses it for another purposes (99% parked and uses redirection to a selling page, or used for ads/scum.

Currently, domains that are used in such scenarios are skipped.

In the second case URLs contain query params (usually ad related).

These domains can be logged to a file by pairs domain + tab + redirection_url or replaced in the filter by ! commented out by dead-domains-linter: domain + redirection_url

Perhaps if an address doesn't open with HTTPS, it can be considered dead.

Examples:

• bukaivip.com - first-party redirect

Screenshot

• sa8zdui.com - third-party redirect

Screenshot

• www.mp4er.cc - legal redirect

Screenshot

[ameshkov]

Redirect does not look like a good indication of the domain being dead.

It means the domain is very well alive and since there's traffic on that domain, it can be repurposed back very quickly.

[Alex-302]

If a site is moved, the rule is not used. For us, it is almost equal to a dead domain.
But the list of logged domains can be reviewed.

[Yuki2718]

What is the current state of the issue? Or rather what did these AdguardTeam/AdguardFilters#207701 check? Before opening an issue I talked in Slack, I have to understand what these changes aimed to do first (IOW the expected behavior).

[Yuki2718]

I thought it's redirection check as the title says, but then noticed some strange results. E.g. (nsfw) gerorian.net removed by AdguardTeam/AdguardFilters@f2ae31e#diff-b0bf1333dcfa2e503b6b6318a289d7553d3d6d091dfe5a17cc3a2664dd859caf is living and many of the rules are still applied; however, some of its siter sites in the same lines are actually parked and redirecting (ex. peepspider.com), but not detected by DDL.

[Alex-302]

some of its siter sites in the same lines are actually parked and redirecting (ex. peepspider.com), but not detected by DDL.

Because someone resolved the domain using AdGuard DNS

gerorian.net removed

during 4 days (I made 1 check every day) no AdGuard DNS users visited the site. It literally has ~0 trafic. Which is not surprising, given the type of content.

[Yuki2718]

All right, that makes sense. So anyway the purpose is to detect redirecting domain.