Quantcast
Channel: phpBB.com
Viewing all articles
Browse latest Browse all 2435

[3.3.x] Support Forum • Re: Excessive forum load time

$
0
0
No idea what the results are for blank disallow but use allow instead.

https://developers.google.com/search/do ... robots-txt

There is numerous topics over the past few years about the surge in traffic from bots, just do a search. They aren't identifying themselves as bots and don't obey robots.txt. There is different solutions but Cloudflare is the most robust one.

Statistics: Posted by thecoalman — Fri Feb 14, 2025 2:33 am



Viewing all articles
Browse latest Browse all 2435

Trending Articles