Quantcast
Channel: phpBB.com
Viewing all articles
Browse latest Browse all 2788

[3.3.x] Support Forum • Re: Excluding Bots from accessing anything on my board

$
0
0
Something to note here is blocking bots within phpBB only blocks legitimate bots that identify themselves with user agent or anything spoofing the user agent.

Generally speaking you can just do this with robots.txt.

Code:

User-agent: *Disallow: /
Copy into text file, name it robots.txt and upload to the domain root of your server. It should be accessible with example.com/robots.txt

Legitimate bots will occasionally request this file and they will obey it. Bots that do not obey robots.txt typically don't have unique user agent and instead use a browsers user agent. That's whole other topic and they can't be stopped with phpBB.

Statistics: Posted by thecoalman — Tue Dec 17, 2024 1:21 am



Viewing all articles
Browse latest Browse all 2788

Trending Articles