Attack of the Web Crawlers at benheck.com

vb_master · Post by **vb_master** » Sat Mar 26, 2005 2:58 pm

You may have not noticed, but there has been a guest posting inapproprite messages with links to ads. What do you need to stop it? A simple robots.txt file in the root folder of the side. Here's what you need to do:

Code: Select all

User-agent: *
Disallow: /v-web/

Put this is a text file called robots.txt, and slap it in the root file of the site, and you should be protected!

--AND--

Disable guest posting, so no web crawler can access the forum, or post if they happen to get in.

soundwave · Post by **soundwave** » Sat Mar 26, 2005 3:12 pm

Yeah, why not block quest posting, they should just register. Either that or just block guest posting for a few days, until the guy loses interest.

vb_master · Post by **vb_master** » Sat Mar 26, 2005 3:13 pm

Ok, like at AA, guest posting is blocked. Do this, and add robots.txt .

vb_master · Post by **vb_master** » Sat Mar 26, 2005 5:12 pm

Ok, look 25 guests!

Oh, this is a really old version of phpBB. Ben needs to upgrade!

Post by **gannon** » Sat Mar 26, 2005 7:49 pm

umm... the version was upgraded....