« Telstra - still the (… | Home | The Man that Sold the… »

75 percent of Traffic is Scraper bots!?

I was checking my logs recently on a site I run - that has a lot of content on it - and I found that in the last 7 days I had 1700 hits to forum threads.  Of those hits only 700 (or less - I only bothered filtering out 5 rather obvious leachers) were actual traffic.  Most of the filter traffic was at 2 second intervals.

I spent quite a few hours searching for something that would bot-detect like Yahoo! does - threshold requests/minute and requests/day.  I eventually found it in this post on wmw.

So I'll just add the PHP code to my host so it runs before site requests, and all is ok again ;-)

frak

---

No comments:

---

No trackbacks:

Trackback link:

---

Name:			Remember personal info? Yes No
Email:
URL:
Comment:		/ Textile
this is to stop spam bots causing me pain. the first four letters of frakkle     (Register your username / Log in)
Notify: Yes, send me email when someone replies. Hide email: Yes, hide my email address.
Small print: All html tags except <b> and <i> will be removed from your comment. You can make links by just typing the url or mail-address.