I've never really thought about spiders being used for a spam list or such. And I've never used a spider.txt file either (no surprise here huh).
I have had one visitor that I'm not really sure about. It may be just someone from this site because they have been on both politilcalforums.net and oldhouseforums.net. Webtop.com This visitor has been on my forums for three straight days now. I've been to the webtop.com site and it seems to be a local provider but why would just a regular kinda guy be on a forum every single hour of the day for three days? I mean a person has to sleep ya know.
Another odd thing about this particular visitor is that he has looked at a few of the boards that only have three or four posts but the log file says they have looked at the board nearly a hundred times.....I wonder what's up with that? Looking at the same post over and over?
I included an attachment that shows his details. I don't mind someone that's checking out the forums....That's what they're there for. It just seems odd is all.
I'll look into the spaming spiders now a little closer. Thanks for the heads up!
Brew
CustomShowCars.com
OldHouseForums.net
PoliticalForums.net