Brant Gaede Posted December 17, 2007 Share Posted December 17, 2007 Last night I was the only member online vrs 215 "guests." Who are these people? Am I a goldfish in a fish tank?--Brant Link to comment Share on other sites More sharing options...
Michael Stuart Kelly Posted December 20, 2007 Share Posted December 20, 2007 Brant,I just saw this. You had posted it in "Articles," so it was awaiting release.Many of the visitors in a surge like that are nothing more than automatic search engine and spider activity. Michael Link to comment Share on other sites More sharing options...
Chris Grieb Posted December 20, 2007 Share Posted December 20, 2007 Michael; What is "spider" activity? Link to comment Share on other sites More sharing options...
Michael Stuart Kelly Posted December 20, 2007 Share Posted December 20, 2007 Chris,There are companies that have programs that visit as many of the sites on the web as they can and take digital snapshots of them. They then store these snapshots (billions of them) and use them for varying purposes. The most common purpose is to provide a search service to the public, like Google does.The programs that scour the web taking digital snapshots are called spiders. There are a handful of spiders running all the time.Michael Link to comment Share on other sites More sharing options...
RTB Posted December 21, 2007 Share Posted December 21, 2007 By the way, you can block that activity if you wish. There are programs that stop these scans. The website of Wendy McElroy uses a product that stops it. Link to comment Share on other sites More sharing options...
Michael Stuart Kelly Posted December 21, 2007 Share Posted December 21, 2007 RTB,There are also internal controls one can use, even here in the forum software. I can even block parts of the forum from spiders if I wish. But it is good to be crawled by search engine spiders and be shown on search engines. I can't imagine why anyone would have a public site and not want that. A search engine spider should not be confused with a bot spammer. Those are the bad guys. They sign up automatically and post porn and things like that. Fortunately, with the upgrade we made in the forum software, most of the ones that were bothering us have disappeared.Michael Link to comment Share on other sites More sharing options...
Kat Posted December 22, 2007 Share Posted December 22, 2007 OK, time to yank the covers off our mysterious guests... I have changed the setting so you can see when the site is being crawled by search engine spiders. It is generally just a handful at any given time, not hundreds. Over 200 guests in here is a lot so you may have been in a fish tank that night. There are several reasons why so many guests would be listed. If people are not signed in, they will show up as guests, as will people just stopping in and just interested in reading stuff. There are also programs out there that automate forum joining and posting used by spammers and bots and although they can enter the forum, they cannot post until they join, and we have made it increasingly more difficult to automatically join the forum. We have put tighter controls on the membership validation process, such as requiring a name (We have found that most spammers or bots will put USA or another country name in that field, and that is our signal to ban them). In the internet world, driving traffic to the site is important and I periodically submit the site to directories and search engines, which can also create a flurry of spider traffic. I hope that members will also link to our site and use the social bookmarking tools we have provided to help promote our site as well. You digg?Kat Link to comment Share on other sites More sharing options...
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now