Inktomi Spiders ... Do we need bug spray?

fe3333au

Deity
Joined
Apr 1, 2004
Messages
6,979
Location
Fern Tree, Tassie
I was looking in Who's On-line and once the members had all been accounted for ... the remaining Lurkers were designated either Guest or Inktomi Spider ... :eek:

Being arachnophobic is the forum in any peril? :p

The name sounds cool ... what is the origin?

Also I assume that some members can become 'invisible' are these ... the Spiders :confused:
 
I did a google on it, apparently it's from yahoo or hotbot:

At HotBot, you can type www.yoursite.com into their search box and see if it shows up. Since HotBot uses the Inktomi database for its search results, you can simply wait for the Inktomi spider to find your site. If you've been listed in the LookSmart directory, the Inktomi spider should easily find you in no time. You can also submit to them through any Inktomi partner site. As with most of the search engines, HotBot/Inktomi does not guarantee that they will list all sites that are submitted to them for free. For guaranteed inclusion in their database, you might want to use the Inktomi Paid Inclusion Program. Basically, Inktomi has partnered with some submission companies that, for a fee, guarantee the Inktomi spider will crawl your submitted pages every 48 hours. This will also keep your URL in their database for a year. You won't get any boost in rankings, but you'll have peace of mind knowing your site is listed.

I say we burn 'em ;)
 
The Intomki/Yahoo spider can be quiet annoying sometimes. Some forums have seen 2000+ Intomi spiders once at one time. :eek:

Google spiders are much more server friendly and efficient. I rarely see more than a dozen Google spiders.
 
Not sure if you would want to, but is there any way to block the spiders?
 
As usual propt and informative replies ... :thumbsup:

Thanks for clearing up the mystery ... although I was hoping for a more romantic answer :sad:
 
Back
Top Bottom