PDA

View Full Version : Yahoo Slurp Spider



satay
04 July 2007, 10:20 AM
namaste,
lately, I have been noticing a lot of yahoo slurp spiders 'slurping' up the pages of HDF, indexing them for its search engine. This is good.

Just thought I share it with everyone.

sm78
05 July 2007, 01:36 AM
How do one notice a spider ? just curious...have heard lot about them, never seen one ... :)

Agnideva
05 July 2007, 11:41 AM
How do one notice a spider ? just curious...have heard lot about them, never seen one ... :)

Singhi, just look to see who's online right now. At this very moment, I notice there are 6 spiders slurping HDF! :)

satay
05 July 2007, 02:25 PM
namaskar,

Yahoo slurp spider is an yahoo's search indexer robot that indexes content from a site. Sarabhanga had some search optimization few months back that invited yahoo and google spiders regularly to HDF. For a number of months I didn't see yahoo spider as much but lately it has been around constantly on our site indexing pages for its search engine.

Agni, not all members can see the 'who is online' link. It was disabled about a year or so ago for privacy reasons. Only certain groups of members can see this link for now.