Yahoo Renames Spider

February 19, 2004 Comments

Robert Clough

Robert Clough

Articles



Source: Webmaster World - "Yahoo! will be modifying its web-indexing robot (crawler) user-agent to reflect our company name. This is the crawler we use to build a searchable index for the Yahoo! search services. To ensure consistency and minimal disruption, we will continue to maintain the "Slurp" name within our web crawler user agent and continue to support "Slurp" as part of any robots.txt files that references this." Link to Article





About the Author

Search Engine Marketing Columnist

Search Engine Marketing Columnist