This link has been bookmarked by 13 people . It was first bookmarked on 03 Jul 2008, by Frederik Van Zande.
One of the frustrations of doing SEO for large websites is the fact that Google makes it very difficult to see more than a small part of the search index. Even in Webmaster Tools, Google's index search is built on the same mechanics as its web search, which only lets you see the first 1,000 pages of any result. Whether you're trying to get pages discovered, struggling with duplicate content, confirming robots.txt changes, or doing advanced index sculpting, that 1,000-page barrier can be extremely limiting when you're dealing with a site with 10,000 or more indexed pages.
Would you like to comment?
Join Diigo for a free account, or sign in if you are already a member.