Future Improvements and Conclusion

Future Improvements

Depending on how Google or other search engines choose to implement the concept of permission-based indexing, the following improvements/enhancements could be made at a later date:

  1. Detailed crawling/indexing analysis. An indication of the dates, times, and status of each page that was crawled. This would allow those users who do not have access to their raw logs the ability to see a similar detailed breakout of how Google crawled and indexed pages, and any errors that occurred.
  2. Increased capacity to detect/remove manipulation via algorithm. Resources that were previously allocated to spiders could be used to algorithmically calculate, detect, and eliminate unethical manipulation of engines.
  3. Better explanation of technical issues and how to solve them. Some of this already exists within the Google Sitemaps service; however, more information could be provided regarding issues such as code validation, headers, and other issues which may enable or prevent proper crawling and indexing of pages.
  4. Customized webmaster guidance for ethical site ranking. The information contained within the various parts of the Google database (such as PageRank) could be presented to the webmaster and used to tailor a series of customized tips on how to obtain a long-term high ranking without resorting to black hat techniques.

Conclusion

Permission-based indexing is the ideal methodology to ensure that webmasters who have legitimate, ethical content would at least get indexed and be given an opportunity to compete in the search engine arena; to assist in the elimination of websites and pages that exist for the purposes of unethical manipulation; and to avoid the accidental indexing of pages that may not necessarily have value to the index and its end users as a whole.

Permission-based indexing increases the ability for webmasters to communicate with search engines, and encourages webmasters to build websites with a solid navigation structure, which allows both the webmaster and the search engine to provide a better product to the end user.

Permission-based indexing gives control to the webmasters as far as what should and should not be indexed, within reason.

Permission-based indexing is more cost-effective in the long-term.

Permission-based indexing can be implemented with minimal short-term cost and engine disruption, if done properly.

For all of these reasons and more, permission-based indexing is the optimal solution for the Supplemental indexing problem, as well as many other indexing problems that may exist.

06/12/2006
Questions/Comments and Clarifications –>
This website is for sale!