New sites do not need to be "submitted" to search engines to be listed. However, Google and Yahoo offer a submission program such as Google Sitemaps that an XML type feed could be created and submitted. Generally however, a simple link from an established site will get the search engines to visit the new site and begin to spider its contents. It can take a few days or even weeks from the acquisition of a link from such an established site for all the main search engine spiders to commence visiting and indexing the new site.

Once the search engine has found the new site, it will generally visit and start to index the pages on the site, as long as all the pages are linked to with anchor tag hyperlinks. Pages which are accessible only through Flash or Javascript links may not be findable by the spiders. Search engine crawlers may look at a number of different factors when crawling a site, and many pages from a site may not be indexed by the search engines until they gain more pagerank or links or traffic. Distance of pages from the root directory of a site may also be a factor in whether or not pages get crawled, as well as other importance metrics. Cho et al. (Cho et al., 1998) described some standards for those decisons as to which pages are visited and sent by a crawler to be included in a search engine's index.

Webmasters can instruct spiders to not index certain files or directories through the standard robots.txt file in the root directory of the domain. Standard practice requires a search engine to check this file upon visiting the domain, though a search engine crawler will keep a cached copy of this file as it visits the pages of a site, and may not update that copy as quickly as a webmaster does. The web developer can use this feature to prevent pages such as shopping carts or other dynamic, user-specific content from appearing in search engine results, as well as keeping spiders from endless loops and other spider traps.

For those search engines who have their own paid submission (like Yahoo!), it may save some time to pay a nominal fee for submission. Yahoo!'s paid submission program guarantees inclusion in their search results, but does not guarantee specific ranking within the search results.

We will also manually submit your Website to the following major search engines: Yahoo, AltaVista, HotBot, AllTheWeb, Google, AOL, iWon, Netsacape, MSN, Lycos, Teoma, AskJeeves and DMOZ (Open Directory).
Note that Yahoo no longer accepts automated submissions, so do not get fooled by some other companies claiming to submit you to Yahoo with their software. Before we submit your Website, one of our analysts will review your site and make sure that it is search engine friendly - meaning we will verify that your page uses proper design, content and Meta Tags, for best search engine placement. If we notice any spam or other search engine related problems on your site or any improvements that can be made to give you a better ranking in the search engines, we will tell you about them and give you a chance to modify your page before submission. This is a VERY valuable service that you won't find anywhere else.