This allows search engines to crawl the site more intelligently. Sitemaps are particularly beneficial on websites where some areas of the website are not available through the browser interface. Since Search Engines such as Google, Bing, and Yahoo make use of sitemaps, this helps get your web pages indexed in their systems. Sitemaps are used as a supplement and do not replace the existing crawl-based mechanisms that search engines already use to discover URLs. Keep in mind that using sitemaps does not guarantee that web pages will be included in search indexes, nor does it influence the way that pages are ranked in search results. If you submit your sitemaps to multiple search engines, you’ll notice that your pages are not indexed equally. Again, while sitemaps are helpful, they do not guarantee any specific results. They generally improve your chances to get your pages indexed.

Sitemap XML File Format

Here is an example of how a sitemap XML file should be formatted.

Sitemap Elements

Sitemap files have a limit of 50,000 URLs and 10 MB per sitemap file. Sitemaps can be compressed using gzip though. Multiple sitemap files are supported so if you exceed the limit, submit multiple sitemap files. As with all XML files, any data values including URLs, must use entity escape codes for the characters ampersand (&), single quote (’), double quote ("), less than (<), and greater than (>).

Generate a Sitemap File

You have a few options with regard to generating your own sitemap file. The first is to purchase software or use software that your hosting provider has available. For instance, some hosting providers provide you with the ability to generate a sitemap file that you can submit to search engines at no additional cost. Another method is to use a free/paid online website that provides this service. There are many on the Internet. A quick search will result in many websites to choose from. A third option is to create one manually. However, if you have many pages, this is not a task that I would recommend. Finally, if you have some programming skills, you can generate a sitemap file using asp.net and/or vb.net that builds the sitemap from information stored in a database table. If you have an asp.net web application, create a new asp.net page, and add the following code listed below to the code-behind page. When you open the page in a browser, the sitemap file will be created. Of course, you do not have to use an asp.net web application. You can modify this code and use it in a stand-alone vb.net application. Sitemaps are a great way to help move the indexing process along. As long as you have great content and backlinks located on well ranked sites, the search engines will eventually find your website and index your pages regardless of whether or not you have a sitemap submitted with them. Having a sitemap, just helps their indexing bots locate your pages faster.