Creating sitemaps for your site is a very important part of ensuring that the search engines can spider your site easily and know the most about its pages. You can view ProductCritic's sitemap at
http://www.productcritic.com/sitemap.xmlAt
ProductCritic, we mostly care about Google and Yahoo! since these two sites combine for more than 80% of the search traffic to the site. If you have not done so already, you should set up your sites at both
Google Webmaster Tools and
Yahoo! Site Explorer:
http://www.google.com/webmasters/toolshttp://siteexplorer.search.yahoo.comOnce you've set up your sites and verified that you own them (I've found that the easiest way to do this is to upload their generated html file to your site vs using a meta-tag), it's time to create and upload a sitemap.
When we first launched the main site, we tried some free sitemap generators (just do a search at Google and you'll find a ton of them). The free online one that we found was the best was
XML-Sitemaps.com. Still, I found it a pain to generate it online, download the resulting files, and then upload them to our server. Also, while free,
XML-Sitemaps.com only has a 500 URL limit.
So, I found a Windows application that does the job very quickly, is FREE and has a ton of advanced features if you want to use them. It's called GSiteCrawler and can be found at
http://gsitecrawler.com/. The author, John Mueller, lives in Switzerland and works on the software on the side. Although he offers the software for free, I definitely believe that once you use it, you will want to make a donation to him for the time and effort he's devoted to the project.
Once you install it, just "Create A New Project" and it will walk you through a mere four screens in its New Project Wizard. Using the wizard, you have tons of options to tell it what type of files and urls to crawl on your site. You can choose file extensions of files you want crawled, images, and videos. You can also choose to upload the sitemaps directly to your ftp server once the files have been generated. See the options you have in the four screencaps that follow.




Once you have generated your sitemaps and uploaded them to your site, you need to let Google and Yahoo! know that there is a new sitemap that the search engines should use to crawl your site.
Do this on
Google Webmaster Tools by choosing the "sitemap" tab and either "Add a Sitemap" link at the top right or once you've added it, just select that file (click on the box next to the sitemap name) and click on the "Resubmit Selected" button.
For
Yahoo! Site Explorer, click on the "Manage" button next to the sitename and add the name of the sitemap file (usually "sitemap.xml") to the feed.
It's quite simple and you should make a point of updating your sitemap when there's new content for the search engines to crawl.
Labels: google, promotion, search, tutorials