This article will give an insight into getting started and setting up you're Joomla 1.6 site for search engines.

The first component you need to install is XMap

Xmap is a Site map generator component for Joomla. Xmap allows you to create a map of your site using the structure of your menus. Some of Xmap's features are:
* Capability to create more than one sitemap with different preferences for each sitemap.
* Generation of XML sitemaps compatible with Google, Yahoo, Bing and others.
* Cache system to allow a fastest sitemap generation. Ideally for large or high traffic sites. You can enable or disable this feature independently for each sitemap.
* Exclude easily any menu item from your site map directly from the frontend
* Option to compress the XML sitemap
* Better presentation of the XML sitemap on browsers.
* Compatibility with Joomla 1.5 and Joomla 1.6
* You can specify the priority and change frequency params for each menu and now for every item in your site map.
* You can change the priority and change frequency for every item in your sitemap.
* Shows some statistical information for each sitemap:
o Las visit date.
o Number of links generated on the last visit.
o Number of visits.
* There is available a lot of plugins for the most popular components: Zoom, DOCman, VirtueMart, Fireboard, SMF, Hot Property, SOBI2, Mosets Tree, MyBlog, RSG and many others.
* Customization for each extension.

For joomla users the text file is generated automatically.

robots.txt file generator