編輯“WordPress:Search Engine Optimization for Wordpress”（章節(jié)）

==Robots.txt 優(yōu)化==
搜索引擎讀取一個(gè)yourserver.com/robots.txt 文件來(lái)獲得關(guān)于它們是否應(yīng)該被查找和到哪查找的信息。

指定搜索引擎在高級(jí)目錄中到哪里查找內(nèi)容，或者可以擴(kuò)大站點(diǎn)范圍的文件，還有受[http://www.google.com/support/webmasters/bin/answer.py?answer=35769 Google] 和其他搜索引擎推薦的東西。

例如 [http://www.askapache.com/seo/updated-robotstxt-for-wordpress.html WordPress robots.txt] 文件:
<pre>
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /feed
Disallow: /comments
Disallow: /category/*/*
Disallow: */trackback
Disallow: */feed
Disallow: */comments
Disallow: /*?*
Disallow: /*?
Allow: /wp-content/uploads

# Google Image
User-agent: Googlebot-Image
Disallow:
Allow: /*

# Google AdSense
User-agent: Mediapartners-Google*
Disallow:
Allow: /*

# Internet Archiver Wayback Machine
User-agent: ia_archiver
Disallow: /

# digg mirror
User-agent: duggmirror
Disallow: /

Sitemap: http://www.askapache.com/sitemap.xml
</pre>


===參見(jiàn):===
* [http://wordpress.org/extend/plugins/kb-robotstxt/ WordPress KB Robots.txt 插件]
* [http://www.google.com/support/webmasters/bin/topic.py?topic=8843 Google如何查找我的網(wǎng)站]
* [http://www.google.com/support/webmasters/bin/answer.py?answer=40360 我如何使用 robots.txt 文件控制對(duì)我站點(diǎn)的訪問(wèn)?]
* [http://www.askapache.com/seo/seo-with-robotstxt.html 在SEO 中使用robots.txt ]
* [http://www.markwilson.co.uk/blog/2007/04/removing-duplicate-search-engine-content-using-robotstxt.htm 使用robots.txt移除搜索引擎副本]
* [http://www.robotstxt.org/wc/robots.html 網(wǎng)頁(yè)機(jī)器人頁(yè)面]
* [http://en.wikipedia.org/wiki/Robots.txt wikipedia - Robots.txt]