This plugin helps you to create and manage a robots.txt file.
Robots.txt file can have a great influence on SEO blog. By excluding “useless” (for search engines) files from crawling, you can increase your Wordpress blog’s traffic and search engine rankings
An example of SEO optimized robots.txt file (should work on most blogs… just edit the sitemap URL):
User-agent: *
Disallow: /cgi-bin/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/User-Agent: Mediapartners-Google
Allow: /User-Agent: Adsbot-Google
Allow: /User-Agent: Googlebot-Image
Allow: /User-Agent: Googlebot-Mobile
Allow: /Sitemap: http://freebloggerskill.net/sitemap.xml
When robots (like the Googlebot) crawl your site, they begin by requesting http://freebloggerskill.net/robots.txt and checking it for special instructions. Use this plugin to create and edit your robots.txt file from within Wordpress (using Options -> Robots.txt).
No comments:
Post a Comment