Posting in the Magento forums has been disabled pending the implementation of a new and improved forum solution which should better serve the community.

For new questions please post at magento.stackexchange.com, the community-run support site for the Magento community. We will be providing updates on the new forum solution soon. For questions or concerns please email community@magento.com.

Magento Forum

SEO for Magento
 
Bhanup
Jr. Member
 
Total Posts:  13
Joined:  2010-11-11
 

Hello,

Everyone is looking for the SEO for Magento, when you upload a Google webmaster file in your server and after that see the results in Webmaster tools, “OHHO” What is this, You will find a huge list of Duplicate content, a big list of Pages with duplicate description. 

I searched and checked too many extension available on the net, some extension change the title, description, blablablabalabalabalaaaaaaaaaaaa but I think going with such extensions are not so useful.

Then I just block the Robots to crawl all the unnecessary URL’s.

Just Think you have blocked the Robots not to Crawl unnecessary URL and that’s you want.

here is the Code

User-agent: *

Allow: /*?p=
Allow: /index.php/blog/
Allow: /catalog/seo_sitemap/category/
Allow:/catalogsearch/result/
Disallow: /404/
Disallow: /app/
Disallow: /cgi-bin/
Disallow: /downloader/
Disallow: /includes/
Disallow: /js/
Disallow: /lib/
Disallow: /magento/
Disallow: /media/
Disallow: /pkginfo/
Disallow: /report/
Disallow: /skin/
Disallow: /stats/
Disallow: /var/

Disallow: /index.php/
Disallow: /catalog/product_compare/
Disallow: /catalog/category/view/
Disallow: /catalog/product/view/
Disallow: /catalogsearch/
Disallow: /checkout/
Disallow: /control/
Disallow: /contacts/
Disallow: /customer/
Disallow: /customize/
Disallow: /newsletter/
Disallow: /poll/
Disallow: /review/
Disallow: /sendfriend/
Disallow: /tag/
Disallow: /wishlist/

Disallow: /cron.php
Disallow: /cron.sh
Disallow: /error_log
Disallow: /install.php
Disallow: /LICENSE.html
Disallow: /LICENSE.txt
Disallow: /LICENSE_AFL.txt
Disallow: /STATUS.txt

# Paths (no clean URLs)
Disallow: /*.js$
Disallow: /*.css$
Disallow: /*.php$
Disallow: /*?p=*&
Disallow: /*?SID=

 
Magento Community Magento Community
Magento Community
Magento Community
 
prateekgupta
Guru
 
Avatar
Total Posts:  541
Joined:  2010-06-04
India
 

magento Yoast extension is also very good for SEO purposes. It do help.

 
Magento Community Magento Community
Magento Community
Magento Community
 
nathan040
Jr. Member
 
Total Posts:  1
Joined:  2013-06-23
 

Nice! Thanks for providing me such a nice information related to magento website SEO. I really appreciate your work.

 
Magento Community Magento Community
Magento Community
Magento Community
 
alexloxton
Jr. Member
 
Total Posts:  1
Joined:  2013-07-15
 

You can try this out

http://www.magentocommerce.com/magento-connect/robots-txt.html

or use search for it in google you can get many of them.

 
Magento Community Magento Community
Magento Community
Magento Community
 
JohnMoss
Jr. Member
 
Total Posts:  1
Joined:  2013-09-10
 

blogging with john chow review

 
Magento Community Magento Community
Magento Community
Magento Community
 
Thomas1201
Jr. Member
 
Total Posts:  6
Joined:  2013-09-04
 

You can try this extension: http://www.magestore.com/magento-seo-extension.html

 
Magento Community Magento Community
Magento Community
Magento Community
 
TemplateStudio
Jr. Member
 
Avatar
Total Posts:  9
Joined:  2013-03-10
Milton Keynes
 

Yeah, we use similar robots.txt records...it works nicely(tested on a few clients).
Don’t see a point of installing extra extension for robots.txt extensions (especially if you want to block the spiders you can do it from magento admin System > Configuration > Design > HTML Head)

Best,
Nick

 
Magento Community Magento Community
Magento Community
Magento Community
 
britnigoetzk
Jr. Member
 
Total Posts:  2
Joined:  2013-09-17
 

Hi,

Maybe Advanced Product Feeds it’s right choice for you http://mirasvit.com/magento-extensions/advanced-product-feeds-generator.html
Tried it and was pleased. Very simple and effective

 
Magento Community Magento Community
Magento Community
Magento Community
 
lavender74
Jr. Member
 
Total Posts:  1
Joined:  2013-09-19
 

Thanks for useful information you sharing. For me its a great information. I have just bookmarked your site and waiting for your next post. Really Nice Post...........Thanks You

 
Magento Community Magento Community
Magento Community
Magento Community
Magento Community
Magento Community
Back to top