Posting in the Magento forums has been disabled pending the implementation of a new and improved forum solution which should better serve the community.

For new questions please post at magento.stackexchange.com, the community-run support site for the Magento community. We will be providing updates on the new forum solution soon. For questions or concerns please email community@magento.com.

Magento Forum

Help Please ! 
 
fannychou
Jr. Member
 
Total Posts:  1
Joined:  2011-03-10
 

The problem is about robots.txt of my site, which was built by Magento. Three days ago, I created a robot.txt file for my site and uploaded it in the right directory, but today when I checked the Crawl Status of my site in google webmaster account, I found googlebot haven\’t crawled my site since that day when I uploaded the robots.txt file. I don\’t know why, anyone can help me ? thanks.

This is my robots.txt file:

User-agent: *
Disallow: /index.php/
Disallow: /*?
Disallow: /*.js$
Disallow: /*.css$
Disallow: /checkout/
Disallow: /tag/
Disallow: /catalogsearch/advanced/
Disallow: /review/
Disallow: /app/
Disallow: /downloader/
Disallow: /js/
Disallow: /lib/
Disallow: /media/
Disallow: /*.php$
Disallow: /pkginfo/
Disallow: /report/
Disallow: /skin/
Disallow: /var/
Disallow: /catalog/
Disallow: /customer/

 
Magento Community Magento Community
Magento Community
Magento Community
Magento Community
Magento Community
Back to top