Call-back icon  Sales: Call 877.832.5289 (N America)|310.295.4144 (International)

Magento

eCommerce Software for Online Growth

Magento Forum

   
Page 3 of 3
Duplicate URLs - extent of the issue and partial, temporary resolution
 
pixelpusher
Member
 
Avatar
Total Posts:  62
Joined:  2008-04-23
SoCal
 


As I stated before. Turn on category names in URLs and look at ANY of these
New Products
Featured Products
Recently Viewed Products
Related Products
Compare Products
You may also be interested in…

Or even the product sitemap…

They won’t include the category name in the URL.

Sorry I had misunderstood you on this one. You are correct - I thought you were talking about with category urls off.

Correct me if I’m wrong but if this were fixed then there would be no way to navigate to the duplicate URLs (and with robots.txt you could not index filtered navigation and not really lose any hits? )

 
Magento Community Magento Community
Magento Community
Magento Community
 
hyteckit
Sr. Member
 
Avatar
Total Posts:  152
Joined:  2008-04-01
Los Angeles, CA
 

pixelpusher,

If your product was in 2 different categories, which category would your breadcrumb show if your product was found through Google or by using the search function of your website?

 Signature 

Current Project:
GeekGears.com - Accessories for your iPod, iPhone, MP3 Players, Cell Phone, PDA, GPS Devices, Digital Camera, and more.
Extension: Product Gallery Importer, Enhanced Search

 
Magento Community Magento Community
Magento Community
Magento Community
 
hyteckit
Sr. Member
 
Avatar
Total Posts:  152
Joined:  2008-04-01
Los Angeles, CA
 
pixelpusher - 22 August 2008 09:40 AM

Correct - i am afraid that is how it works for now - to avoid duplicate urls pointing to the same product you need to remove category names from the url.

Has anyone looked into a temporary workaround to append categories to the URLs? Maybe turn off the category URL names then just append the category names to the link code?

I thought the whole point was to avoid duplicate content?  Why would you want to append categories to the URLs that points to the same product?  You would be creating duplicate content where 2 different URLs are pointing to the same product page.

 Signature 

Current Project:
GeekGears.com - Accessories for your iPod, iPhone, MP3 Players, Cell Phone, PDA, GPS Devices, Digital Camera, and more.
Extension: Product Gallery Importer, Enhanced Search

 
Magento Community Magento Community
Magento Community
Magento Community
 
elmbrook
Jr. Member
 
Total Posts:  2
Joined:  2008-08-16
 

Where in admin does one turn off categories?  I do not find anything under the Category tab in the Demo.

 
Magento Community Magento Community
Magento Community
Magento Community
 
pixelpusher
Member
 
Avatar
Total Posts:  62
Joined:  2008-04-23
SoCal
 

to clarify I want products to show up in both the main category and sub-category BUT the url link in both views should be to it’s respective sub-category URL and therefor sub-category breadcrumb.

IF this were the case AND the sitemap, recently viewed products, etc also pointed to the sub-category URLs, there would be no duplicate views or products....

 
Magento Community Magento Community
Magento Community
Magento Community
 
joyously
Guru
 
Total Posts:  357
Joined:  2008-08-21
 
pixelpusher - 29 August 2008 01:08 PM

to clarify I want products to show up in both the main category and sub-category BUT the url link in both views should be to it’s respective sub-category URL and therefor sub-category breadcrumb.

IF this were the case AND the sitemap, recently viewed products, etc also pointed to the sub-category URLs, there would be no duplicate views or products....

I don’t quite follow your thinking here. If you include the category or subcategory in the product URL, you get multiple URLs for the same product page.
I turned category names OFF and refreshed indexes and catalog rewrites just to be sure (I have all cache off), and then navigated to a page using the top menu and choosing a subcategory. All the products listed included the category and subcategory in the URL. But the Recently Viewed, the sitemap, and the New Products on the home page all show the product URL with no category names.  Seems like the only problem is the URLs in the category list.

What puzzles me is that it seems opposite to what you are saying it should be.

Edit: Maybe I should clarify that I have my categories set to Anchor and show products. So I can see the same product whether I go to the category or the subcategory.  That means that product will have two URLs to the same product page, which is what you are saying you want.

 
Magento Community Magento Community
Magento Community
Magento Community
 
Business Feet
Member
 
Total Posts:  58
Joined:  2008-05-24
 
elmbrook - 22 August 2008 06:02 PM

Where in admin does one turn off categories?  I do not find anything under the Category tab in the Demo.

system > configuration > catalog > search engine optimizations (Use categories path for product URLs) should say NO

 Signature 

Content Management Solutions ::  SEO - Search engine optimisation ::  Internet Marketing Services ::  Affordable Web Hosting

 
Magento Community Magento Community
Magento Community
Magento Community
 
Business Feet
Member
 
Total Posts:  58
Joined:  2008-05-24
 

The only change i would make to the robots.txt file suggested earlier would be to

Change
Disallow: /catalogsearch/

TO Disallow: /catalogsearch/advanced/

and Add
Allow: /catalogsearch/result/?q

Apart from that there’s not much else you can do with magento that hasn’t already been mentioned to make your site more seo friendly

 Signature 

Content Management Solutions ::  SEO - Search engine optimisation ::  Internet Marketing Services ::  Affordable Web Hosting

 
Magento Community Magento Community
Magento Community
Magento Community
 
joyously
Guru
 
Total Posts:  357
Joined:  2008-08-21
 
Business Feet - 12 October 2008 09:18 AM

The only change i would make to the robots.txt file suggested earlier would be to

Change
Disallow: /catalogsearch/

TO Disallow: /catalogsearch/advanced/

and Add
Allow: /catalogsearch/result/?q

Apart from that there’s not much else you can do with magento that hasn’t already been mentioned to make your site more seo friendly

Isn’t the default “Allow” and it’s not part of the standard to put it in the file?

And there is a lot more to be done to make Magento more SEO. The default template is really bad. The use of h1 and h2 should be changed and the menu should be after the actual page content.  There is very little content and a whole lot of markup. That could change. Also a better way to put nofollow on links would be nice.

 
Magento Community Magento Community
Magento Community
Magento Community
 
Business Feet
Member
 
Total Posts:  58
Joined:  2008-05-24
 
joyously - 05 November 2008 10:19 AM

Business Feet - 12 October 2008 09:18 AM
The only change i would make to the robots.txt file suggested earlier would be to

Change
Disallow: /catalogsearch/

TO Disallow: /catalogsearch/advanced/

and Add
Allow: /catalogsearch/result/?q

Apart from that there’s not much else you can do with magento that hasn’t already been mentioned to make your site more seo friendly

Isn’t the default “Allow” and it’s not part of the standard to put it in the file?

And there is a lot more to be done to make Magento more SEO. The default template is really bad. The use of h1 and h2 should be changed and the menu should be after the actual page content.  There is very little content and a whole lot of markup. That could change. Also a better way to put nofollow on links would be nice.

You are of course right about the work needed on the templating side grin

As for the robots file, i have aspects disallowed which preceed parts that i wish to allow, hence the allow directive

 Signature 

Content Management Solutions ::  SEO - Search engine optimisation ::  Internet Marketing Services ::  Affordable Web Hosting

 
Magento Community Magento Community
Magento Community
Magento Community
 
joyously
Guru
 
Total Posts:  357
Joined:  2008-08-21
 
Business Feet - 26 November 2008 02:40 PM

You are of course right about the work needed on the templating side grin

As for the robots file, i have aspects disallowed which preceed parts that i wish to allow, hence the allow directive

Read the robots.txt standard, what there is of it. It does not mention an “Allow” keyword and wildcards are not supported. Some robots, however, do support more than the standard. Google, for one, but the order is unimportant.

 
Magento Community Magento Community
Magento Community
Magento Community
 
Business Feet
Member
 
Total Posts:  58
Joined:  2008-05-24
 
joyously - 28 November 2008 06:38 AM

Read the robots.txt standard, what there is of it. It does not mention an “Allow” keyword and wildcards are not supported. Some robots, however, do support more than the standard. Google, for one, but the order is unimportant.

Well there you have it, think about what you’ve just said and ask yourself why i have allow directives in my robots.txt file.

 Signature 

Content Management Solutions ::  SEO - Search engine optimisation ::  Internet Marketing Services ::  Affordable Web Hosting

 
Magento Community Magento Community
Magento Community
Magento Community
Magento Community
Magento Community
    Back to top
Page 3 of 3
 
Sales: Call 877.832.5289 (North America) 310.295.4144 (International)
© Copyright 2008 Varien. Magento, eCommerce software, is a trademark of Irubin Consulting Inc. DBA Varien
Privacy Policy|Terms of Service
Magento Community Count
53171 users|759 users currently online|107193 forum posts