Magento

eCommerce Software for Online Growth

Magento Forum

From setting up your store to managing your products, pages and promotions to generating detailed reports, the Magento User Guide empowers the user to utilize the platform for all of its vast capacity.
Available in eBook and Print formats – Download Now!!!
   
Duplicate Content Problem
 
matt5409
Jr. Member
 
Total Posts:  15
Joined:  2008-12-22
 

i am very sceptical about this duplicate content thing. surely enhancing your internal linking to improve user experience will not cause problems with google - it might even add weight to your site. sometimes, you CAN’T help but put a product in more than one category. i don’t buy this duplicate content thing - as long as doing it is justified and you’re not artificially trying to improve rank

 
Magento Community Magento Community
Magento Community
Magento Community
 
Joachim
Sr. Member
 
Avatar
Total Posts:  132
Joined:  2008-01-23
Netherlands
 

Instead of using Robots.txt you can use a tag since yesterday. Google, Yahoo and Microsoft have just announced a new tag, which we can use to tell the search engines which URL it should have for the current page. See also Canonincal URLs at Yoast

There is Magento Module to add this tag to your head.

 
Magento Community Magento Community
Magento Community
Magento Community
 
Mike Smullin
Jr. Member
 
Avatar
Total Posts:  23
Joined:  2008-10-25
Eagle Mountain, Utah
 

I came up with a patch to Magento core that works as an alternative solution to get it the way everyone [including me] seems to want.
Check it out here and let me know how it works for you:

Use Categories in Product URLs for Magento SEO without Duplicate Content
http://www.mikesmullin.com/development/use-categories-product-urls-magento-seo-without-duplicate-content/

 
Magento Community Magento Community
Magento Community
Magento Community
 
quanza
Sr. Member
 
Avatar
Total Posts:  97
Joined:  2008-12-02
Tokyo, Japan
 

BUMP - can *anyone* at Magento at least give us a hint as to whether this issue is being looked into??

 
Magento Community Magento Community
Magento Community
Magento Community
 
jonas73
Member
 
Total Posts:  62
Joined:  2009-04-24
 

does anyone knowthis problem has been solved?
Thanks

 
Magento Community Magento Community
Magento Community
Magento Community
 
pharmokan
Sr. Member
 
Avatar
Total Posts:  136
Joined:  2009-04-12
 

no wonder i never see magento pages on the first page of google.  ever

 Signature 

modern furniture

 
Magento Community Magento Community
Magento Community
Magento Community
 
eliteeternity
Member
 
Avatar
Total Posts:  74
Joined:  2008-07-16
 

bump, bump, bump, bump, bump.

 
Magento Community Magento Community
Magento Community
Magento Community
 
Nightfly
Guru
 
Avatar
Total Posts:  310
Joined:  2008-11-26
Dortmund, Germany
 

@pharmokan: There are Magento sites on the first google result page.
@all:

Joachim - 13 February 2009 01:38 AM

Instead of using Robots.txt you can use a tag since yesterday. Google, Yahoo and Microsoft have just announced a new tag, which we can use to tell the search engines which URL it should have for the current page. See also Canonincal URLs at Yoast

There is Magento Module to add this tag to your head.

This fixes the duplicate content issue.

 
Magento Community Magento Community
Magento Community
Magento Community
 
botc
Member
 
Total Posts:  38
Joined:  2009-05-16
 

Is it just me, or does this only fix this scenario:

product.html
product-html?utmsource=twitter
product-html?SID0303940

and not:

product.html
catalog/product.html

(same product)
??

Can this be used on a page like yourshop.com/product.html - and tell it the url should have been yourshop.com/catalog/product.html?

 
Magento Community Magento Community
Magento Community
Magento Community
 
Nightfly
Guru
 
Avatar
Total Posts:  310
Joined:  2008-11-26
Dortmund, Germany
 

It fixes the second class:

“product.html
catalog/product.html”

The first class is not a problem at all. Google is pretty clear about this matter: URLs with query strings with only slight differences in content are not detrimental to the page-rank of the individual pages.

 
Magento Community Magento Community
Magento Community
Magento Community
 
kudosmi
Jr. Member
 
Total Posts:  1
Joined:  2009-10-05
 

Hi,Any further updates on this thread? Hope to see more replies one of these days,especially feedbacks from the thread starter. Seems like this thread has been inactive for a while…

Regards,
kudosmi
Prêt travaux

 
Magento Community Magento Community
Magento Community
Magento Community
 
allianceetrading
Jr. Member
 
Total Posts:  13
Joined:  2009-09-27
 

Anyone have any luck with this? :(

 Signature 

MexicanPantry.com / / Alliance eTrading

 
Magento Community Magento Community
Magento Community
Magento Community
 
jshpro2
Sr. Member
 
Avatar
Total Posts:  197
Joined:  2008-12-30
Florida
 
Nightfly - 12 July 2009 04:04 PM

It fixes the second class:

“product.html
catalog/product.html”

The first class is not a problem at all. Google is pretty clear about this matter: URLs with query strings with only slight differences in content are not detrimental to the page-rank of the individual pages.

You are very wrong and I have the answer you are all seeking. Everyone worried about duplicate content needs to watch this video.
http://www.youtube.com/watch?v=Cm9onOGTgeM&feature;=player_embedded

He specifically points to “open source ecommerce systems"… that ... “serve different versions of pages with different urls that only differ by content sorting direction” ( remind you of a certain… Magento? ) Magento also serves duplicate content with grid/list view.

Luckily they came out with a canonical link *element* (Matt’s emphasis). I am very busy so I don’t know if I have the time, and someone will likely implement this plugin for you guys.

Ideally, a properly SEOd system, would use POST not GET for those parameters who’s values caused the page to differ only in presentation. Magento uses GET paramaters (that is, the values are passed as part of the request URI, and thus not canonical)

Magento should have been thinking about your store’s markup as a semantic structure, and not using the markup itself for presentation. (grid/list view should be a simple CSS swap via javascript, not an entirely distinct page.)

 Signature 

Extensions
FREE Vehicle Fits (year/make/model) | Misc. Automotive Extensions | RMA Support For Magento

 
Magento Community Magento Community
Magento Community
Magento Community
 
Faminor
Jr. Member
 
Total Posts:  2
Joined:  2010-01-02
 

I am not sure why everyone ignored Mike Smullin’s post #33, but it solved the problem for me to the full extent. Through this I got the breadcrumbs, titles and navigation fixed. Before, if I entered the product page from search results or from a higher level category listing, Magento displayed incomplete breadcrumbs and url’s.

I believe, however, that the file in my Magento install differed from the file in the post. Also, if you don’t understand the diff files, just try to do this:

go to app/code/core/Mage/Catalog/Model/Resource/Eav/Mysql4/Product/Collection.php

find this piece of code (in my revision it is line #825):

$select = $this->getConnection()->select()
->from($this->getTable(’core/url_rewrite’), array(’product_id’, ‘request_path’))
->where(’store_id=?’, Mage::app()->getStore()->getId())
->where(’is_system=?’, 1)
->where(’category_id=? OR category_id is NULL’, $this->_urlRewriteCategory)
->where(’product_id IN(?)’, $productIds)
->order(’category_id DESC’); // more priority is data with category id
$urlRewrites = array();

and replace it all with:

$select = $this->getConnection()->select()
->from($this->getTable(’core/url_rewrite’), array(’product_id’, ‘request_path’))
->where(’store_id=?’, Mage::app()->getStore()->getId())
->where(’is_system=?’, 1)
// excluding this clause to facilitate one URL per product, and one that includes the category
// if a product has multiple categories, the first one (by category_id) will be used
// in most cases you’ll probably only have one category because you only want one page per product for SEO reasons
// for maximum link juice, no possibility of duplicate content, and a less confusing store
// ->where(’category_id=? OR category_id is NULL’, $this->_urlRewriteCategory)
->where(’product_id IN(?)’, $productIds)
->order(’category_id DESC’); // more priority is data with category id
$urlRewrites = array();

For more check this out:
http://www.mikesmullin.com/development/use-categories-product-urls-magento-seo-without-duplicate-content/

 
Magento Community Magento Community
Magento Community
Magento Community
 
Senetor
Sr. Member
 
Avatar
Total Posts:  168
Joined:  2009-03-26
Denmark
 
Faminor - 02 January 2010 02:30 PM

For more check this out:
http://www.mikesmullin.com/development/use-categories-product-urls-magento-seo-without-duplicate-content/

I would love to see this, but can’t access site, get a

Forbidden

You don’t have permission to access /development/use-categories-product-urls-magento-seo-without-duplicate-content/ on this server.

Apache/2.2.3 (CentOS) Server at www.mikesmullin.com Port 80

 
Magento Community Magento Community
Magento Community
Magento Community
Magento Community
Magento Community
    Back to top
 
© Copyright 2010 Magento Inc.
Privacy Policy|Terms of Service
Magento Community Count
194423 users|749 users currently online|363837 forum posts