Magento Forum

What is the best/fast way to solve duplicate content issue
 
raym0nd
Member
 
Total Posts:  45
Joined:  2010-06-23
 

Hi,

In SEO point of view, it detect the following as duplicate contents:
http://www.domain.com/store/category/subcategory/productA
http://www.domain.com/store/category/productA
http://www.domain.com/store/productA

What is the best/fast way to solve this issue without modifying the core codes?

Currently I am using .htaccess method by redirecting all duplicate URL to this format: http://www.domain.com/store/category/subcategory/productA

I saw some people suggested Yoast modules, anyone tried before? The rating does not seems good though.

Please advise.

Thanks

 
Magento Community Magento Community
Magento Community
Magento Community
 
nChannel
Guru
 
Avatar
Total Posts:  329
Joined:  2012-02-28
 

The main product is housed at http://www.domain.com/store/productA correct? The other category and sub category routes are just ways to navigate there but the main page is at http://www.domain.com/store/productA I assume. If that\’s the case, you can use a rel=canonical tag on the other pages to point to this page: http://www.domain.com/store/productA.

 
Magento Community Magento Community
Magento Community
Magento Community
 
raym0nd
Member
 
Total Posts:  45
Joined:  2010-06-23
 
nChannel - 25 April 2013 07:01 AM

The main product is housed at http://www.domain.com/store/productA correct? The other category and sub category routes are just ways to navigate there but the main page is at http://www.domain.com/store/productA I assume. If that\’s the case, you can use a rel=canonical tag on the other pages to point to this page: http://www.domain.com/store/productA.

The product can be housed in http://www.domain.com/store/category/subcategory/productA and can be accessed via http://www.domain.com/store/category/productA and http://www.domain.com/store/productA

I wish to redirect all the URLs to http://www.domain.com/store/category/subcategory/productA so that user are aware of the categories and the breadcrumb will be shown in the page correctly.

Can I still use the rel link for this scenario and how should I go about doing that?

 
Magento Community Magento Community
Magento Community
Magento Community
 
raym0nd
Member
 
Total Posts:  45
Joined:  2010-06-23
 
VanquishTech - 25 April 2013 07:53 AM

Switch off the category url prefixing and prefix the keywords manually to the product, you then only have one product reference across the whole site. We use an external PIM to automate this but the manual methods works the same only it takes longer, you could also create a script to do the same thing, that would not take too long. Simplicity is the key.

I need the category to be displayed in the URLs. What type of external PIM do you used?

 
Magento Community Magento Community
Magento Community
Magento Community
 
raym0nd
Member
 
Total Posts:  45
Joined:  2010-06-23
 
Monty22 - 25 April 2013 07:21 AM

Hi,

We all know that having quality and unique content is very much important to rank well in search engines. In such a situation, if your ecommerce website provides duplicate content then it can be penalized by search engines.

Following are duplicate content issues which you may face in your Magento Website:

1) Duplicate content from dynamic filter pages

Most of the Magento users face technical issues as regards to dynamic filter pages. Due to these dynamic pages, website owners often find that thousands of pages have been indexed by search engines.

Example of a dynamic filter page:

/men-shoes?manufacturer=174&price;_band=978



Such pages are usually used on category pages to filter product results.

Solution:

This issue can be eliminated by using Meta robots rules. Following are the steps involved:

Take out the query strings which you want to remove
Create and apply meta robots rules i.e. noindex, follow or noindex, nofollow
Send URL removal requests via Google Webmaster Tools

Note: Make sure your website is added and verified in Google Webmaster Tools Account.


2) Duplicate content from Search Pages

Most of the websites provide “Search” option for their users. Although it is a good option from user perspective, however search pages in Magento also causes duplicate content issues as these pages also find their way into Google’s index.

Solution:

This issue can be resolved by using robots.txt file in which you just need to disallow the search directory. In Magento, usually the URL structure of search pages looks like ‘/catalogsearch/result/?q=product1’. So, disallow /catalogsearch/ in robots.txt file. After this, send URL Removal request in Webmaster Tools in order to eliminate already indexed pages in Google.



3) Duplicate content from Pagination

In order to solve the duplicate content issue from pagination it is suggested to use specific tags such as rel=next, prev, and all so as to show search engines that these pages are in pagination.

Hope this will help you!

Thanks

Monty
iLoveMage

Get flat 25% discount on all our Magento Extensions.

Thanks, will explore on that.

 
Magento Community Magento Community
Magento Community
Magento Community
 
ScommerceMage
Sr. Member
 
Avatar
Total Posts:  103
Joined:  2013-12-27
United Kingdom
 

Hi Guys,

This plugin is must have for resolving duplicate content issue for all Magento stores

http://www.scommerce-mage.co.uk/magento-extensions/magento-seo-catalog-urls.html

Here are the main features of this module-:

- One primary category for products which are there in multiple categories

- Permanent redirects (301) if you explicitly remove category path from the URL

- Permanent redirects (301) if you explicitly add non-primary category in the URL

- Primary category will be used in the URL for each and every section of the store including cross sells, up sells, relative products, basket link, search, advance search etc.

- It also resolves duplicate content issue problem for your site as search engines will find one unique url for each product instead of multiple urls

- This module can be completely disabled whenever required via system configuration in admin

Along with the above we would also recommend to use the following module -:

http://www.scommerce-mage.co.uk/magento-extensions/google-friendly-layered-navigation.html

Combination of both the above module will take away duplicate content issue from your Magento site.

Kind Regards
Scommerce Mage

 
Magento Community Magento Community
Magento Community
Magento Community
 
jhzdt01
Jr. Member
 
Total Posts:  3
Joined:  2014-02-09
 

I wouldn’t pay too much attention to the rant above.
cheap fifa 14 coins
fifa 14 coins

 
Magento Community Magento Community
Magento Community
Magento Community
 
Amasty
Mentor
 
Avatar
Total Posts:  3988
Joined:  2009-11-10
 
raym0nd - 25 April 2013 03:39 AM

Hi,

In SEO point of view, it detect the following as duplicate contents:
http://www.domain.com/store/category/subcategory/productA
http://www.domain.com/store/category/productA
http://www.domain.com/store/productA

What is the best/fast way to solve this issue without modifying the core codes?

Currently I am using .htaccess method by redirecting all duplicate URL to this format: http://www.domain.com/store/category/subcategory/productA

I saw some people suggested Yoast modules, anyone tried before? The rating does not seems good though.

Please advise.

Thanks

Hello,

if you need to avoid duplicate content in product URLs, then the Unique Product URL extension is what you are looking for. With the module you’ll be able to set one URL for each product placed in multiple categories - it means that the product will remain accessible from any category it’s added to, but the product’s URL will remain the same. This will help to combat duplicate content and help search engines better index your store pages.

 
Magento Community Magento Community
Magento Community
Magento Community
 
FmeAddons
Sr. Member
 
Avatar
Total Posts:  123
Joined:  2014-01-15
USA
 

Use this FREE Canonicals URL extension. It will automatically add canonical tags in product URL and resolve the duplication issue, The store manager can set the preferred URL from SEO meta option of each product. Canonical tags will be add on all other URL variations to transfer link juice to one URL and make it rank higher in Google Search Results.

 
Magento Community Magento Community
Magento Community
Magento Community
Magento Community
Magento Community
Back to top