How to remove Duplicate URLs???

Discuss Search Engine Optimization in relation to Joomla! 3.x. This forum will also have discussions on SEF/SEO Joomla! 3.x extensions.

Moderator: General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Windows Defender SmartScreen Issues <-- please read this if using Windows 10.
Locked
User avatar
boss_3
Joomla! Intern
Joomla! Intern
Posts: 80
Joined: Fri Apr 16, 2010 6:50 am
Location: Cairo, Egypt
Contact:

How to remove Duplicate URLs???

Post by boss_3 » Thu Oct 22, 2015 9:13 pm

Hello: I have a problem with links and how google is catching them!
Google says that my website has some Duplicate meta descriptions,
and when I check the URLs leading to the same article I find sometimes strange paths!!
EXample:
http://egyptfuntours.com/149-egypt-fun- ... -and-cairo
http://egyptfuntours.com/egypt-travel-e ... -and-cairo

those two are pointing to the a\same article. I deleted the article and lost one link, but there is still one link pointing to the same article which is already deleted. I feel it is still stored in the database, but I need help on how to get red of such URLs... please someone help me.
Happy are those who dream dreams and are ready to pay the price to make them come true.
http://egyptfuntours.com

User avatar
Per Yngve Berg
Joomla! Master
Joomla! Master
Posts: 30926
Joined: Mon Oct 27, 2008 9:27 pm
Location: Romerike, Norway

Re: How to remove Duplicate URLs???

Post by Per Yngve Berg » Fri Oct 23, 2015 8:45 am

Mod. Note: Relocated the topic to the SEO J3.x forum.

User avatar
boss_3
Joomla! Intern
Joomla! Intern
Posts: 80
Joined: Fri Apr 16, 2010 6:50 am
Location: Cairo, Egypt
Contact:

Re: How to remove Duplicate URLs???

Post by boss_3 » Fri Oct 23, 2015 12:33 pm

I was very cautious on choosing the right forum to post my topic, however, I did post it in the wrong forum.
I have installed canonical plugin, but it did not help!
This kind of problems started to appear after upgrading from joomla 2 to joomla 3.
Happy are those who dream dreams and are ready to pay the price to make them come true.
http://egyptfuntours.com

User avatar
AndresNWD
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 176
Joined: Thu Sep 06, 2012 1:45 pm
Location: Granada-Spain
Contact:

Re: How to remove Duplicate URLs???

Post by AndresNWD » Fri Oct 23, 2015 1:20 pm

There shouldn't be any problems with those if you have marked the duplicate ones as canonicals of the one you chose to be the original (the ones with more backlinks I would say)

If you need an extension to handle canonicals, I suggest sh404sef http://extensions.joomla.org/extensions ... f/sh404sef
I work at
http://www.component-creator.com - Easy Joomla MVC development
http://www.neno-translate.com - The complete translation solution for Joomla

User avatar
boss_3
Joomla! Intern
Joomla! Intern
Posts: 80
Joined: Fri Apr 16, 2010 6:50 am
Location: Cairo, Egypt
Contact:

Re: How to remove Duplicate URLs???

Post by boss_3 » Fri Oct 23, 2015 3:26 pm

I have installed and enabled sh404sef. I left most of the features as it is in the default mode.
in the URL manager I found some items with more than one URL, but the sh404sef is marking one as Main without me doing it. Do I still have to make something with it?.....
Happy are those who dream dreams and are ready to pay the price to make them come true.
http://egyptfuntours.com

User avatar
boss_3
Joomla! Intern
Joomla! Intern
Posts: 80
Joined: Fri Apr 16, 2010 6:50 am
Location: Cairo, Egypt
Contact:

Re: How to remove Duplicate URLs???

Post by boss_3 » Fri Oct 23, 2015 3:27 pm

Links are broken!!
without the .haccess, all the links are broken
with the .haccess, All links are working properly
????
Happy are those who dream dreams and are ready to pay the price to make them come true.
http://egyptfuntours.com

User avatar
Per Yngve Berg
Joomla! Master
Joomla! Master
Posts: 30926
Joined: Mon Oct 27, 2008 9:27 pm
Location: Romerike, Norway

Re: How to remove Duplicate URLs???

Post by Per Yngve Berg » Fri Oct 23, 2015 8:33 pm

SEF Rewrite does not work without the .htaccess.

benedictford
I've been banned!
Posts: 19
Joined: Wed Oct 21, 2015 3:00 pm
Contact:

Re: How to remove Duplicate URLs???

Post by benedictford » Fri Oct 23, 2015 10:17 pm

I dont understand why you want to get rid of htaccess?

User avatar
boss_3
Joomla! Intern
Joomla! Intern
Posts: 80
Joined: Fri Apr 16, 2010 6:50 am
Location: Cairo, Egypt
Contact:

Re: How to remove Duplicate URLs???

Post by boss_3 » Tue Oct 27, 2015 8:44 pm

""without .haccess file"" is just an option is sh404sef extension.
--------------------------------------------------------------------------
Using sh404sef caused the search component stop working, it might be a good solution for duplicated URLs, but it causes problems!!
I do not like it when i install extensions to solve a specific problem and then the new extension makes new problems and push me towards solving them and then find another extension to solve the new problem and make new problem.. it seems endless process to find out at the end that the core extensions are enough to run a website with the fewest problems..
I think joomla makers do not want to include the must-have components and extensions with joomla project because of the problems they make.
Happy are those who dream dreams and are ready to pay the price to make them come true.
http://egyptfuntours.com

Hussain321
I've been banned!
Posts: 24
Joined: Sun Oct 25, 2015 1:06 pm

Re: How to remove Duplicate URLs???

Post by Hussain321 » Wed Oct 28, 2015 11:22 am

benedictford wrote:I dont understand why you want to get rid of htaccess?
Same here.

User avatar
boss_3
Joomla! Intern
Joomla! Intern
Posts: 80
Joined: Fri Apr 16, 2010 6:50 am
Location: Cairo, Egypt
Contact:

Re: How to remove Duplicate URLs???

Post by boss_3 » Sat Oct 31, 2015 1:35 pm

I have removed sh404SEF component, it is causing Search component to stop. Is there any other vital solution for duplicated URLs??
Happy are those who dream dreams and are ready to pay the price to make them come true.
http://egyptfuntours.com

User avatar
ramarjun
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 204
Joined: Fri Feb 13, 2015 4:57 am
Location: bangalore
Contact:

Re: How to remove Duplicate URLs???

Post by ramarjun » Sat Oct 31, 2015 2:56 pm

if you have option for sh404sef stop unwanted url create
Web Design company bangalore | Web Development company bangalore - Xennex Technology

arman66
I've been banned!
Posts: 4
Joined: Sun Nov 01, 2015 12:39 am
Location: Emirate
Contact:

Re: How to remove Duplicate URLs???

Post by arman66 » Sun Nov 01, 2015 12:49 am

i have 2 ways for you ...
1 - in webmastertools , you can find all your URL that is indexed !
So you can go and delete them

2 - you have a real page like this domain.com/page.aspx?ID=12
- you changed the url to domain.com/page/12
- you must make domain.com/NEWpage.aspx?ID=12
- make it like this > domain.com/NEWpage/12
- Redirect domain.com/page/12 to domain.com/NEWpage/12
after days google left last Url

;) have good time

User avatar
sangomalaysia
Joomla! Apprentice
Joomla! Apprentice
Posts: 28
Joined: Sun Mar 23, 2014 3:12 pm
Location: Malaysia
Contact:

Re: How to remove Duplicate URLs???

Post by sangomalaysia » Mon Nov 09, 2015 2:08 am

One very common reason for duplicates is if you link one article from multiple menu-items. This is a very common thing to do: sometimes an article that is reached from the main menu must also be reachable from a footer menu-item. In this case, Joomla builds a URL for the menu-item. Let's compare 2 examples:
If you have a menu called Products, with a submenu-item for each product, the URL for the article Chair would be /index.php/product/chair
If you make the same article reachable from the footer, but directly (no submenu), the URL is /index.php/chair.

lilysmith22
I've been banned!
Posts: 69
Joined: Sat Feb 21, 2015 6:25 am
Location: Augusta
Contact:

Re: How to remove Duplicate URLs???

Post by lilysmith22 » Mon Nov 09, 2015 9:47 am

You should delete that one and wait for few days for the updation to work on.

User avatar
ladydevil
Joomla! Intern
Joomla! Intern
Posts: 52
Joined: Sun Sep 14, 2014 5:56 am
Location: Singapore
Contact:

Re: How to remove Duplicate URLs???

Post by ladydevil » Sat Nov 28, 2015 5:32 pm

Yes, you need to create friendly links using the plugin: sh404sef

BryanWalters
Joomla! Apprentice
Joomla! Apprentice
Posts: 32
Joined: Thu Dec 03, 2015 9:54 am

Re: How to remove Duplicate URLs???

Post by BryanWalters » Thu Dec 03, 2015 10:29 am

Hello,

After defining the canonical url for certain page, it takes time for google to deindex (ignore) duplicate url and the change will also reflect in webmaster tools (Search Console) data. It should not show meta duplication there once canonical url is recognized by google.

hoanta
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 141
Joined: Thu Jun 14, 2007 2:22 pm
Contact:

Re: How to remove Duplicate URLs???

Post by hoanta » Sun Dec 27, 2015 2:26 am

Season greetings!

Google Webmastertools show that every my web's SEF URL has it sister like that:

/?catid=0&id=214
while the SEF url is /category-menu/214-article

How to prevent Joomla produce the sister url or how to tell Google ignore it?

Thank you all,

BryanWalters
Joomla! Apprentice
Joomla! Apprentice
Posts: 32
Joined: Thu Dec 03, 2015 9:54 am

Re: How to remove Duplicate URLs???

Post by BryanWalters » Tue Dec 29, 2015 10:24 am

Season greetings!

"Since version 1.5, Joomla! is capable of creating and parsing URLs in any format, including SEF URLs"

Here is a complete guide for creating search engine friendly URL structure of your website.

https://docs.joomla.org/Search_Engine_Friendly_URLs

tabisu123
Joomla! Apprentice
Joomla! Apprentice
Posts: 11
Joined: Mon Sep 17, 2012 2:45 pm

Re: How to remove Duplicate URLs???

Post by tabisu123 » Sat Jan 02, 2016 10:47 am

my way is use webmastertools. and i remove duplicate url by hand. i have a big hand, just kidding hehe.

User avatar
wdiggles
Joomla! Apprentice
Joomla! Apprentice
Posts: 30
Joined: Wed Sep 23, 2009 7:05 pm
Location: Loveland, Colorado
Contact:

Re: How to remove Duplicate URLs???

Post by wdiggles » Mon Jan 11, 2016 6:20 pm

boss_3 wrote:Using sh404sef caused the search component stop working, it might be a good solution for duplicated URLs, but it causes problems!! I do not like it when i install extensions to solve a specific problem and then the new extension makes new problems and push me towards solving them and then find another extension to solve the new problem and make new problem.. it seems endless process to find out at the end that the core extensions are enough to run a website with the fewest problems..
Couldn't agree with your more!

Joomla! can solve your problem without the help of any third-party extensions. On my website I go through the process step-by-step and include screenshots. You can see it here:
https://www.digglescreative.com/seo-for ... menus.html

This is how I do it and it works beautifully.

Warren
Warren Diggles
Diggles Creative, LLC - https://www.digglescreative.com, Sustainable Marketing Agency

GreyWing
Joomla! Fledgling
Joomla! Fledgling
Posts: 3
Joined: Mon Jan 08, 2018 1:22 pm

Re: How to remove Duplicate URLs???

Post by GreyWing » Thu Jan 11, 2018 11:30 am

boss_3 wrote:Hello: I have a problem with links and how google is catching them!
Google says that my website has some Duplicate meta descriptions,
and when I check the URLs leading to the same article I find sometimes strange paths!!
EXample:
http://egyptfuntours.com/149-egypt-fun- ... -and-cairo
http://egyptfuntours.com/egypt-travel-e ... -and-cairo

those two are pointing to the a\same article. I deleted the article and lost one link, but there is still one link pointing to the same article which is already deleted. I feel it is still stored in the database, but I need help on how to get red of such URLs... please someone help me.
I know this is an old thread but it came top in Google for "joomla duplicate threads" so I thought it best to post in here.

We suffered the same problem for a while and solved it by setting the next article id in the database table (after installation) to something random like 2439, same with k2 when we use k2.

Basically it reduces the chances, almost to zero of the url having a number of a previous joomla install having that number in the url and causing a duplicate page.

If I was on the dev team at Joomla, I'd consider setting a random start number for the article ID number on new installs. If they keep starting it at 1, these issues will probably continue.

When I read up on it, it is something that is not unique to joomla.

User avatar
Per Yngve Berg
Joomla! Master
Joomla! Master
Posts: 30926
Joined: Mon Oct 27, 2008 9:27 pm
Location: Romerike, Norway

Re: How to remove Duplicate URLs???

Post by Per Yngve Berg » Thu Jan 11, 2018 12:03 pm

It will only be valid if you replace one Joomla site with another on the same domain. Submitting a site-map to Google should take care of it.

GreyWing
Joomla! Fledgling
Joomla! Fledgling
Posts: 3
Joined: Mon Jan 08, 2018 1:22 pm

Re: How to remove Duplicate URLs???

Post by GreyWing » Thu Jan 11, 2018 2:28 pm

Per Yngve Berg wrote:It will only be valid if you replace one Joomla site with another on the same domain. Submitting a site-map to Google should take care of it.
Yes mate, unfortunately that's what we have done. On some sites we have been using Joomla for 10 years now and some are now on their fourth complete rebuild. The site map to Google didn't really seem to work for us.

Only recently have we found this solution but it works for us, by starting it at some crazy high number of an article ID (that we know we have never used before). It now returns the correct 404 error page for urls that don't exist instead of creating a duplicate.

Just wondering that the new Joomla routing system seems to have / or moving towards dropping the number from the url. If this is true, it might cause issues in the future for anyone that goes for a rebuild.

Definitely not criticism of Joomla, it appears this affects just about all CMS's.

kevinix
Joomla! Apprentice
Joomla! Apprentice
Posts: 5
Joined: Wed Nov 08, 2017 4:06 am

Re: How to remove Duplicate URLs???

Post by kevinix » Mon Jan 22, 2018 11:35 am

Anyone have solutions? Because even using JoomSEF component having the same issue! Have submitted sitemap, however, the search console shows duplicate title tags with different URLs! Thanks.

GreyWing
Joomla! Fledgling
Joomla! Fledgling
Posts: 3
Joined: Mon Jan 08, 2018 1:22 pm

Re: How to remove Duplicate URLs???

Post by GreyWing » Wed Jan 24, 2018 2:20 pm

kevinix wrote:Anyone have solutions? Because even using JoomSEF component having the same issue! Have submitted sitemap, however, the search console shows duplicate title tags with different URLs! Thanks.
What pages (url's) are mostly being duplicated? K2, standard joomla article system?


Locked

Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 3.x”