Google strated to report strange URLs in my site

Discuss Search Engine Optimization in relation to Joomla!. This forum will also have discussions on SEF/SEO Joomla! extensions.

Moderator: General Support Moderators

ldor
Joomla! Apprentice
Joomla! Apprentice
Posts: 46
Joined: Mon Sep 20, 2010 12:50 pm

Google strated to report strange URLs in my site

Postby ldor » Tue Mar 24, 2015 8:13 am

Hi everybody,

My site was migrated to another host recently. Right after that Google reported an increase in crawl errors.

The URLs Google reports are really strange, they look like this:
http://www.my_site_url.org/link1/link2/link2/link4.html

Each of these link1, link2, link3, etc. are meaningful on their own, I mean, I do have URLs like http://www.my_site_url.org/link1.html, http://www.my_site_url.org/link2.html, etc. But when they appear mixed together in a single URL, that is completely meaningless.

From the raw log files, I've noticed the same URLs crawled by Yandex, so this is not something specific just to Google.

Google reports such URLs with error codes 500, 503, 504. But how does it manage to find such URLs on my site? They should not exist at all?! This is the 2nd time I had to change the host in 5 years. On the first two hosts there was nothing like that. I did contact tech support but so far they have no idea...

raghumudaliar
Joomla! Fledgling
Joomla! Fledgling
Posts: 2
Joined: Fri Mar 20, 2015 5:30 am
Location: Bangalore

Re: Google strated to report strange URLs in my site

Postby raghumudaliar » Tue Mar 24, 2015 10:11 am

Use robots.txt and disallow the components and plugins and themes folders which are unnecessary for Google

ldor
Joomla! Apprentice
Joomla! Apprentice
Posts: 46
Joined: Mon Sep 20, 2010 12:50 pm

Re: Google strated to report strange URLs in my site

Postby ldor » Tue Mar 24, 2015 1:02 pm

Thank you. Actually, I do have such a robots.txt file but I've just noticed some new folders not mentioned in it. I've included those folders too (and erased some temporary folders). Hopefully that will help


Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 1.5”

Who is online

Users browsing this forum: No registered users and 8 guests