The Joomla! Forum ™

Download

Demo


Board index » Joomla! Older Version Support » Joomla! 1.5 » Search Engine Optimization (Joomla! SEO) in Joomla! 1.5

Forum rules


Please click here to view the forum rules



Post new topic Reply to topic  Page 1 of 1
  [ 5 posts ] 
  Print view Previous topic | Next topic 
Author Message
mikelamar
PostPosted: Wed Feb 22, 2012 10:06 am 
Joomla! Apprentice
Joomla! Apprentice

Joined: Tue Mar 01, 2011 5:19 pm
Posts: 36
Location: Athens, Greece
3 days before I realized that I have some google crawl errors. In order to remove them I did the following: site configuration>crawler access>url removals(*) and I added all the broken links that were in my error list. After that a new yellow icon appeared next to each link "pending".

The next day I logged in Webmaster Tools and saw that the submitted urls(*) were gone/disappeared but the crawl errors links were still there(diagnostics>crawl errors), so I decide to delete my old sitemap from google webmaster tools and and submit a new one which I tested (with webmaster tools).

Today I logged in Webmaster Tools and was expecting some changes to be honest.
The crawl errors to be gone, but there were still there.

Can you help me to get rid of them please!
My site is www.afoikanavitsa.gr
Top
 Profile  
 
polomintus
PostPosted: Wed Feb 22, 2012 11:55 pm 
User avatar
Joomla! Guru
Joomla! Guru

Joined: Tue Nov 29, 2011 2:43 pm
Posts: 525
Location: Bournemouth
Don't worry about them, they could be their for months..... Google only skims your site half the time, you need a completely rescan.. Something what you can't control.

In Good time they will be removed, in the mean time you can block those urls from the robots.txt meaning they might get picked up by a skim crawl but again, nothing is a sure thing.

I have missing URLS from 3months ago, and google visits my site least 3 times a week ;)

_________________
Affordable Web Design in Bournemouth
http://www.bybe.net
Top
 Profile  
 
goosed
PostPosted: Thu Feb 23, 2012 2:01 am 
Joomla! Apprentice
Joomla! Apprentice

Joined: Mon Sep 07, 2009 9:07 pm
Posts: 21
Location: South Carolina
That is good to know. I have a TON of links that are no longer relevant. I updated my robots.txt to remove certain URLs. It is strange though, I still see Google trying to crawl directories that are blocked in my robots file. Things like site/components.

_________________
www.mdtechteam.com
Top
 Profile  
 
mikelamar
PostPosted: Fri Feb 24, 2012 10:25 am 
Joomla! Apprentice
Joomla! Apprentice

Joined: Tue Mar 01, 2011 5:19 pm
Posts: 36
Location: Athens, Greece
Do you thing I should do something more to remove them?
What you mean by "updating" robots.txt? Shall I do it and how?
Top
 Profile  
 
goosed
PostPosted: Sat Feb 25, 2012 6:34 am 
Joomla! Apprentice
Joomla! Apprentice

Joined: Mon Sep 07, 2009 9:07 pm
Posts: 21
Location: South Carolina
I didn't want certain directories to be indexed in Google, so I added them to my robots.txt file. For example, I added:

Code:
Disallow: /mindspin/


I do notice however though, that Google still seems to crawl the "Disallow" directories. They show up as "restricted by robots".

_________________
www.mdtechteam.com
Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  Page 1 of 1
  [ 5 posts ] 


Board index » Joomla! Older Version Support » Joomla! 1.5 » Search Engine Optimization (Joomla! SEO) in Joomla! 1.5

Who is online

Users browsing this forum: Exabot [Bot] and 5 guests

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
Powered by phpBB® Forum Software © phpBB Group