Links Excluded By Google Topic is solved

Discuss Search Engine Optimization in relation to Joomla! 3.x. This forum will also have discussions on SEF/SEO Joomla! 3.x extensions.

Moderator: General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Post Reply
User avatar
Newman123
I've been banned!
Posts: 158
Joined: Tue Jun 20, 2017 7:54 pm

Links Excluded By Google

Post by Newman123 » Sat Oct 13, 2018 10:32 pm

Hello, I was wondering if anyone can help me understand how to unexclude links, a lot of my tags seem to be excluded from indexing, I have it set to index and follow.. Thank you..

User avatar
Per Yngve Berg
Joomla! Master
Joomla! Master
Posts: 26126
Joined: Mon Oct 27, 2008 9:27 pm
Location: Akershus, Norway

Re: Links Excluded By Google

Post by Per Yngve Berg » Sun Oct 14, 2018 12:47 am

Mod. Note: Relocated the topic to the SEO forum.

Edit robots.txt file

delacroix1505
Joomla! Apprentice
Joomla! Apprentice
Posts: 12
Joined: Fri Jul 20, 2018 1:51 am

Re: Links Excluded By Google

Post by delacroix1505 » Wed Oct 17, 2018 2:28 am

You can look at here: https://docs.joomla.org/Robots.txt_file

Open the robots.txt file (must be in the root folder). Then edit -> type: Allow: /tags/ (It really depend on your URL structure - for example: if I want to indexing my tag: I should type: Allow: /blogs/tags/)

User avatar
Newman123
I've been banned!
Posts: 158
Joined: Tue Jun 20, 2017 7:54 pm

Re: Links Excluded By Google

Post by Newman123 » Fri Oct 19, 2018 9:49 pm

thanks everyone, just added that one line, let's see what happens..

User avatar
occultfish
Joomla! Apprentice
Joomla! Apprentice
Posts: 49
Joined: Tue Jun 11, 2013 8:07 pm
Contact:

Re: Links Excluded By Google

Post by occultfish » Wed Oct 24, 2018 5:20 pm

You can also use the joomla option for meta data by creating a menu item for the tags. In the meta robots box, just type in "index,follow".

Thanks

User avatar
sozzled
Joomla! Exemplar
Joomla! Exemplar
Posts: 8025
Joined: Sun Jul 05, 2009 3:30 am
Location: Canberra, Australia
Contact:

Re: Links Excluded By Google

Post by sozzled » Wed Oct 24, 2018 7:21 pm

delacroix1505 wrote:
Wed Oct 17, 2018 2:28 am
Open the robots.txt file (must be in the root folder). Then edit -> type: Allow: /tags/ (It really depend on your URL structure - for example: if I want to indexing my tag: I should type: Allow: /blogs/tags/)
Hmmm ...

Everything I've read about the Robots Exclusion Protocol suggests that there's no use for writing "Allow". Four other important points we should also make are:
  1. The /robots.txt is a de-facto standard, and is not owned by any standards body.
  2. The /robots.txt standard is not actively developed.
  3. robots can ignore your /robots.txt especially malware robots that scan the web for security vulnerabilities and email address harvesters used by spammers will pay no attention.
  4. The /robots.txt file is a publicly available file. Anyone can see what sections of your server you don't want robots to use.
The source for the above list is http://www.robotstxt.org/robotstxt.html.
https://www.kuneze.com/blog
“If you think I’m wrong then say, ‘I think you’re wrong.’ If you say ‘You’re wrong!’, how do you know?” :)


Post Reply

Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 3.x”