Google index robots.txt link in google search result

Discuss Search Engine Optimization in relation to Joomla! 3.x. This forum will also have discussions on SEF/SEO Joomla! 3.x extensions.

Moderator: General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Post Reply
calypso_man
Joomla! Apprentice
Joomla! Apprentice
Posts: 31
Joined: Mon Sep 03, 2018 1:27 pm

Google index robots.txt link in google search result

Post by calypso_man » Fri Nov 16, 2018 9:21 am

Hi,
in google search I enter this site:my-domain.com and google show all index links.
In that results with title show this: User-agent: * Disallow: /administrator/ Disallow: /bin/ Disallow: /cache

If I click on that then open link: my-domain.com/robots.txt
How remove or disalow that google index my robots.txt link.

User avatar
Webdongle
Joomla! Master
Joomla! Master
Posts: 37287
Joined: Sat Apr 05, 2008 9:58 pm

Re: Google index robots.txt link in google search result

Post by Webdongle » Fri Nov 16, 2018 11:39 pm

http://www.weblinksonline.co.uk/
https://www.weblinksonline.co.uk/updating-joomla.html
"The definition of insanity is doing the same thing over and over again, but expecting different results": Albert Einstein

Aqeel664
Joomla! Fledgling
Joomla! Fledgling
Posts: 1
Joined: Wed Nov 28, 2018 5:49 am

Re: Google index robots.txt link in google search result

Post by Aqeel664 » Wed Nov 28, 2018 5:52 am

Make a disalow file as per google guidance and add your robots.txt URL which can you want to remove then submit in webmaster tool.

kashifsaleem
Joomla! Fledgling
Joomla! Fledgling
Posts: 4
Joined: Wed Nov 28, 2018 7:19 am

Re: Google index robots.txt link in google search result

Post by kashifsaleem » Wed Nov 28, 2018 7:31 am

Use disavow option in search console to de-index the url from SERPs.


Post Reply

Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 3.x”