How do I hide a Joomla site from search engines?

Discuss Search Engine Optimization in relation to Joomla!. This forum will also have discussions on SEF/SEO Joomla! extensions.

Moderator: General Support Moderators

Locked
ViewFactory
Joomla! Apprentice
Joomla! Apprentice
Posts: 17
Joined: Tue Jul 29, 2008 4:25 pm

How do I hide a Joomla site from search engines?

Post by ViewFactory » Wed Sep 17, 2008 6:37 pm

Is there a way to "hide" a Joomla site so it does NOT get indexed by search engines?

Thanks in advance!

 
jmc
Joomla! Guru
Joomla! Guru
Posts: 682
Joined: Thu Aug 18, 2005 9:10 pm
Location: Hey! I'm in Hartlepool! We hang monkeys!!!
Contact:

Re: How do I hide a Joomla site from search engines?

Post by jmc » Wed Sep 17, 2008 10:20 pm

Hi!
Theoretically, yes. It can be done by setting the appropriate switches in your .htaccess and/or robots.txt files. However, given that not all search engines actually respect and obey said files, it may be somewhat problematic.
A simple robots.txt file, which should deny all robots from crawling your site would be like this:

Code: Select all

# Make changes for all web spiders
User-agent: *
Disallow: /
Check out the Joomla default robots.txt file in your install.
If you're talking about hiding a site whilst it's under development, the best way is to simply develop it offline, using one of the many WAMP packages out there. The finished article can then be uploaded as "good-to-go" to your web server. Of course, you may then find that you encounter some difficulties due to server configuration not matching your own setup :'(
But life is a learning curve! :D
HTH,
John Mc
When all of your wishes are granted, many of your dreams will be destroyed...

ViewFactory
Joomla! Apprentice
Joomla! Apprentice
Posts: 17
Joined: Tue Jul 29, 2008 4:25 pm

Re: How do I hide a Joomla site from search engines?

Post by ViewFactory » Wed Sep 17, 2008 10:38 pm

Thanks for the info John,
Yes, my client is asking for a resume site, but only wants to hand out the url to companies he is applying to. He has had bad experiences with old college buds, etc, googling him and finding his site, I guess.

So I will try to edit the robots.text file as you have suggested.

ptmike
Joomla! Apprentice
Joomla! Apprentice
Posts: 36
Joined: Wed Jan 31, 2007 11:31 am
Location: The Algarve, Portugal

Re: How do I hide a Joomla site from search engines?

Post by ptmike » Sat Sep 20, 2008 6:53 am

What I do is password protect the root directory with cpanel. Then give out usernames and passwords to who ever.

Regards

Mike

User avatar
trichnosis
Joomla! Explorer
Joomla! Explorer
Posts: 315
Joined: Wed May 17, 2006 4:15 pm

Re: How do I hide a Joomla site from search engines?

Post by trichnosis » Sat Sep 20, 2008 4:48 pm

you can also use <meta name="ROBOTS" content="NOINDEX,NOFOLLOW"> meta tag to prevent bots

baconi
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Sun Apr 08, 2012 10:57 am

Re: How do I hide a Joomla site from search engines?

Post by baconi » Sun Apr 08, 2012 11:06 am

Hi everybody

The most imortant question which makes me wondering is how to hide only part of joomla contents (articles) from search engines.

User avatar
jmuehleisen
Joomla! Virtuoso
Joomla! Virtuoso
Posts: 4874
Joined: Thu Nov 09, 2006 2:46 pm
Location: Kampala, Uganda
Contact:

Re: How do I hide a Joomla site from search engines?

Post by jmuehleisen » Sun Apr 08, 2012 2:59 pm

makes me wondering is how to hide only part of joomla contents (articles) from search engines.
You can fine tune the robots directives on an article by article basis if you want.

In the article editor, look at the "Metadata options" section.

I don't know how to do it globally for all articles, though. But you can turn it on and off on an article by article (and therefore page by page) basis.
Last edited by jmuehleisen on Sun Apr 08, 2012 6:04 pm, edited 1 time in total.
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com

baconi
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Sun Apr 08, 2012 10:57 am

Re: How do I hide a Joomla site from search engines?

Post by baconi » Sun Apr 08, 2012 3:06 pm

jmuehleisen wrote:
makes me wondering is how to hide only part of joomla contents (articles) from search engines.
You can fine tuen the robots directives on an article by article basis if you want.

In the article editor, look at the "Metadata options" section.

I don't know how to do it globally for all articles, though. But you can turn it on and off on an article by article (and therefore page by page) basis.
Thank you for the quick reply, but I didnt fully understand what is supposed to write in the metadata options section, maybe s.th like NOROBOT, please tell me

Description:
Key words:
Robots:
Autor:

User avatar
jmuehleisen
Joomla! Virtuoso
Joomla! Virtuoso
Posts: 4874
Joined: Thu Nov 09, 2006 2:46 pm
Location: Kampala, Uganda
Contact:

Re: How do I hide a Joomla site from search engines?

Post by jmuehleisen » Sun Apr 08, 2012 4:54 pm

There is a robots option right in there.

Just choose "No index, no follow" from the drop down.

Like this:
ss-robots.gif
You do not have the required permissions to view the files attached to this post.
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com

baconi
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Sun Apr 08, 2012 10:57 am

Re: How do I hide a Joomla site from search engines?

Post by baconi » Sun Apr 08, 2012 6:02 pm

jmuehleisen wrote:There is a robots option right in there.

Just choose "No index, no follow" from the drop down.

Like this:
ss-robots.gif
that was wonderful, thank you very much

baconi
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Sun Apr 08, 2012 10:57 am

Re: How do I hide a Joomla site from search engines?

Post by baconi » Mon Apr 09, 2012 1:50 pm

jmuehleisen wrote:There is a robots option right in there.

Just choose "No index, no follow" from the drop down.

Like this:
ss-robots.gif
sorry for the clarification, but my Meta information is without drop down menu for the robots

SO... can I write down no index, no follow
You do not have the required permissions to view the files attached to this post.

User avatar
jmuehleisen
Joomla! Virtuoso
Joomla! Virtuoso
Posts: 4874
Joined: Thu Nov 09, 2006 2:46 pm
Location: Kampala, Uganda
Contact:

Re: How do I hide a Joomla site from search engines?

Post by jmuehleisen » Mon Apr 09, 2012 4:18 pm

Which version of Joomla do you have?

Sorry. I gave you information for Joomla 2.5 and forgot that you were using 1.5.

So, simply type in there "noindex, nofollow".
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com

baconi
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Sun Apr 08, 2012 10:57 am

Re: How do I hide a Joomla site from search engines?

Post by baconi » Mon Apr 09, 2012 5:48 pm

jmuehleisen wrote:Which version of Joomla do you have?

Sorry. I gave you information for Joomla 2.5 and forgot that you were using 1.5.

So, simply type in there "noindex, nofollow".
yes, my joomla is 1.5.22

and final queston
"no index, no follow" - with space
or
"noindex, nofollow" - without space

User avatar
jmuehleisen
Joomla! Virtuoso
Joomla! Virtuoso
Posts: 4874
Joined: Thu Nov 09, 2006 2:46 pm
Location: Kampala, Uganda
Contact:

Re: How do I hide a Joomla site from search engines?

Post by jmuehleisen » Mon Apr 09, 2012 6:09 pm

You do need to update your Joomla to 1.5.26 for sure.

And there is no space in noindex and nofollow
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com

baconi
Joomla! Apprentice
Joomla! Apprentice
Posts: 8
Joined: Sun Apr 08, 2012 10:57 am

Re: How do I hide a Joomla site from search engines?

Post by baconi » Mon Apr 09, 2012 6:54 pm

jmuehleisen wrote:You do need to update your Joomla to 1.5.26 for sure.

And there is no space in noindex and nofollow
my joomla is already 1.5.26 but there is still no drop down menu, so I manually write down in robots field "noindex, nofollow" - without spaces

is it already OK?

User avatar
jmuehleisen
Joomla! Virtuoso
Joomla! Virtuoso
Posts: 4874
Joined: Thu Nov 09, 2006 2:46 pm
Location: Kampala, Uganda
Contact:

Re: How do I hide a Joomla site from search engines?

Post by jmuehleisen » Mon Apr 09, 2012 7:11 pm

Yes, that is OK. The drop downs came in the Joomla 2.5 series.
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com

irandream
Joomla! Intern
Joomla! Intern
Posts: 52
Joined: Fri Mar 25, 2011 7:06 pm
Contact:

Re: How do I hide a Joomla site from search engines?

Post by irandream » Fri May 25, 2012 6:38 am

(For GOOGLE ONLY ) you can use the URL removal tool in google Webmaster Tools if you need to urgently remove your site from Google search results

User avatar
Yesceeohhh
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 159
Joined: Mon May 14, 2012 9:56 am
Location: Irving, TX 75039
Contact:

Re: How do I hide a Joomla site from search engines?

Post by Yesceeohhh » Fri May 25, 2012 9:43 am

You can do it in 2 ways wither in robots.txt disallow bots to crawl your website or in the meta data options give "no index, no follow"

User avatar
mostafa2012
Joomla! Apprentice
Joomla! Apprentice
Posts: 11
Joined: Tue May 01, 2012 11:32 am
Contact:

Re: How do I hide a Joomla site from search engines?

Post by mostafa2012 » Mon May 28, 2012 10:30 pm

use a robots.txt file. Place the file in the root of the site with this content:

User-agent: *
Disallow: /

malfooh
Joomla! Fledgling
Joomla! Fledgling
Posts: 1
Joined: Sat Sep 20, 2014 7:52 am
Contact:

Re: How do I hide a Joomla site from search engines?

Post by malfooh » Sat Sep 20, 2014 8:00 am

There is a robots option in the control panel . You can use no index , no follow.. so it will not appear on search engines

----------------------

 

Locked

Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 1.5”