The Joomla! Forum ™






Post new topic Reply to topic  [ 19 posts ] 
Author Message
PostPosted: Wed Sep 17, 2008 6:37 pm 
Joomla! Apprentice
Joomla! Apprentice

Joined: Tue Jul 29, 2008 4:25 pm
Posts: 17
Is there a way to "hide" a Joomla site so it does NOT get indexed by search engines?

Thanks in advance!


Top
 Profile  
 
PostPosted: Wed Sep 17, 2008 10:20 pm 
Joomla! Guru
Joomla! Guru

Joined: Thu Aug 18, 2005 9:10 pm
Posts: 682
Location: Hey! I'm in Hartlepool! We hang monkeys!!!
Hi!
Theoretically, yes. It can be done by setting the appropriate switches in your .htaccess and/or robots.txt files. However, given that not all search engines actually respect and obey said files, it may be somewhat problematic.
A simple robots.txt file, which should deny all robots from crawling your site would be like this:
Code:
# Make changes for all web spiders
User-agent: *
Disallow: /

Check out the Joomla default robots.txt file in your install.
If you're talking about hiding a site whilst it's under development, the best way is to simply develop it offline, using one of the many WAMP packages out there. The finished article can then be uploaded as "good-to-go" to your web server. Of course, you may then find that you encounter some difficulties due to server configuration not matching your own setup :'(
But life is a learning curve! :D
HTH,
John Mc

_________________
When all of your wishes are granted, many of your dreams will be destroyed...


Top
 Profile  
 
PostPosted: Wed Sep 17, 2008 10:38 pm 
Joomla! Apprentice
Joomla! Apprentice

Joined: Tue Jul 29, 2008 4:25 pm
Posts: 17
Thanks for the info John,
Yes, my client is asking for a resume site, but only wants to hand out the url to companies he is applying to. He has had bad experiences with old college buds, etc, googling him and finding his site, I guess.

So I will try to edit the robots.text file as you have suggested.


Top
 Profile  
 
PostPosted: Sat Sep 20, 2008 6:53 am 
Joomla! Apprentice
Joomla! Apprentice

Joined: Wed Jan 31, 2007 11:31 am
Posts: 36
Location: The Algarve, Portugal
What I do is password protect the root directory with cpanel. Then give out usernames and passwords to who ever.

Regards

Mike


Top
 Profile  
 
PostPosted: Sat Sep 20, 2008 4:48 pm 
User avatar
Joomla! Explorer
Joomla! Explorer

Joined: Wed May 17, 2006 4:15 pm
Posts: 308
you can also use <meta name="ROBOTS" content="NOINDEX,NOFOLLOW"> meta tag to prevent bots

_________________
http://www.turkcebilgi.net/
http://www.sozlukturkce.com/


Top
 Profile  
 
PostPosted: Sun Apr 08, 2012 11:06 am 
Joomla! Apprentice
Joomla! Apprentice

Joined: Sun Apr 08, 2012 10:57 am
Posts: 8
Hi everybody

The most imortant question which makes me wondering is how to hide only part of joomla contents (articles) from search engines.


Top
 Profile  
 
PostPosted: Sun Apr 08, 2012 2:59 pm 
User avatar
Joomla! Virtuoso
Joomla! Virtuoso

Joined: Thu Nov 09, 2006 2:46 pm
Posts: 4859
Location: Kampala, Uganda
Quote:
makes me wondering is how to hide only part of joomla contents (articles) from search engines.

You can fine tune the robots directives on an article by article basis if you want.

In the article editor, look at the "Metadata options" section.

I don't know how to do it globally for all articles, though. But you can turn it on and off on an article by article (and therefore page by page) basis.

_________________
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com


Last edited by jmuehleisen on Sun Apr 08, 2012 6:04 pm, edited 1 time in total.

Top
 Profile  
 
PostPosted: Sun Apr 08, 2012 3:06 pm 
Joomla! Apprentice
Joomla! Apprentice

Joined: Sun Apr 08, 2012 10:57 am
Posts: 8
jmuehleisen wrote:
Quote:
makes me wondering is how to hide only part of joomla contents (articles) from search engines.

You can fine tuen the robots directives on an article by article basis if you want.

In the article editor, look at the "Metadata options" section.

I don't know how to do it globally for all articles, though. But you can turn it on and off on an article by article (and therefore page by page) basis.


Thank you for the quick reply, but I didnt fully understand what is supposed to write in the metadata options section, maybe s.th like NOROBOT, please tell me

Description:
Key words:
Robots:
Autor:


Top
 Profile  
 
PostPosted: Sun Apr 08, 2012 4:54 pm 
User avatar
Joomla! Virtuoso
Joomla! Virtuoso

Joined: Thu Nov 09, 2006 2:46 pm
Posts: 4859
Location: Kampala, Uganda
There is a robots option right in there.

Just choose "No index, no follow" from the drop down.

Like this:

Attachment:
ss-robots.gif


You do not have the required permissions to view the files attached to this post.

_________________
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com


Top
 Profile  
 
PostPosted: Sun Apr 08, 2012 6:02 pm 
Joomla! Apprentice
Joomla! Apprentice

Joined: Sun Apr 08, 2012 10:57 am
Posts: 8
jmuehleisen wrote:
There is a robots option right in there.

Just choose "No index, no follow" from the drop down.

Like this:

Attachment:
ss-robots.gif


that was wonderful, thank you very much


Top
 Profile  
 
PostPosted: Mon Apr 09, 2012 1:50 pm 
Joomla! Apprentice
Joomla! Apprentice

Joined: Sun Apr 08, 2012 10:57 am
Posts: 8
jmuehleisen wrote:
There is a robots option right in there.

Just choose "No index, no follow" from the drop down.

Like this:

Attachment:
ss-robots.gif

sorry for the clarification, but my Meta information is without drop down menu for the robots

SO... can I write down no index, no follow


You do not have the required permissions to view the files attached to this post.


Top
 Profile  
 
PostPosted: Mon Apr 09, 2012 4:18 pm 
User avatar
Joomla! Virtuoso
Joomla! Virtuoso

Joined: Thu Nov 09, 2006 2:46 pm
Posts: 4859
Location: Kampala, Uganda
Which version of Joomla do you have?

Sorry. I gave you information for Joomla 2.5 and forgot that you were using 1.5.

So, simply type in there "noindex, nofollow".

_________________
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com


Top
 Profile  
 
PostPosted: Mon Apr 09, 2012 5:48 pm 
Joomla! Apprentice
Joomla! Apprentice

Joined: Sun Apr 08, 2012 10:57 am
Posts: 8
jmuehleisen wrote:
Which version of Joomla do you have?

Sorry. I gave you information for Joomla 2.5 and forgot that you were using 1.5.

So, simply type in there "noindex, nofollow".


yes, my joomla is 1.5.22

and final queston
"no index, no follow" - with space
or
"noindex, nofollow" - without space


Top
 Profile  
 
PostPosted: Mon Apr 09, 2012 6:09 pm 
User avatar
Joomla! Virtuoso
Joomla! Virtuoso

Joined: Thu Nov 09, 2006 2:46 pm
Posts: 4859
Location: Kampala, Uganda
You do need to update your Joomla to 1.5.26 for sure.

And there is no space in noindex and nofollow

_________________
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com


Top
 Profile  
 
PostPosted: Mon Apr 09, 2012 6:54 pm 
Joomla! Apprentice
Joomla! Apprentice

Joined: Sun Apr 08, 2012 10:57 am
Posts: 8
jmuehleisen wrote:
You do need to update your Joomla to 1.5.26 for sure.

And there is no space in noindex and nofollow


my joomla is already 1.5.26 but there is still no drop down menu, so I manually write down in robots field "noindex, nofollow" - without spaces

is it already OK?


Top
 Profile  
 
PostPosted: Mon Apr 09, 2012 7:11 pm 
User avatar
Joomla! Virtuoso
Joomla! Virtuoso

Joined: Thu Nov 09, 2006 2:46 pm
Posts: 4859
Location: Kampala, Uganda
Yes, that is OK. The drop downs came in the Joomla 2.5 series.

_________________
John Muehleisen
Visit my "Getting Started with Joomla" site, now with videos, tips, and new user tutorials:  http://welcometojoomla.com


Top
 Profile  
 
PostPosted: Fri May 25, 2012 6:38 am 
Joomla! Intern
Joomla! Intern

Joined: Fri Mar 25, 2011 7:06 pm
Posts: 52
(For GOOGLE ONLY ) you can use the URL removal tool in google Webmaster Tools if you need to urgently remove your site from Google search results

_________________
http://www.irandream.com


Top
 Profile  
 
PostPosted: Fri May 25, 2012 9:43 am 
User avatar
Joomla! Enthusiast
Joomla! Enthusiast

Joined: Mon May 14, 2012 9:56 am
Posts: 133
Location: Irving, TX 75039
You can do it in 2 ways wither in robots.txt disallow bots to crawl your website or in the meta data options give "no index, no follow"


Top
 Profile  
 
PostPosted: Mon May 28, 2012 10:30 pm 
User avatar
Joomla! Apprentice
Joomla! Apprentice

Joined: Tue May 01, 2012 11:32 am
Posts: 11
use a robots.txt file. Place the file in the root of the site with this content:

User-agent: *
Disallow: /

_________________
Egyptian Education http://www.almo3lm.net/


Top
 Profile  
 
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 19 posts ] 



Who is online

Users browsing this forum: No registered users and 4 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Jump to:  
Powered by phpBB® Forum Software © phpBB Group