my hosting company have said my robot file is wrong

Discuss Search Engine Optimization in relation to Joomla! 3.x. This forum will also have discussions on SEF/SEO Joomla! 3.x extensions.

Moderator: General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Locked
seaside man
Joomla! Guru
Joomla! Guru
Posts: 698
Joined: Thu May 08, 2008 2:55 pm
Contact:

my hosting company have said my robot file is wrong

Post by seaside man » Mon Sep 02, 2013 5:10 pm

hi can anyone please help me, my hosting company have said that my robot file is wrong and is causing me problems.

the hosting company have said as follows

Also we have checked again the content of your robots.txt and you have allowed only the following folder to be indexed:

/component/com_dmk2googlenewssitemap/

If you want to we can remove the robots.txt file from the public_html folder and that should resolve your issue. If the issue which you are experiencing is not related with the indexing of your website, please provide us with a step by step instruction how to recreate the issue on our end.

is my hosting company right, is this damaging my seo and causing me problems. any help would be great. my site is http://www.in2town.co.uk

# If the Joomla site is installed within a folder such as at
# e.g. www.example.com/joomla/ the robots.txt file MUST be
# moved to the site root at e.g. www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to the disallowed
# path, e.g. the Disallow rule for the /administrator/ folder
# MUST be changed to read Disallow: /joomla/administrator/
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/orig.html
#
# For syntax checking, see:
# http://www.sxw.org.uk/computing/robots/check.html

User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /logs/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Sitemap: http://www.in2town.co.uk/index.php?opti ... onent&id=1
Allow: /component/com_dmk2googlenewssitemap/
In2town Magazine is a popular magazine covering celebrity gossip, travel news, lifestyle news, gadget news and so much more. visit http://www.in2town.co.uk

artonweb
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 181
Joined: Mon Oct 24, 2011 5:07 am
Location: Hellas
Contact:

Re: my hosting company have said my robot file is wrong

Post by artonweb » Mon Sep 02, 2013 7:53 pm

I am using the same robots.txt file (except two last lines) without problems on 3 websites.
I suggest that, last line is unnecessary.

seaside man
Joomla! Guru
Joomla! Guru
Posts: 698
Joined: Thu May 08, 2008 2:55 pm
Contact:

Re: my hosting company have said my robot file is wrong

Post by seaside man » Mon Sep 02, 2013 8:59 pm

ok cheers for that
In2town Magazine is a popular magazine covering celebrity gossip, travel news, lifestyle news, gadget news and so much more. visit http://www.in2town.co.uk


Locked

Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 3.x”