Google finds index.php/component/users/

Discuss Search Engine Optimization in relation to Joomla! 3.x. This forum will also have discussions on SEF/SEO Joomla! 3.x extensions.

Moderator: General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Post Reply
deanivk
Joomla! Apprentice
Joomla! Apprentice
Posts: 7
Joined: Tue Apr 11, 2017 8:54 pm

Google finds index.php/component/users/

Post by deanivk » Fri Apr 19, 2019 11:03 am

Hello,
just put in Google search index.php/component/users/ and you will find likns to thousands of Joomla Websites and coming directly to login or password forget form, although login module in frontend is deactivated. This should not be possible, this is core matter.
Last edited by toivo on Fri Apr 19, 2019 12:34 pm, edited 1 time in total.
Reason: mod note: moved, not related to 3.x Security

User avatar
Per Yngve Berg
Joomla! Master
Joomla! Master
Posts: 26020
Joined: Mon Oct 27, 2008 9:27 pm
Location: Akershus, Norway

Re: Google finds index.php/component/users/

Post by Per Yngve Berg » Fri Apr 19, 2019 5:49 pm

robots.txt should contain "disallow /components/"

You probably forgot to rename robots.txt.dist when you installed Joomla. The file must be placed at the web root.

officially4h
Joomla! Fledgling
Joomla! Fledgling
Posts: 2
Joined: Sun Apr 07, 2019 5:30 am

Re: Google finds index.php/component/users/

Post by officially4h » Mon Apr 22, 2019 5:22 pm

When installing , Rename file to robot.txt

User avatar
sozzled
Joomla! Exemplar
Joomla! Exemplar
Posts: 7875
Joined: Sun Jul 05, 2009 3:30 am
Location: Canberra, Australia
Contact:

Re: Google finds index.php/component/users/

Post by sozzled » Mon Apr 22, 2019 8:26 pm

First of all, I don't think we're likely to hear again from @deanivk on this subject. If this was something important to someone then they would remain engaged in the discussion. It's been four days since they wrote (even allowing for the Easter break) and they're silent. So, let's unpack the so called "core matter" problem:

deanivk wrote:
Fri Apr 19, 2019 11:03 am
... just put in Google search index.php/component/users/ and you will find [links] to thousands of Joomla websites ...
That's true, perhaps, but so what? The "fact" does not identify which websites are generating these SERPs or what versions of J! are involved in those links being indexed by Google or other search engines.

deanivk wrote:
Fri Apr 19, 2019 11:03 am
... and coming directly to login or password forget form, although login module in frontend is deactivated ...
Where is the evidence? Where is the analysis for making any conclusion on the matter.

deanivk wrote:
Fri Apr 19, 2019 11:03 am
This should not be possible, this is core matter.
Lots of things "should not be possible" but they are. They're possible because people allow these things to happen.

When someone first installs Joomla 3.9.5, two files are created. These files are named robots.txt and robots.txt.dist. As we all know, the second of these two files is a "template" for the first. Search engines, like Google, do not use the file robots.txt.dist. Well-behaved search engines follow the "robots.txt" rules (see http://www.robotstxt.org/).

There's no need to rename anything (unless someone used a non-standard J! installation package to begin with).

The standard robots.txt file looks like this

Code: Select all

# If the Joomla site is installed within a folder
# eg www.example.com/joomla/ then the robots.txt file 
# MUST be moved to the site root 
# eg www.example.com/robots.txt
# AND the joomla folder name MUST be prefixed to all of the
# paths. 
# eg the Disallow rule for the /administrator/ folder MUST 
# be changed to read 
# Disallow: /joomla/administrator/
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/orig.html
#
# For syntax checking, see:
# http://tool.motoricerca.info/robots-checker.phtml

User-agent: *
Disallow: /administrator/
Disallow: /bin/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /layouts/
Disallow: /libraries/
Disallow: /logs/
Disallow: /modules/
Disallow: /plugins/
Disallow: /tmp/
As you can see, the standard file includes a rule to prevent Google from indexing "index.php/component/users/". If Google is able to index these kinds of URLs then the first thing to do is to see what is contained in the file robots.txt.

Anyway, for what it's worth, any further discussion on this subject is pretty much wasted on people who claim there's a problem without providing supporting evidence of a problem or making generalised assertions about Joomla unless they're also prepared to back up those assertions with examples and the analysis that shows how, where, when and why these kinds of things could occur. Yes, "This should not be possible." I can agree with that. 8)
https://www.kuneze.com/blog
“If you think I’m wrong then say, ‘I think you’re wrong.’ If you say ‘You’re wrong!’, how do you know?” :)


Post Reply

Return to “Search Engine Optimization (Joomla! SEO) in Joomla! 3.x”