how to write Robot.txt disallow with * ?

Need help with the Administration of your Joomla! 3.x site? This is the spot for you.

Moderator: General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Windows Defender SmartScreen Issues <-- please read this if using Windows 10.
Post Reply
skyfranky
Joomla! Enthusiast
Joomla! Enthusiast
Posts: 102
Joined: Wed May 10, 2006 4:35 am

how to write Robot.txt disallow with * ?

Post by skyfranky » Sat Feb 10, 2024 10:48 am

Hi

I see google bot somehow creating a lot of traffic to my site access hugh amout of url in below format. they are not the sitemap urls I submitted. I want to stop google bot for these URL.

how to add disable rule to match anything url with "tel:" will be blocked.

/a/tel:12345678?xxxxx
/b/tel:1456478?xxxxx
/c/tel:1456478?xxxxx
....

is this correct?
disable */tel:*

thanks
Top
User avatar
cmbay
Joomla! Explorer
Joomla! Explorer
Posts: 259
Joined: Thu Dec 31, 2009 11:53 pm
Location: Oregon, USA

Re: how to write Robot.txt disallow with * ?

Post by cmbay » Sat Feb 10, 2024 4:52 pm

I suggest using one of the robots.txt testing tools such as the one offered by LOGEIX.
Charles
Top
Post Reply

Return to “Administration Joomla! 3.x”