 |
| Joomla! Apprentice |
 |
Joined: Mon Jan 16, 2006 6:08 pm
Posts: 19
Location: Halderberge System
|
I'm not the expert here but I use 2 files and place them in the root of my webspace (running Apache): The first is a robot.txt, which is merely an instruction for search-bots. robot.txt Quote: User-Agent: *
Disallow: /
Or more specific for certain bots (but there are so many now-a-days): robot.txt Quote: User-agent: Googlebot
Disallow: /
User-Agent: Scooter-3.2.FNR
Disallow: /
User-Agent: ia_archiver
Disallow: /
The second file is the famous .htaccess file which I consider as the first entry to my cybercastle ... Thanks to this forum my .htaccess has 3 chapters. The first locks all subdirectories, only the root can be indexed. The second part is a security-part, it defines the rewrite ruies and is the second gate in my cybercastle. The 3rd part solves a problem with quotes causing trailing slashes: .htaccessQuote:
order deny,allow
deny from all
########## Begin - Rewrite rules to block out some common exploits
#
# Block out any script trying to set a mosConfig value through the URL
RewriteCond %{QUERY_STRING} mosConfig_[a-zA-Z_]{1,21}(=|\%3D) [OR]
# Block out any script trying to base64_encode crap to send via URL
RewriteCond %{QUERY_STRING} base64_encode.*\(.*\) [OR]
# Block out any script that includes a
Who is online |
Users browsing this forum: FAST WebCrawler [Crawler] and 4 guests |
|
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum
|
| |
