Robots.txt Topic is solved

[jerry258]

I ran the Google robots test today and found that almost all my site is ALLOWED. The only thing that shows up on sites:www.azssar.org are pages of category "website", which I have specifically disallowed in robots.txt. I read somewhere on this forum about confilicts between robots.txt rules and "no index, no follow" in publishing. I have done both should change the no index, no follow to global? Thanks in advance for your help.

[20-Sep-2023 16:14:54 UTC] PHP Warning: Attempt to read property

Joomla! Instance :: Joomla! 4.3.4-Stable (Bora) 22-August-2023
Joomla! Configured :: Yes | Read-Only (444) |
Configuration Options :: Offline: false | SEF: true | SEF Suffix: false | SEF ReWrite: false | .htaccess/web.config: Yes | GZip: true | Cache: true | CacheTime: 5 | CacheHandler: file | CachePlatformPrefix: false | FTP Layer: N/A | Proxy: false | LiveSite: | Session lifetime: 15 | Session handler: database | Shared sessions: false | SSL: 2 | Error Reporting: default | Site Debug: false | Language Debug: false | Default Access: Registered | Unicode Slugs: false | dbConnection Type: mysqli | PHP Supports J! 4.3.4: Yes | Database Supports J! 4.3.4: Yes | Database Credentials Present: Yes |

Host Configuration :: OS: Linux | OS Version: 2.6.32-954.3.5.lve1.4.92.el6.x86_64 | Technology: x86_64 | Web Server: Apache | Encoding: gzip, deflate, br | System TMP Writable: Yes | Free Disk Space : 782.63 GiB |

PHP Configuration :: Version: 8.1.22 | PHP API: litespeed | Session Path Writable: Yes | Display Errors: 0 | Error Reporting: 22527 | Log Errors To: error_log | Last Known Error: 20th September 2023 16:14:54. | Register Globals: | Magic Quotes: | Safe Mode: | Allow url fopen: 1 | Open Base: | Uploads: 1 | Max. Upload Size: 64M | Max. POST Size: 64M | Max. Input Time: 60 | Max. Execution Time: 30 | Memory Limit: 128M

Database Configuration :: Version: 5.7.42-cll-lve (Client:mysqlnd 8.1.22) | Database Size: 51.00 MiB | #of Tables with config prefix:  166 | #of other Tables:  6 | User Privileges : GRANT ALL

PHP Extensions :: Core (8.1.22) | date (8.1.22) | libxml (8.1.22) | openssl (8.1.22) | pcre (8.1.22) | sqlite3 (8.1.22) | zlib (8.1.22) | bz2 (8.1.22) | calendar (8.1.22) | ctype (8.1.22) | curl (8.1.22) | hash (8.1.22) | filter (8.1.22) | ftp (8.1.22) | gettext (8.1.22) | json (8.1.22) | iconv (8.1.22) | SPL (8.1.22) | pcntl (8.1.22) | readline (8.1.22) | Reflection (8.1.22) | session (8.1.22) | standard (8.1.22) | mbstring (8.1.22) | shmop (8.1.22) | SimpleXML (8.1.22) | tokenizer (8.1.22) | xml (8.1.22) | litespeed () | bcmath (8.1.22) | dom (20031129) | fileinfo (8.1.22) | gd (8.1.22) | imagick (3.7.0) | imap (8.1.22) | inotify (3.0.0) | intl (8.1.22) | exif (8.1.22) | mcrypt (1.0.4) | mysqlnd (mysqlnd 8.1.22) | mysqli (8.1.22) | PDO (8.1.22) | pdo_mysql (8.1.22) | pdo_sqlite (8.1.22) | Phar (8.1.22) | posix (8.1.22) | soap (8.1.22) | sockets (8.1.22) | xmlreader (8.1.22) | xmlwriter (8.1.22) | xsl (8.1.22) | zip (1.19.5) | Zend OPcache (8.1.22) | Zend Engine (4.1.22) |
Potential Missing Extensions ::

Switch User Environment :: PHP CGI: Yes | Server SU: Yes | PHP SU: Yes | Potential Ownership Issues: No

Core Folders :: images/ (755) | components/ (755) | modules/ (755) | plugins/ (755) | language/ (755) | templates/ (755) | cache/ (755) | logs/ (---) | tmp/ (755) | administrator/components/ (755) | administrator/modules/ (755) | administrator/language/ (755) | administrator/templates/ (755) | administrator/logs/ (755) | api/ (755) |

Elevated Permissions (First 10) ::

Database statistics :: Uptime: 310724 | Threads: 5 | Questions: 157345849 | Slow queries: 0 | Opens: 2880742 | Flush tables: 13 | Open tables: 4992 | Queries per second avg: 506.384 |

Components :: Site ::
Core ::
3rd Party:: WF_NONBREAKING_TITLE (2.9.41) ? | WF_TABLE_TITLE (2.9.41) ? | WF_AUTOSAVE_TITLE (2.9.41) ? | WF_FONTSIZESELECT_TITLE (2.9.41) ? | WF_TEXTCASE_TITLE (2.9.41) ? | WF_CLEANUP_TITLE (2.9.41) ? | WF_STYLE_TITLE (2.9.41) ? | WF_VISUALCHARS_TITLE (2.9.41) ? | WF_BROWSER_TITLE (2.9.41) ? | WF_HR_TITLE (2.9.41) ? | WF_KITCHENSINK_TITLE (2.9.41) ? | WF_LISTS_TITLE (2.9.41) ? | WF_IMGMANAGER_TITLE (2.9.41) ? | WF_FORMATSELECT_TITLE (2.9.41) ? | WF_PREVIEW_TITLE (2.9.41) ? | WF_PRINT_TITLE (2.9.41) ? | WF_CLIPBOARD_TITLE (2.9.41) ? | WF_CONTEXTMENU_TITLE (2.9.41) ? | WF_REFERENCE_TITLE (2.9.41) ? | WF_LINK_TITLE (2.9.41) ? | WF_DIRECTIONALITY_TITLE (2.9.41) ? | WF_MEDIA_TITLE (2.9.41) ? | WF_LANGCODE_TITLE (2.9.41) ? | WF_ATTRIBUTES_TITLE (2.9.41) ? | WF_SOURCE_TITLE (2.9.41) ? | WF_STYLESELECT_TITLE (2.9.41) ? | WF_VISUALBLOCKS_TITLE (2.9.41) ? | WF_FULLSCREEN_TITLE (2.9.41) ? | WF_SEARCHREPLACE_TITLE (2.9.41) ? | WF_HELP_TITLE (2.9.41) ? | WF_SPELLCHECKER_TITLE (2.9.41) ? | WF_ARTICLE_TITLE (2.9.41) ? | JCE - Noneditable (1.0.0) ? | WF_CHARMAP_TITLE (2.9.41) ? | WF_WORDCOUNT_TITLE (2.9.41) ? | WF_FONTSELECT_TITLE (2.9.41) ? | WF_ANCHOR_TITLE (2.9.41) ? | WF_EMOTIONS_TITLE (2.9.41) ? | WF_FONTCOLOR_TITLE (2.9.41) ? | WF_LINK_SEARCH_TITLE (2.9.41) ? | WF_POPUPS_JCEMEDIABOX_TITLE (2.9.41) ? | WF_LINKS_JOOMLALINKS_TITLE (2.9.41) ? | WF_FILESYSTEM_JOOMLA_TITLE (2.9.41) ? | WF_AGGREGATOR_VIMEO_TITLE (2.9.41) ? | WF_AGGREGATOR_DAILYMOTION_TITLE (2.9.41) ? | WF_AGGREGATOR_VIDEO_TITLE (2.9.41) ? | WF_AGGREGATOR_[youtube]_TITLE (2.9.41) ? | WF_AGGREGATOR_AUDIO_TITLE (2.9.41) ? |

Components :: Admin ::
Core :: com_newsfeeds (4.0.0) 1 | com_admin (4.0.0) 1 | com_config (4.0.0) 1 | com_languages (4.0.0) 1 | com_joomlaupdate (4.0.3) 1 | com_wrapper (4.0.0) 1 | com_cache (4.0.0) 1 | com_mails (4.0.0) 1 | com_modules (4.0.0) 1 | com_contenthistory (4.0.0) 1 | com_postinstall (4.0.0) 1 | com_checkin (4.0.0) 1 | com_menus (4.0.0) 1 | com_fields (4.0.0) 1 | com_content (4.0.0) 1 | com_tags (4.0.0) 1 | com_workflow (4.0.0) 1 | com_cpanel (4.0.0) 1 | com_login (4.0.0) 1 | com_actionlogs (3.9.0) 1 | com_users (4.0.0) 1 | com_installer (4.0.0) 1 | com_plugins (4.0.0) 1 | com_templates (4.0.0) 1 | com_ajax (4.0.0) 1 | com_redirect (4.0.0) 1 | com_scheduler (4.1.0) 1 | com_banners (4.0.0) 1 | com_associations (4.0.0) 1 | com_categories (4.0.0) 1 | com_finder (4.0.0) 1 | com_privacy (3.9.0) 1 | com_guidedtours (4.3.0) 1 | com_media (3.0.0) 1 | com_messages (4.0.0) 1 |
3rd Party:: com_myjspace (3.1.3) 0 | joodb (4.2.2) 1 | COM_JCE (2.9.41) 1 | com_phocagallery (4.5.4) 1 | com_phocadownload (4.0.6) 1 | COM_MINIORANGE_IMPORTEXPORTUSERS (2.2) 1 | COM_REGULARLABSMANAGER (8.5.0) 1 | com_api (3.0.2) 0 | com_dpcalendar (8.14.1) 1 | COM_ENGAGE (3.3.1) 1 | com_akeebabackup (9.7.1) 1 |

Modules :: Site ::
Core :: mod_banners (3.0.0) 1 | mod_tags_similar (3.1.0) 1 | mod_related_items (3.0.0) 1 | mod_articles_category (3.0.0) 1 | mod_finder (3.0.0) 1 | mod_breadcrumbs (3.0.0) 1 | mod_articles_categories (3.0.0) 1 | mod_whosonline (3.0.0) 1 | mod_tags_popular (3.1.0) 1 | mod_custom (3.0.0) 1 | mod_articles_archive (3.0.0) 1 | mod_wrapper (3.0.0) 1 | mod_languages (3.5.0) 1 | mod_footer (3.0.0) 1 | mod_articles_popular (3.0.0) 1 | mod_menu (3.0.0) 1 | mod_feed (3.0.0) 1 | mod_articles_news (3.0.0) 1 | mod_stats (3.0.0) 1 | mod_syndicate (3.0.0) 1 | mod_articles_latest (3.0.0) 1 | mod_login (3.0.0) 1 | mod_random_image (3.0.0) 1 | mod_users_latest (3.0.0) 1 |
3rd Party:: mod_dpcalendar_mini (8.14.1) 1 | mod_dpcalendar_upcoming (8.14.1) 1 | MOD_ENGAGE_LATEST (3.3.1) 1 | mod_dpcalendar_map (8.14.1) 1 | BS ViewMyJspace (3.1.1) 0 | mod_dpcalendar_counter (8.14.1) 1 | KickstartCassiopeia module (1.5) 1 |

Modules :: Admin ::
Core :: mod_logged (3.0.0) 1 | mod_loginsupport (4.0.0) 1 | mod_version (3.0.0) 1 | mod_sampledata (3.8.0) 1 | mod_popular (3.0.0) 1 | mod_quickicon (3.0.0) 1 | mod_latestactions (3.9.0) 1 | mod_privacy_dashboard (3.9.0) 1 | mod_toolbar (3.0.0) 1 | mod_post_installation_messages (4.0.0) 1 | mod_custom (3.0.0) 1 | mod_frontend (4.0.0) 1 | mod_guidedtours (4.3.0) 1 | mod_latest (3.0.0) 1 | mod_privacy_status (4.0.0) 1 | mod_menu (3.0.0) 1 | mod_feed (3.0.0) 1 | mod_messages (4.0.0) 1 | mod_multilangstatus (3.0.0) 1 | mod_stats_admin (3.0.0) 1 | mod_user (4.0.0) 1 | mod_login (3.0.0) 1 | mod_title (3.0.0) 1 | mod_submenu (3.0.0) 1 |
3rd Party::

Libraries ::
Core ::
3rd Party:: Regular Labs Library (23.9.3039) 1 |

Plugins ::
Core :: plg_task_demo_tasks (4.1) 1 | plg_task_site_status (4.1) 1 | plg_task_requests (4.1) 1 | plg_task_check_files (4.1) 1 | plg_extension_finder (4.0.0) 1 | plg_extension_joomla (3.0.0) 1 | plg_extension_namespacemap (4.0.0) 1 | plg_authentication_ldap (3.0.0) 0 | plg_authentication_cookie (3.0.0) 1 | plg_authentication_joomla (3.0.0) 1 | plg_multifactorauth_yubikey (3.2.0) 1 | plg_multifactorauth_webauthn (4.2.0) 1 | plg_multifactorauth_fixed (4.2.0) 1 | plg_multifactorauth_totp (3.2.0) 1 | plg_multifactorauth_email (4.2.0) 1 | plg_installer_urlinstaller (3.6.0) 1 | plg_installer_override (4.0.0) 1 | plg_installer_packageinstaller (3.6.0) 1 | plg_installer_folderinstaller (3.6.0) 1 | plg_installer_webinstaller (4.0.0) 1 | plg_editors-xtd_module (3.5.0) 1 | plg_editors-xtd_fields (3.7.0) 1 | plg_editors-xtd_image (3.0.0) 1 | plg_editors-xtd_pagebreak (3.0.0) 1 | plg_editors-xtd_article (3.0.0) 1 | plg_editors-xtd_readmore (3.0.0) 1 | plg_editors-xtd_menu (3.7.0) 1 | plg_sampledata_multilang (4.0.0) 1 | plg_api-authentication_basic (4.0.0) 0 | plg_api-authentication_token (4.0.0) 0 | plg_finder_contacts (3.0.0) 1 | plg_finder_content (3.0.0) 1 | plg_finder_categories (3.0.0) 1 | plg_finder_newsfeeds (3.0.0) 1 | plg_finder_tags (3.0.0) 1 | plg_captcha_recaptcha_invisible (3. 0 | plg_captcha_recaptcha (3.4.0) 0 | plg_workflow_featuring (4.0.0) 1 | plg_workflow_publishing (4.0.0) 1 | plg_workflow_notification (4.0.0) 1 | plg_media-action_resize (4.0.0) 1 | plg_media-action_crop (4.0.0) 1 | plg_media-action_rotate (4.0.0) 1 | plg_behaviour_versionable (4.0.0) 1 | plg_behaviour_taggable (4.0.0) 1 | plg_privacy_message (3.9.0) 1 | plg_privacy_content (3.9.0) 1 | plg_privacy_user (3.9.0) 1 | plg_privacy_consents (3.9.0) 1 | plg_privacy_actionlogs (3.9.0) 1 | plg_content_finder (3.0.0) 1 | plg_content_vote (3.0.0) 1 | plg_content_emailcloak (3.0.0) 1 | plg_content_pagenavigation (3.0.0) 1 | plg_content_joomla (3.0.0) 1 | plg_content_loadmodule (3.0.0) 1 | plg_content_fields (3.7.0) 1 | plg_content_confirmconsent (3.9.0) 1 | plg_content_pagebreak (3.0.0) 1 | plg_webservices_installer (4.0.0) 1 | plg_webservices_banners (4.0.0) 1 | plg_webservices_users (4.0.0) 1 | plg_webservices_messages (4.0.0) 1 | plg_webservices_privacy (4.0.0) 1 | plg_webservices_content (4.0.0) 1 | plg_webservices_languages (4.0.0) 1 | plg_webservices_media (4.1.0) 1 | plg_webservices_menus (4.0.0) 1 | plg_webservices_templates (4.0.0) 1 | plg_webservices_newsfeeds (4.0.0) 1 | plg_webservices_redirect (4.0.0) 1 | plg_webservices_plugins (4.0.0) 1 | plg_webservices_modules (4.0.0) 1 | plg_webservices_tags (4.0.0) 1 | plg_webservices_config (4.0.0) 1 | plg_filesystem_local (4.0.0) 1 | plg_quickicon_privacycheck (3.9.0) 1 | plg_quickicon_joomlaupdate (3.0.0) 1 | plg_quickicon_overridecheck (4.0.0) 1 | plg_quickicon_phpversioncheck (3.7.0) 1 | plg_quickicon_extensionupdate (3.0.0) 1 | plg_quickicon_downloadkey (4.0.0) 1 | plg_user_token (3.9.0) 0 | plg_user_joomla (3.0.0) 1 | plg_user_terms (3.9.0) 1 | plg_user_profile (3.0.0) 1 | plg_user_contactcreator (3.0.0) 0 | plg_fields_list (3.7.0) 1 | plg_fields_radio (3.7.0) 1 | plg_fields_text (3.7.0) 1 | plg_fields_usergrouplist (3.7.0) 1 | plg_fields_integer (3.7.0) 1 | plg_fields_subform (4.0.0) 1 | plg_fields_color (3.7.0) 1 | plg_fields_checkboxes (3.7.0) 1 | plg_fields_editor (3.7.0) 1 | plg_fields_media (3.7.0) 1 | plg_fields_imagelist (3.7.0) 1 | plg_fields_user (3.7.0) 1 | plg_fields_textarea (3.7.0) 1 | plg_fields_url (3.7.0) 1 | plg_fields_calendar (3.7.0) 1 | plg_fields_sql (3.7.0) 1 | plg_actionlog_joomla (3.9.0) 1 | plg_system_log (3.0.0) 1 | plg_system_remember (3.0.0) 1 | plg_system_webauthn (4.0.0) 1 | plg_system_privacyconsent (3.9.0) 0 | plg_system_jooa11y (4.2.0) 1 | plg_system_accessibility (4.0.0) 0 | plg_system_skipto (4.0.0) 1 | plg_system_guidedtours (4.3.0) 0 | plg_system_debug (3.0.0) 1 | plg_system_stats (3.5.0) 1 | plg_system_highlight (3.0.0) 1 | plg_system_updatenotification (3.5.0) 1 | plg_system_logout (3.0.0) 1 | plg_system_languagecode (3.0.0) 0 | plg_system_schedulerunner (4.1) 1 | plg_system_redirect (3.0.0) 1 | plg_system_cache (3.0.0) 1 | plg_system_fields (3.7.0) 1 | plg_system_logrotation (3.9.0) 1 | plg_system_shortcut (4.2.0) 1 | plg_system_sessiongc (3.8.6) 1 | plg_system_httpheaders (4.0.0) 1 | plg_system_languagefilter (3.0.0) 0 | plg_system_task_notification (4.1) 1 | plg_system_sef (3.0.0) 1 | plg_system_actionlogs (3.9.0) 1 |
3rd Party:: PLG_TASK_AKEEBABACKUP (9.7.1) 1 | plg_dpcalendar_caldav (8.14.1) 1 | Search - MyJspace (3.1.1) 0 | plg_editors_jce (2.9.41) 1 | plg_editors_codemirror (5.65.12) 1 | plg_editors_tinymce (5.10.7) 1 | plg_extension_jce (2.9.41) 1 | plg_authentication_tjapi (3.0.2) 0 | plg_installer_dpcalendar (8.14.1) 1 | plg_installer_jce (2.9.41) 1 | pdf_btn (3.0.0) 1 | PLG_EDITORS-XTD_MODALS (12.6.1) 1 | Button - MyJspace Page Break (3.1.1) 1 | Button - MyJspace Image (3.1.1) 1 | Button - MyJspace Upload (3.1.1) 1 | Button - MyJspace Tags (3.1.1) 1 | Smart Search - MyJspace (3.1.1) 1 | plg_dpattachments_dpcalendar (8.14.1) 1 | plg_privacy_dpcalendar (8.14.1) 1 | Privacy - MyJspace (3.1.1) 1 | PLG_PRIVACY_ENGAGE (3.3.1) 1 | plg_content_dpcalendar (8.14.1) 1 | plg_content_jce (2.9.41) 1 | pdf_embed (3.0.0) 1 | Content - Pagebreak - MyJspace (3.1.1) 1 | Content - idbbee (1.4) 1 | DirectPHP (4.02) 1 | PLG_CONTENT_ENGAGE (3.3.1) 1 | PLG_WEBSERVICES_AKEEBABACKUP (9.7.1) 1 | plg_quickicon_jce (2.9.41) 1 | plg_quickicon_myjspace (3.1.1) 0 | PLG_QUICKICON_AKEEBABACKUP (9.7.1) 1 | plg_quickicon_joodb (4.0) 1 | PLG_DATACOMPLIANCE_ENGAGE (3.3.1) 1 | plg_user_dpcalendar (8.14.1) 1 | PLG_USER_ENGAGE (3.3.1) 1 | ACF_WHATSAPPCTC (1.0) 1 | ACF_TIMEPICKER (1.0) 1 | ACF_COUNTRY (1.0) 1 | plg_fields_dpcalendar (8.14.1) 1 | ACF_TELEPHONE (1.0) 1 | ACF_BINGMAP (1.0) 1 | ACF_[URL not permitted] (1.0) 1 | ACF_URL (1.0) 1 | ACF_MAP (1.0) 1 | ACF_CONVERTFORMS (1.0) 1 | ACF_[youtube] (1.0) 1 | ACF_IFRAME (1.0) 1 | ACF_ARTICLES (1.0) 1 | plg_fields_mediajce (2.9.41) 1 | ACF_DAILYMOTION (1.0) 1 | ACF_VIMEO (1.0) 1 | ACF_FACEBOOK (1.0) 1 | ACF_EMAIL (1.0) 1 | ACF_GRAVATAR (1.0) 1 | ACF_TRUEFALSE (1.0) 1 | ACF_QRCODE (1.0) 1 | ACF_TWITTER (1.0) 1 | ACF_HTML5VIDEO (1.0) 1 | ACF_CURRENCY (1.0) 1 | ACF_PROGRESSBAR (1.0) 1 | ACF_GOOGLEMAP (1.0) 1 | ACF_HTML5AUDIO (1.0) 1 | ACF_DOWNLOADBUTTON (1.0) 1 | ACF_FACEBOOKVIDEO (1.0) 1 | ACF_VIDEO (1.0) 1 | ACF_OSM (1.0) 1 | PLG_ENGAGE_GRAVATAR (3.3.1) 1 | PLG_ENGAGE_EMAIL (3.3.1) 1 | PLG_ENGAGE_AKISMET (3.3.1) 1 | PLG_ACTIONLOG_REGULARLABSMANAGER (8.5.0) 1 | plg_actionlog_dpcalendar (8.14.1) 1 | PLG_ACTIONLOG_AKEEBABACKUP (9.7.1) 1 | PLG_ACTIONLOG_ENGAGE (3.3.1) 1 | plg_system_jce (2.9.41) 1 | PLG_SYSTEM_MODALS (12.6.1) 1 | plg_system_nrframework (4.10.53) 1 | PLG_SYSTEM_BACKUPONUPDATE (9.7.1) 1 | PLG_SYSTEM_REGULARLABS (23.9.3039) 1 | plg_system_jcemediabox (2.1.5) 1 | plg_system_tgeoip (2.2.2) 1 | plg_system_tjupdates (1.0.3) 1 | PLG_SYSTEM_ACF (2.7.0) 1 | System - MyJspace (3.1.1) 1 | PLG_SYSTEM_MINIORANGEIMPORTEXPORTUS (2.2) ? | plg_system_tjtokenlogin (3.0.2) 0 | PLG_SYSTEM_ENGAGECACHE (3.3.1) 1 | mySites.guru Secure Plugin (n/a) 1 | PLG_CONSOLE_AKEEBABACKUP (9.7.1) 1 | PLG_CONSOLE_ENGAGE (3.3.1) 1 |

Templates :: Site :: cassiopeia_azssar_template (1.0) 1 | cassiopeia (1.0) 1 |
Templates :: Admin :: atum (1.0) 1 |

[ceford]

Joomla comes with a file named robots.txt.dist - either copy it to robots.txt or rename it to robots.txt.

You can also set a Robots metadata value for each article.

[jerry258]

Joomla comes with a file named robots.txt.dist - either copy it to robots.txt or rename it to robots.txt.

You can also set a Robots metadata value for each article.

Thanks for the reply Ceford, but I have done that and included a copy of my Robots.txt in my question. Trouble is, it does not prevent the bots from indexing and following any of my disallowed items.

[gws]

Not all bots obey robots.txt.

[ceford]

Looked at your site and its robots.txt: www.azssar.org/robots.txt which has entries like this:

User-agent: *
Disallow: /joomla/administrator/
Disallow: /joomla/public_html/api/

But the /joomla/ folder does not exist. Remove all the /joomla parts of each line.

[jerry258]

Ceford My face is red. Thank you for being kind.
But after I corrected that error, my categories are still being indexed and published by robots. I can't find a way to block the indexing on a category. Is there a way?
Thanks in advance

[ceford]

There is no folder named /Joomla/cms/categories/categories/ in a standard Joomla installation. So your statement my categories are still being indexed does not make much sense. Do you mean that a category blog is being indexed? If so, you can go to the menu item and under Metadata set Robots to noindex,nofolow. Also, if your site has been indexed it will stay indexed until the next robot visit.

[jerry258]

Ceford
I have set all the articles that are in the "website" category to no index, no follow, and yet here is what I get from sites:www.azssar.org:
And on the second screen shot the 4 articles at the bottom are followable and give the full page on selection.
The possibility that the index has been up there for a while is true. So I'll wait for a while to see if it disappears. But it's strange that they are all in that category.
Thanks for your help.
Jerry