Very poor performance with 15k articles

[Sn0rlaX]

Hi. I've 15k articles into a new (in development) Joomla site.
Site is multilanguage (ENG-ITA): articles are in english and italian. It is very slow to show front-end and back-end contents.
This is profile information:

Code: Select all

Time: 41.57 ms / 41.57 ms Memory: 0.541 MB / 0.88 MB Application: afterLoad
Time: 112.85 ms / 154.42 ms Memory: 1.081 MB / 1.96 MB Application: afterInitialise
Time: 22.03 ms / 176.46 ms Memory: 0.236 MB / 2.20 MB Application: afterRoute
Time: 8.69 ms / 185.15 ms Memory: 0.277 MB / 2.47 MB Application: beforeRenderComponent com_content
Time: 16.52 ms / 201.66 ms Memory: 0.131 MB / 2.61 MB Application: Before Access::preloadComponents (all components)
Time: 1.38 ms / 203.05 ms Memory: 0.053 MB / 2.66 MB Application: After Access::preloadComponents (all components)
Time: 0.03 ms / 203.08 ms Memory: -0.003 MB / 2.65 MB Application: Before Access::getAssetRules (id:8 name:com_content)
Time: 1.16 ms / 204.23 ms Memory: 0.071 MB / 2.73 MB Application: After Access::getAssetRules (id:8 name:com_content)
Time: 22788.08 ms / 22992.31 ms Memory: 211.558 MB / 214.28 MB Application: afterRenderComponent com_content
Time: 1.11 ms / 22993.43 ms Memory: 0.007 MB / 214.29 MB Application: afterDispatch
Time: 54.04 ms / 23047.47 ms Memory: 0.257 MB / 214.55 MB Application: afterRender

Database queries total: 1560.38 ms

Some queries seems very slow... i don't think this is normal.
Any idea?

Code: Select all

27 Queries Logged: 1560.38 ms

Thanks in advance

Code: Select all

Joomla! version: 3.9.24 Stable
PHP Version: 7.4.13
mysql: 5.6.49-log

No JCH Optimize, Caching OFF.
Session Handler: PHP

[vishwas_22]

That said, if you have to do this for more articles than just one I would probably take a different approach:

1 - when importing the data make sure that the old IDs are ported over, if you don't want to use them as IDs again you could add them to a column such as old_id or similar.

2 - write a PHP script that expects an old ID as parameter and issues a 301 redirect to the new URL by pulling the reuqired info from the DB.

3 - add an htaccess rule to force all old URLs to the PHP script:

RewriteRule ^content/view/full/([0-9]+) old_to_new_article_redirect.php?old_id=$1

[Sn0rlaX]

Hi vishwas_22, thanks for reply.
Articles are imported from wordpress and inserted in Joomla as new articles, so there are no old ids to keep.

[darb]

Hi Sn0rlaX thanks for joining the Joomla free real open source community.

To better help you can you please give us the url so we can check and really help you with you site?

Its crucial so we can se whats going on and also you can make a FPA of your site?

More info here: viewtopic.php?f=714&t=757645

Download and RUN the Forum Post Assistant / FPA Instructions

[Sn0rlaX]

Hi darb, site URL is:

d i s c o v e r p l a c e s . i t

This is the FPA results:

Joomla! Instance :: Joomla! 3.9.24-Stable (Amani) 12-January-2021
Joomla! Platform :: Joomla Platform 13.1.0-Stable (Curiosity) 24-Apr-2013
Joomla! Configured :: Yes | Read-Only (444) |
Configuration Options :: Offline: false | SEF: true | SEF Suffix: false | SEF ReWrite: true | .htaccess/web.config: Yes | GZip: true | Cache: false | CacheTime: 15 | CacheHandler: file | CachePlatformPrefix: false | FTP Layer: false | Proxy: false | LiveSite: | Session lifetime: 15 | Session handler: none | Shared sessions: false | SSL: 2 | Error Reporting: none | Site Debug: false | Language Debug: false | Default Access: 1 | Unicode Slugs: false | dbConnection Type: mysqli | PHP Supports J! 3.9.24: Yes | Database Supports J! 3.9.24: Yes | Database Credentials Present: Yes |

Host Configuration :: OS: Linux | OS Version: 3.10.0-1160.6.1.el7.x86_64 | Technology: x86_64 | Web Server: Apache | Encoding: gzip, deflate, br | System TMP Writable: Yes | Free Disk Space : 326.03 GiB |

PHP Configuration :: Version: 7.4.13 | PHP API: cgi-fcgi | Session Path Writable: Yes | Display Errors: | Error Reporting: 32759 | Log Errors To: /home/ndiscovq/error_log_php | Last Known Error: 15th January 2021 03:14:16. | Register Globals: | Magic Quotes: | Safe Mode: | Allow url fopen: 1 | Open Base: /home/ndiscovq/:/opt/cpanel/ea-php74/root/usr:/usr/local/lib/php:/tmp:/etc/pki/tls/certs/ca-bundle.crt:/var/cpanel/php/sessions | Uploads: 1 | Max. Upload Size: 150M | Max. POST Size: 150M | Max. Input Time: 60 | Max. Execution Time: 180 | Memory Limit: 1024M

Database Configuration :: Version: 5.6.49-log (Client:mysqlnd 7.4.13) | Database Size: 503.92 MiB | #of Tables with config prefix:  87 | #of other Tables:  0 | User Privileges : GRANT ALL

PHP Extensions :: Core (7.4.13) | date (7.4.13) | libxml (7.4.13) | openssl (7.4.13) | pcre (7.4.13) | zlib (7.4.13) | filter (7.4.13) | hash (7.4.13) | pcntl (7.4.13) | readline (7.4.13) | Reflection (7.4.13) | SPL (7.4.13) | session (7.4.13) | standard (7.4.13) | cgi-fcgi (7.4.13) | bcmath (7.4.13) | bz2 (7.4.13) | calendar (7.4.13) | ctype (7.4.13) | curl (7.4.13) | dom (20031129) | mbstring (7.4.13) | fileinfo (7.4.13) | ftp (7.4.13) | gd (7.4.13) | gettext (7.4.13) | iconv (7.4.13) | imap (7.4.13) | intl (7.4.13) | json (7.4.13) | exif (7.4.13) | mysqlnd (mysqlnd 7.4.13) | PDO (7.4.13) | Phar (7.4.13) | posix (7.4.13) | SimpleXML (7.4.13) | soap (7.4.13) | sockets (7.4.13) | sqlite3 (7.4.13) | tokenizer (7.4.13) | xml (7.4.13) | xmlwriter (7.4.13) | xsl (7.4.13) | zip (1.15.6) | mysqli (7.4.13) | pdo_mysql (7.4.13) | pdo_sqlite (7.4.13) | xmlreader (7.4.13) | xmlrpc (7.4.13) | imagick (3.4.4) | ionCube Loader (10.4.5) | Zend OPcache (7.4.13) | Zend Engine (3.4.0) |
Potential Missing Extensions ::
Disabled Functions :: dl | passthru | proc_open | proc_close | proc_terminate | shell_exec | system |

Switch User Environment :: PHP CGI: Yes | Server SU: Yes | PHP SU: Yes | Potential Ownership Issues: No

Core Folders :: images/ (755) | components/ (755) | modules/ (755) | plugins/ (755) | language/ (755) | templates/ (755) | cache/ (755) | logs/ (---) | tmp/ (755) | administrator/components/ (755) | administrator/modules/ (755) | administrator/language/ (755) | administrator/templates/ (755) | administrator/logs/ (755) |

Elevated Permissions (First 10) :: images/description/ (777) |

Database statistics :: Uptime: 3303914 | Threads: 28 | Questions: 3658049480 | Slow queries: 538760 | Opens: 39612324 | Flush tables: 401 | Open tables: 2000 | Queries per second avg: 1107.186 |

Components :: Site ::
Core :: com_wrapper (3.0.0) 1 | com_mailto (3.0.0) 1 |
3rd Party::

Components :: Admin ::
Core :: com_ajax (3.2.0) 1 | com_fields (3.7.0) 1 | com_admin (3.0.0) 1 | com_checkin (3.0.0) 1 | com_plugins (3.0.0) 1 | com_contenthistory (3.2.0) 1 | com_media (3.0.0) 1 | com_actionlogs (3.9.0) 1 | com_content (3.0.0) 1 | com_languages (3.0.0) 1 | com_categories (3.0.0) 1 | com_menus (3.0.0) 1 | com_postinstall (3.2.0) 1 | com_cpanel (3.0.0) 1 | com_privacy (3.9.0) 1 | com_cache (3.0.0) 1 | com_templates (3.0.0) 1 | com_redirect (3.0.0) 1 | com_banners (3.0.0) 1 | com_associations (3.7.0) 1 | com_config (3.0.0) 1 | com_search (3.0.0) 1 | com_users (3.0.0) 1 | com_joomlaupdate (3.6.2) 1 | com_tags (3.1.0) 1 | com_login (3.0.0) 1 | com_messages (3.0.0) 1 | com_installer (3.0.0) 1 | com_modules (3.0.0) 1 | com_newsfeeds (3.0.0) 1 | com_finder (3.0.0) 1 |
3rd Party:: Smart Slider 3 (3.4.1.15) 1 |

Modules :: Site ::
Core :: mod_articles_news (3.0.0) 1 | mod_search (3.0.0) 1 | mod_articles_archive (3.0.0) 1 | mod_menu (3.0.0) 1 | mod_languages (3.5.0) 1 | mod_stats (3.0.0) 1 | mod_syndicate (3.0.0) 1 | mod_articles_category (3.0.0) 1 | mod_tags_popular (3.1.0) 1 | mod_banners (3.0.0) 1 | mod_articles_categories (3.0.0) 1 | mod_login (3.0.0) 1 | mod_feed (3.0.0) 1 | mod_related_items (3.0.0) 1 | mod_whosonline (3.0.0) 1 | mod_custom (3.0.0) 1 | mod_articles_latest (3.0.0) 1 | mod_articles_popular (3.0.0) 1 | mod_breadcrumbs (3.0.0) 1 | mod_footer (3.0.0) 1 | mod_random_image (3.0.0) 1 | mod_wrapper (3.0.0) 1 | mod_users_latest (3.0.0) 1 | mod_finder (3.0.0) 1 | mod_tags_similar (3.1.0) 1 |
3rd Party:: Smart Slider 3 Module (3.4.1.15) 1 |

Modules :: Admin ::
Core :: mod_quickicon (3.0.0) 1 | mod_status (3.0.0) 1 | mod_latestactions (3.9.0) 1 | mod_menu (3.0.0) 1 | mod_privacy_dashboard (3.9.0) 1 | mod_version (3.0.0) 1 | mod_stats_admin (3.0.0) 1 | mod_title (3.0.0) 1 | mod_sampledata (3.8.0) 1 | mod_login (3.0.0) 1 | mod_multilangstatus (3.0.0) 1 | mod_feed (3.0.0) 1 | mod_custom (3.0.0) 1 | mod_submenu (3.0.0) 1 | mod_toolbar (3.0.0) 1 | mod_popular (3.0.0) 1 | mod_latest (3.0.0) 1 | mod_logged (3.0.0) 1 |
3rd Party::

Libraries ::
Core ::
3rd Party::

Plugins ::
Core :: plg_captcha_recaptcha (3.4.0) 0 | plg_captcha_recaptcha_invisible (3.8) 0 | plg_system_highlight (3.0.0) 1 | plg_system_logrotation (3.9.0) 1 | plg_system_languagecode (3.0.0) 0 | plg_system_stats (3.5.0) 1 | plg_system_p3p (3.0.0) 0 | plg_system_fields (3.7.0) 1 | plg_system_remember (3.0.0) 1 | plg_system_languagefilter (3.0.0) 0 | plg_system_privacyconsent (3.9.0) 0 | plg_system_logout (3.0.0) 1 | plg_system_updatenotification (3.5.0) 1 | plg_system_sef (3.0.0) 1 | PLG_SYSTEM_ACTIONLOGS (3.9.0) 1 | plg_system_cache (3.0.0) 0 | plg_system_sessiongc (3.8.6) 1 | plg_system_debug (3.0.0) 1 | plg_system_log (3.0.0) 1 | plg_system_redirect (3.0.0) 0 | plg_authentication_joomla (3.0.0) 1 | plg_authentication_ldap (3.0.0) 0 | plg_authentication_cookie (3.0.0) 1 | plg_authentication_gmail (3.0.0) 0 | plg_fields_calendar (3.7.0) 1 | plg_fields_textarea (3.7.0) 1 | plg_fields_integer (3.7.0) 1 | plg_fields_checkboxes (3.7.0) 1 | plg_fields_url (3.7.0) 1 | plg_fields_usergrouplist (3.7.0) 1 | plg_fields_repeatable (3.9.0) 1 | plg_fields_sql (3.7.0) 1 | plg_fields_text (3.7.0) 1 | plg_fields_imagelist (3.7.0) 1 | plg_fields_user (3.7.0) 1 | plg_fields_color (3.7.0) 1 | plg_fields_list (3.7.0) 1 | plg_fields_media (3.7.0) 1 | plg_fields_editor (3.7.0) 1 | plg_fields_radio (3.7.0) 1 | PLG_ACTIONLOG_JOOMLA (3.9.0) 1 | plg_editors-xtd_fields (3.7.0) 1 | plg_editors-xtd_module (3.5.0) 1 | plg_editors-xtd_pagebreak (3.0.0) 1 | plg_editors-xtd_image (3.0.0) 1 | plg_editors-xtd_menu (3.7.0) 1 | plg_editors-xtd_article (3.0.0) 1 | plg_editors-xtd_readmore (3.0.0) 1 | PLG_INSTALLER_URLINSTALLER (3.6.0) 1 | PLG_INSTALLER_FOLDERINSTALLER (3.6.0) 1 | plg_installer_packageinstaller (3.6.0) 1 | plg_quickicon_extensionupdate (3.0.0) 1 | plg_quickicon_privacycheck (3.9.0) 1 | plg_quickicon_joomlaupdate (3.0.0) 1 | plg_quickicon_phpversioncheck (3.7.0) 1 | plg_finder_newsfeeds (3.0.0) 1 | plg_finder_contacts (3.0.0) 1 | plg_finder_tags (3.0.0) 1 | plg_finder_categories (3.0.0) 1 | plg_finder_content (3.0.0) 1 | plg_extension_joomla (3.0.0) 1 | plg_content_vote (3.0.0) 0 | plg_content_joomla (3.0.0) 1 | plg_content_confirmconsent (3.9.0) 0 | plg_content_fields (3.7.0) 1 | plg_content_pagenavigation (3.0.0) 1 | plg_content_finder (3.0.0) 0 | plg_content_pagebreak (3.0.0) 1 | plg_content_emailcloak (3.0.0) 1 | plg_content_loadmodule (3.0.0) 1 | plg_user_contactcreator (3.0.0) 0 | plg_user_joomla (3.0.0) 1 | plg_user_terms (3.9.0) 0 | plg_user_profile (3.0.0) 0 | plg_search_newsfeeds (3.0.0) 1 | plg_search_contacts (3.0.0) 1 | plg_search_tags (3.0.0) 1 | plg_search_categories (3.0.0) 1 | plg_search_content (3.0.0) 1 | plg_twofactorauth_totp (3.2.0) 0 | plg_twofactorauth_yubikey (3.2.0) 0 | plg_privacy_content (3.9.0) 1 | plg_privacy_user (3.9.0) 1 | plg_privacy_actionlogs (3.9.0) 1 | plg_privacy_message (3.9.0) 1 | plg_privacy_consents (3.9.0) 1 |
3rd Party:: Smart Slider 3 System Plugin (3.4.1.15) 1 | System - Helix3 Framework (2.5.7) 1 | Smart Slider 3 Updater Plugin (3.4.1.15) 0 | plg_editors_codemirror (5.56.0) 1 | plg_editors_tinymce (4.5.12) 1 | Helix3 - Ajax (2.5.7) 1 |

Templates :: Site :: protostar (1.0) 1 | beez3 (3.1.0) 1 | Flex (3.9.2) 1 |
Templates :: Admin :: isis (1.0) 1 | hathor (3.0.0) 1 |

[darb]

Ok so you have a WP site that is working and now you want to make another similar copy for Joomla?

I have this template for one site too and I just see quickly you have some old system plg there. System - Helix3 Framework (2.5.7) should be 2.5.8

Maybe you can start just for updating your template, repair & optimise all db tables and see how that goes. Seems to be a db issue I guess but I am not good at db problems. I think you can use some other performance options later for this site to with some Joomla extensions for that.

Is your WP and Joomla site on the same server?

[Sn0rlaX]

I have this template for one site too and I just see quickly you have some old system plg there. System - Helix3 Framework (2.5.7) should be 2.5.8

Maybe you can start just for updating your template, repair & optimise all db tables and see how that goes.

Is your WP and Joomla site on the same server?

Tables are already repaired and optimized in PHPMyAdmin.
Template is not the problem. Site is slow in back-end side too, and already tried to switch to default Joomla template with no success.

Is your WP and Joomla site on the same server?

No.

[darb]

Template is not the problem. Site is slow in back-end side too, and already tried to switch to default Joomla template with no success.

Ok have you tried to get some support from hosting provider ? create a ticket there and see if they also can help to investigate whats wrong with the performance. If Joomla slow in back-end it also show it could be something with the server,db and hosting.

[Sn0rlaX]

Ok have you tried to get some support from hosting provider ? create a ticket there and see if they also can help to investigate whats wrong with the performance. If Joomla slow in back-end it also show it could be something with the server,db and hosting.

I'll try with a ticket too. You think performance issue is not related to Joomla! not optimized query for large contents?

[Sn0rlaX]

No problems on hosting provider. Query seems to be ok (1.5 sec all query).
The problem is on "afterRenderComponent com_content" working for 22 sec!
Any suggest?