Very poor performance with 15k articles

Discussion regarding Joomla! 3.x Performance issues.

Moderators: General Support Moderators, General Support Moderators

Forum rules
Forum Rules
Absolute Beginner's Guide to Joomla! <-- please read before posting, this means YOU.
Forum Post Assistant - If you are serious about wanting help, you will use this tool to help you post.
Windows Defender SmartScreen Issues <-- please read this if using Windows 10.
Post Reply
Sn0rlaX
Joomla! Apprentice
Joomla! Apprentice
Posts: 6
Joined: Mon Jan 18, 2021 9:42 am

Very poor performance with 15k articles

Post by Sn0rlaX » Mon Jan 18, 2021 9:58 am

Hi. I've 15k articles into a new (in development) Joomla site.
Site is multilanguage (ENG-ITA): articles are in english and italian. It is very slow to show front-end and back-end contents.
This is profile information:

Code: Select all

Time: 41.57 ms / 41.57 ms Memory: 0.541 MB / 0.88 MB Application: afterLoad
Time: 112.85 ms / 154.42 ms Memory: 1.081 MB / 1.96 MB Application: afterInitialise
Time: 22.03 ms / 176.46 ms Memory: 0.236 MB / 2.20 MB Application: afterRoute
Time: 8.69 ms / 185.15 ms Memory: 0.277 MB / 2.47 MB Application: beforeRenderComponent com_content
Time: 16.52 ms / 201.66 ms Memory: 0.131 MB / 2.61 MB Application: Before Access::preloadComponents (all components)
Time: 1.38 ms / 203.05 ms Memory: 0.053 MB / 2.66 MB Application: After Access::preloadComponents (all components)
Time: 0.03 ms / 203.08 ms Memory: -0.003 MB / 2.65 MB Application: Before Access::getAssetRules (id:8 name:com_content)
Time: 1.16 ms / 204.23 ms Memory: 0.071 MB / 2.73 MB Application: After Access::getAssetRules (id:8 name:com_content)
Time: 22788.08 ms / 22992.31 ms Memory: 211.558 MB / 214.28 MB Application: afterRenderComponent com_content
Time: 1.11 ms / 22993.43 ms Memory: 0.007 MB / 214.29 MB Application: afterDispatch
Time: 54.04 ms / 23047.47 ms Memory: 0.257 MB / 214.55 MB Application: afterRender

Database queries total: 1560.38 ms
Some queries seems very slow... i don't think this is normal.
Any idea?

Code: Select all

27 Queries Logged: 1560.38 ms
Thanks in advance

Code: Select all

Joomla! version: 3.9.24 Stable
PHP Version: 7.4.13
mysql: 5.6.49-log

No JCH Optimize, Caching OFF.
Session Handler: PHP

vishwas_22
I've been banned!
Posts: 1
Joined: Mon Jan 11, 2021 10:53 am

Re: Very poor performance with 15k articles

Post by vishwas_22 » Mon Jan 18, 2021 10:39 am

That said, if you have to do this for more articles than just one I would probably take a different approach:

1 - when importing the data make sure that the old IDs are ported over, if you don't want to use them as IDs again you could add them to a column such as old_id or similar.

2 - write a PHP script that expects an old ID as parameter and issues a 301 redirect to the new URL by pulling the reuqired info from the DB.

3 - add an htaccess rule to force all old URLs to the PHP script:

RewriteRule ^content/view/full/([0-9]+) old_to_new_article_redirect.php?old_id=$1

Sn0rlaX
Joomla! Apprentice
Joomla! Apprentice
Posts: 6
Joined: Mon Jan 18, 2021 9:42 am

Re: Very poor performance with 15k articles

Post by Sn0rlaX » Mon Jan 18, 2021 11:05 am

Hi vishwas_22, thanks for reply.
Articles are imported from wordpress and inserted in Joomla as new articles, so there are no old ids to keep.

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1706
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: Very poor performance with 15k articles

Post by darb » Mon Jan 18, 2021 11:12 am

Hi Sn0rlaX thanks for joining the Joomla free real open source community.

To better help you can you please give us the url so we can check and really help you with you site?

Its crucial so we can se whats going on and also you can make a FPA of your site?

More info here: viewtopic.php?f=714&t=757645

Download and RUN the Forum Post Assistant / FPA Instructions

Sn0rlaX
Joomla! Apprentice
Joomla! Apprentice
Posts: 6
Joined: Mon Jan 18, 2021 9:42 am

Re: Very poor performance with 15k articles

Post by Sn0rlaX » Mon Jan 18, 2021 11:24 am

Hi darb, site URL is:

d i s c o v e r p l a c e s . i t

This is the FPA results:
Forum Post Assistant (v1.6.2) : 18-Jan-2021 wrote:
Basic Environment :: wrote:Joomla! Instance :: Joomla! 3.9.24-Stable (Amani) 12-January-2021
Joomla! Platform :: Joomla Platform 13.1.0-Stable (Curiosity) 24-Apr-2013
Joomla! Configured :: Yes | Read-Only (444) |
Configuration Options :: Offline: false | SEF: true | SEF Suffix: false | SEF ReWrite: true | .htaccess/web.config: Yes | GZip: true | Cache: false | CacheTime: 15 | CacheHandler: file | CachePlatformPrefix: false | FTP Layer: false | Proxy: false | LiveSite: | Session lifetime: 15 | Session handler: none | Shared sessions: false | SSL: 2 | Error Reporting: none | Site Debug: false | Language Debug: false | Default Access: 1 | Unicode Slugs: false | dbConnection Type: mysqli | PHP Supports J! 3.9.24: Yes | Database Supports J! 3.9.24: Yes | Database Credentials Present: Yes |

Host Configuration :: OS: Linux | OS Version: 3.10.0-1160.6.1.el7.x86_64 | Technology: x86_64 | Web Server: Apache | Encoding: gzip, deflate, br | System TMP Writable: Yes | Free Disk Space : 326.03 GiB |

PHP Configuration :: Version: 7.4.13 | PHP API: cgi-fcgi | Session Path Writable: Yes | Display Errors: | Error Reporting: 32759 | Log Errors To: /home/ndiscovq/error_log_php | Last Known Error: 15th January 2021 03:14:16. | Register Globals: | Magic Quotes: | Safe Mode: | Allow url fopen: 1 | Open Base: /home/ndiscovq/:/opt/cpanel/ea-php74/root/usr:/usr/local/lib/php:/tmp:/etc/pki/tls/certs/ca-bundle.crt:/var/cpanel/php/sessions | Uploads: 1 | Max. Upload Size: 150M | Max. POST Size: 150M | Max. Input Time: 60 | Max. Execution Time: 180 | Memory Limit: 1024M

Database Configuration :: Version: 5.6.49-log (Client:mysqlnd 7.4.13) | Database Size: 503.92 MiB | #of Tables with config prefix:  87 | #of other Tables:  0 | User Privileges : GRANT ALL
Detailed Environment :: wrote:PHP Extensions :: Core (7.4.13) | date (7.4.13) | libxml (7.4.13) | openssl (7.4.13) | pcre (7.4.13) | zlib (7.4.13) | filter (7.4.13) | hash (7.4.13) | pcntl (7.4.13) | readline (7.4.13) | Reflection (7.4.13) | SPL (7.4.13) | session (7.4.13) | standard (7.4.13) | cgi-fcgi (7.4.13) | bcmath (7.4.13) | bz2 (7.4.13) | calendar (7.4.13) | ctype (7.4.13) | curl (7.4.13) | dom (20031129) | mbstring (7.4.13) | fileinfo (7.4.13) | ftp (7.4.13) | gd (7.4.13) | gettext (7.4.13) | iconv (7.4.13) | imap (7.4.13) | intl (7.4.13) | json (7.4.13) | exif (7.4.13) | mysqlnd (mysqlnd 7.4.13) | PDO (7.4.13) | Phar (7.4.13) | posix (7.4.13) | SimpleXML (7.4.13) | soap (7.4.13) | sockets (7.4.13) | sqlite3 (7.4.13) | tokenizer (7.4.13) | xml (7.4.13) | xmlwriter (7.4.13) | xsl (7.4.13) | zip (1.15.6) | mysqli (7.4.13) | pdo_mysql (7.4.13) | pdo_sqlite (7.4.13) | xmlreader (7.4.13) | xmlrpc (7.4.13) | imagick (3.4.4) | ionCube Loader (10.4.5) | Zend OPcache (7.4.13) | Zend Engine (3.4.0) |
Potential Missing Extensions ::
Disabled Functions :: dl | passthru | proc_open | proc_close | proc_terminate | shell_exec | system |

Switch User Environment :: PHP CGI: Yes | Server SU: Yes | PHP SU: Yes | Potential Ownership Issues: No
Folder Permissions :: wrote:Core Folders :: images/ (755) | components/ (755) | modules/ (755) | plugins/ (755) | language/ (755) | templates/ (755) | cache/ (755) | logs/ (---) | tmp/ (755) | administrator/components/ (755) | administrator/modules/ (755) | administrator/language/ (755) | administrator/templates/ (755) | administrator/logs/ (755) |

Elevated Permissions (First 10) :: images/description/ (777) |
Database Information :: wrote:Database statistics :: Uptime: 3303914 | Threads: 28 | Questions: 3658049480 | Slow queries: 538760 | Opens: 39612324 | Flush tables: 401 | Open tables: 2000 | Queries per second avg: 1107.186 |
Extensions Discovered :: wrote:Components :: Site ::
Core :: com_wrapper (3.0.0) 1 | com_mailto (3.0.0) 1 |
3rd Party::

Components :: Admin ::
Core :: com_ajax (3.2.0) 1 | com_fields (3.7.0) 1 | com_admin (3.0.0) 1 | com_checkin (3.0.0) 1 | com_plugins (3.0.0) 1 | com_contenthistory (3.2.0) 1 | com_media (3.0.0) 1 | com_actionlogs (3.9.0) 1 | com_content (3.0.0) 1 | com_languages (3.0.0) 1 | com_categories (3.0.0) 1 | com_menus (3.0.0) 1 | com_postinstall (3.2.0) 1 | com_cpanel (3.0.0) 1 | com_privacy (3.9.0) 1 | com_cache (3.0.0) 1 | com_templates (3.0.0) 1 | com_redirect (3.0.0) 1 | com_banners (3.0.0) 1 | com_associations (3.7.0) 1 | com_config (3.0.0) 1 | com_search (3.0.0) 1 | com_users (3.0.0) 1 | com_joomlaupdate (3.6.2) 1 | com_tags (3.1.0) 1 | com_login (3.0.0) 1 | com_messages (3.0.0) 1 | com_installer (3.0.0) 1 | com_modules (3.0.0) 1 | com_newsfeeds (3.0.0) 1 | com_finder (3.0.0) 1 |
3rd Party:: Smart Slider 3 (3.4.1.15) 1 |

Modules :: Site ::
Core :: mod_articles_news (3.0.0) 1 | mod_search (3.0.0) 1 | mod_articles_archive (3.0.0) 1 | mod_menu (3.0.0) 1 | mod_languages (3.5.0) 1 | mod_stats (3.0.0) 1 | mod_syndicate (3.0.0) 1 | mod_articles_category (3.0.0) 1 | mod_tags_popular (3.1.0) 1 | mod_banners (3.0.0) 1 | mod_articles_categories (3.0.0) 1 | mod_login (3.0.0) 1 | mod_feed (3.0.0) 1 | mod_related_items (3.0.0) 1 | mod_whosonline (3.0.0) 1 | mod_custom (3.0.0) 1 | mod_articles_latest (3.0.0) 1 | mod_articles_popular (3.0.0) 1 | mod_breadcrumbs (3.0.0) 1 | mod_footer (3.0.0) 1 | mod_random_image (3.0.0) 1 | mod_wrapper (3.0.0) 1 | mod_users_latest (3.0.0) 1 | mod_finder (3.0.0) 1 | mod_tags_similar (3.1.0) 1 |
3rd Party:: Smart Slider 3 Module (3.4.1.15) 1 |

Modules :: Admin ::
Core :: mod_quickicon (3.0.0) 1 | mod_status (3.0.0) 1 | mod_latestactions (3.9.0) 1 | mod_menu (3.0.0) 1 | mod_privacy_dashboard (3.9.0) 1 | mod_version (3.0.0) 1 | mod_stats_admin (3.0.0) 1 | mod_title (3.0.0) 1 | mod_sampledata (3.8.0) 1 | mod_login (3.0.0) 1 | mod_multilangstatus (3.0.0) 1 | mod_feed (3.0.0) 1 | mod_custom (3.0.0) 1 | mod_submenu (3.0.0) 1 | mod_toolbar (3.0.0) 1 | mod_popular (3.0.0) 1 | mod_latest (3.0.0) 1 | mod_logged (3.0.0) 1 |
3rd Party::

Libraries ::
Core ::
3rd Party::

Plugins ::
Core :: plg_captcha_recaptcha (3.4.0) 0 | plg_captcha_recaptcha_invisible (3.8) 0 | plg_system_highlight (3.0.0) 1 | plg_system_logrotation (3.9.0) 1 | plg_system_languagecode (3.0.0) 0 | plg_system_stats (3.5.0) 1 | plg_system_p3p (3.0.0) 0 | plg_system_fields (3.7.0) 1 | plg_system_remember (3.0.0) 1 | plg_system_languagefilter (3.0.0) 0 | plg_system_privacyconsent (3.9.0) 0 | plg_system_logout (3.0.0) 1 | plg_system_updatenotification (3.5.0) 1 | plg_system_sef (3.0.0) 1 | PLG_SYSTEM_ACTIONLOGS (3.9.0) 1 | plg_system_cache (3.0.0) 0 | plg_system_sessiongc (3.8.6) 1 | plg_system_debug (3.0.0) 1 | plg_system_log (3.0.0) 1 | plg_system_redirect (3.0.0) 0 | plg_authentication_joomla (3.0.0) 1 | plg_authentication_ldap (3.0.0) 0 | plg_authentication_cookie (3.0.0) 1 | plg_authentication_gmail (3.0.0) 0 | plg_fields_calendar (3.7.0) 1 | plg_fields_textarea (3.7.0) 1 | plg_fields_integer (3.7.0) 1 | plg_fields_checkboxes (3.7.0) 1 | plg_fields_url (3.7.0) 1 | plg_fields_usergrouplist (3.7.0) 1 | plg_fields_repeatable (3.9.0) 1 | plg_fields_sql (3.7.0) 1 | plg_fields_text (3.7.0) 1 | plg_fields_imagelist (3.7.0) 1 | plg_fields_user (3.7.0) 1 | plg_fields_color (3.7.0) 1 | plg_fields_list (3.7.0) 1 | plg_fields_media (3.7.0) 1 | plg_fields_editor (3.7.0) 1 | plg_fields_radio (3.7.0) 1 | PLG_ACTIONLOG_JOOMLA (3.9.0) 1 | plg_editors-xtd_fields (3.7.0) 1 | plg_editors-xtd_module (3.5.0) 1 | plg_editors-xtd_pagebreak (3.0.0) 1 | plg_editors-xtd_image (3.0.0) 1 | plg_editors-xtd_menu (3.7.0) 1 | plg_editors-xtd_article (3.0.0) 1 | plg_editors-xtd_readmore (3.0.0) 1 | PLG_INSTALLER_URLINSTALLER (3.6.0) 1 | PLG_INSTALLER_FOLDERINSTALLER (3.6.0) 1 | plg_installer_packageinstaller (3.6.0) 1 | plg_quickicon_extensionupdate (3.0.0) 1 | plg_quickicon_privacycheck (3.9.0) 1 | plg_quickicon_joomlaupdate (3.0.0) 1 | plg_quickicon_phpversioncheck (3.7.0) 1 | plg_finder_newsfeeds (3.0.0) 1 | plg_finder_contacts (3.0.0) 1 | plg_finder_tags (3.0.0) 1 | plg_finder_categories (3.0.0) 1 | plg_finder_content (3.0.0) 1 | plg_extension_joomla (3.0.0) 1 | plg_content_vote (3.0.0) 0 | plg_content_joomla (3.0.0) 1 | plg_content_confirmconsent (3.9.0) 0 | plg_content_fields (3.7.0) 1 | plg_content_pagenavigation (3.0.0) 1 | plg_content_finder (3.0.0) 0 | plg_content_pagebreak (3.0.0) 1 | plg_content_emailcloak (3.0.0) 1 | plg_content_loadmodule (3.0.0) 1 | plg_user_contactcreator (3.0.0) 0 | plg_user_joomla (3.0.0) 1 | plg_user_terms (3.9.0) 0 | plg_user_profile (3.0.0) 0 | plg_search_newsfeeds (3.0.0) 1 | plg_search_contacts (3.0.0) 1 | plg_search_tags (3.0.0) 1 | plg_search_categories (3.0.0) 1 | plg_search_content (3.0.0) 1 | plg_twofactorauth_totp (3.2.0) 0 | plg_twofactorauth_yubikey (3.2.0) 0 | plg_privacy_content (3.9.0) 1 | plg_privacy_user (3.9.0) 1 | plg_privacy_actionlogs (3.9.0) 1 | plg_privacy_message (3.9.0) 1 | plg_privacy_consents (3.9.0) 1 |
3rd Party:: Smart Slider 3 System Plugin (3.4.1.15) 1 | System - Helix3 Framework (2.5.7) 1 | Smart Slider 3 Updater Plugin (3.4.1.15) 0 | plg_editors_codemirror (5.56.0) 1 | plg_editors_tinymce (4.5.12) 1 | Helix3 - Ajax (2.5.7) 1 |
Templates Discovered :: wrote:Templates :: Site :: protostar (1.0) 1 | beez3 (3.1.0) 1 | Flex (3.9.2) 1 |
Templates :: Admin :: isis (1.0) 1 | hathor (3.0.0) 1 |

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1706
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: Very poor performance with 15k articles

Post by darb » Mon Jan 18, 2021 12:00 pm

Ok so you have a WP site that is working and now you want to make another similar copy for Joomla?

I have this template for one site too and I just see quickly you have some old system plg there. System - Helix3 Framework (2.5.7) should be 2.5.8

Maybe you can start just for updating your template, repair & optimise all db tables and see how that goes. Seems to be a db issue I guess but I am not good at db problems. I think you can use some other performance options later for this site to with some Joomla extensions for that.

Is your WP and Joomla site on the same server?
Last edited by darb on Mon Jan 18, 2021 12:11 pm, edited 1 time in total.

Sn0rlaX
Joomla! Apprentice
Joomla! Apprentice
Posts: 6
Joined: Mon Jan 18, 2021 9:42 am

Re: Very poor performance with 15k articles

Post by Sn0rlaX » Mon Jan 18, 2021 12:07 pm

darb wrote:
Mon Jan 18, 2021 12:00 pm
I have this template for one site too and I just see quickly you have some old system plg there. System - Helix3 Framework (2.5.7) should be 2.5.8

Maybe you can start just for updating your template, repair & optimise all db tables and see how that goes.

Is your WP and Joomla site on the same server?
Tables are already repaired and optimized in PHPMyAdmin.
Template is not the problem. Site is slow in back-end side too, and already tried to switch to default Joomla template with no success.
darb wrote:
Mon Jan 18, 2021 12:00 pm
Is your WP and Joomla site on the same server?
No.

User avatar
darb
Joomla! Ace
Joomla! Ace
Posts: 1706
Joined: Thu Jul 06, 2006 12:57 pm
Location: Stockholm Sweden
Contact:

Re: Very poor performance with 15k articles

Post by darb » Mon Jan 18, 2021 12:18 pm

Template is not the problem. Site is slow in back-end side too, and already tried to switch to default Joomla template with no success.
Ok have you tried to get some support from hosting provider ? create a ticket there and see if they also can help to investigate whats wrong with the performance. If Joomla slow in back-end it also show it could be something with the server,db and hosting.

Sn0rlaX
Joomla! Apprentice
Joomla! Apprentice
Posts: 6
Joined: Mon Jan 18, 2021 9:42 am

Re: Very poor performance with 15k articles

Post by Sn0rlaX » Mon Jan 18, 2021 12:35 pm

darb wrote:
Mon Jan 18, 2021 12:18 pm
Ok have you tried to get some support from hosting provider ? create a ticket there and see if they also can help to investigate whats wrong with the performance. If Joomla slow in back-end it also show it could be something with the server,db and hosting.
I'll try with a ticket too. You think performance issue is not related to Joomla! not optimized query for large contents?

Sn0rlaX
Joomla! Apprentice
Joomla! Apprentice
Posts: 6
Joined: Mon Jan 18, 2021 9:42 am

Re: Very poor performance with 15k articles

Post by Sn0rlaX » Mon Jan 18, 2021 4:02 pm

No problems on hosting provider. Query seems to be ok (1.5 sec all query).
The problem is on "afterRenderComponent com_content" working for 22 sec!
Any suggest?


Post Reply

Return to “Performance - Joomla! 3.x”