setUTF() is not working ? (cautious of a multibyte)

[yumikom]

I announce you the problem which I experienced.

The filter by title is not woking in backend article list.
A result is not obtained after I search a title by filter.

This problem is reproduced only when multibyte is inputted.


I found the cause.
Default character set was not set up correctly, when filter function was performed.
It was a problem of the default character set in MySQL controller.


The following core function.
/libraries/joomla/database/database/mysqli.php
function setUTF()
*This function is called when connecting with mysql.

original code
mysqli_query($this->connection, "SET NAMES 'utf8'");

changed code
mysqli_set_charset($this->connection, 'utf8');


The setting of default character set affects mysqli::real_escape_string.
"SET NAMES utf8" Will not affect $mysqli->real_escape_string()
Reference: http://php.net/manual/en/mysqlinfo.concepts.charset.php

I hope that a core package will be changed.

Thanks.


Using：
Joomla!2.5
Language: Japanese
PHP 5.4
MySQL: 5.5
MySQL client: MySQL Native Driver (mysqlnd)
*This problem does not occur in MySQL Client Library (libmysqlclient).

[infograf768]

Could you please paste here the characters/glyphs you have an issue with?
I can filter OK here article titles using Chinese or Japanese glyphs and we never heard from these users about any issue with mysqli and filtering titles.

Also, can you make a test with the version 3.3.0 of Joomla? The code used is slightly different there.

[yumikom]

Thanks Master !

Japanese glyphs
article title 美術手帖
filter by title 美術


This is the first time that I also discovered this problem.
If time is got for a while, I can test with Jooml!3.3.0.

[yumikom]

I could with the version 3.3.0 of Joomla!
This problem did not happen with Joomla! 3.3. Search function in article list is working cool.

This problem is dependent on server environment. ( MySQL mysqlnd and PHP version )
I tested by the same server as a problem with Joomla!2.5x occurs.

Thanks.

[infograf768]

OK, I will let it know that mysqlnd is the culprit on 2.5

We could port back to 2.5 our 3.3 code

[yumikom]

I thank for your devoted support and great Joomla! community.

[Bakual]

Can you test this PR: https://github.com/joomla/joomla-cms/pull/3731

[yumikom]

It is the same as this code which I tested and It's working.

Thanks.

[Bakual]

Can you please add a comment on the PR?

[infograf768]

I merged, Thomas.

[Bakual]

Even better