Joomla! Forum - community, help and support

Hello
in joomla 1.0.X series,database was latin1
and saved data same : U…?آ±Uئ’?آ² Uâ€،Uâ€

but in joomla 1.5 have change,and saved good data
for example U…?آ±Uئ’?آ² Uâ€،U†==> ُسلام.تست

how may i convert mysql to utf8?and solved charsets? and chars?

com_migrator,done this work
but is just for content,users and ...
but is not for fully database

Thanks

Hello Mostafa,

Just make a dump of the database choosing utf8 as encoding.
Then, to be sure, open the dump in an utf8 editor and check all is OK.

Hello jeans
thanks

i going to phpmyadmin,export joomla 1.0.x series database.
then i open this file into notepad++

and id not good

Thanks jean

Same problem here, how can I export as UTF-8?

Hello,

Simply ... export the tables with phpmyadmin in SQL format. Edit the .sql file with Wordpad (or other editor), replace "latin1" with "utf8" and save the file. Then, import the file with phpmyadmin...

@yamadix

thanx for the reply friend ... but there's a little problem ... my exported .sql backup from phpmyadmin doesn't show character sets for tables creation .. am i missing an option or so in phpmyadmin ??

Hello,

In the SQL-Export, for each table, you must find this line :

ENGINE=MyISAM DEFAULT CHARSET=latin1;

If no, I am sorry ... I don't have an other response !

all that i got is Type=MyISAM ... only. Anyway i'll give it a try with ENGINE=MyISAM DEFAULT CHARSET=latin1; instead of the Type may be it'll work

xenome, take in mind next SQL queries:
DB charset replacement: ALTER DATABASE `db_name` COLLATE utf8_general_ci
Table charset replacement: ALTER TABLE `table_name` COLLATE utf8_general_ci

Where db_name and table_name - you have to use the right data.

xenome wrote:all that i got is Type=MyISAM ... only. Anyway i'll give it a try with ENGINE=MyISAM DEFAULT CHARSET=latin1; instead of the Type may be it'll work

This WILL NOT work in Joomla 1.5.
1.5 is fully utf8.
The default charset does not need to be set in the dump if the database is correctly collated.

Hi,

I got similar problem, but I can't edit my dump file because it's 400 MB. I used the iconv to convert the database dump to UTF8 from Latin1, when I import it to the Joomla 1.5.15 it shows garbage and changes the system info in Joomla from UTF8 to Latin 1, Any idea how can I fix this problem?

Thanks

We have discussed this issue thoroughly in the Arabic forum and solve the issue. There are several things to put in mind like collision must be utf-8 for all fields as well. I used a script to do that for me and I attached it (use on your own risk and you must backup your database). go to this link:
http://forum.joomla.org/viewtopic.php?p=823601#p823601
rename the file to index.php and upload in a folder in your website. Finally, enter db info and it will change all necessary fields, tables and so on to utf-8

A trick I used as well for Arabic, I assume for Urdu it will work, is to insert the contents of your .sql file in an html page (as an article in the old joomla that used to work) then show the page online and it will show the sql code along with the correct text in your language. Copy it from the page and past in notepad++ and save as utf without BOM. Then use it to export to your db.

I hope this helps.

Good luck,
Zak

emakki wrote:We have discussed this issue thoroughly in the Arabic forum and solve the issue. There are several things to put in mind like collision must be utf-8 for all fields as well. I used a script to do that for me and I attached it (use on your own risk and you must backup your database). go to this link:
http://forum.joomla.org/viewtopic.php?p=823601#p823601
rename the file to index.php and upload in a folder in your website. Finally, enter db info and it will change all necessary fields, tables and so on to utf-8

A trick I used as well for Arabic, I assume for Urdu it will work, is to insert the contents of your .sql file in an html page (as an article in the old joomla that used to work) then show the page online and it will show the sql code along with the correct text in your language. Copy it from the page and past in notepad++ and save as utf without BOM. Then use it to export to your db.

I hope this helps.

Good luck,
Zak

Thanks for the suggestion. I will give it a try.

I finally did it. These are the steps:



--------------------------

steps:

1- Install 1.5 without sample data
2- Install com_mtwmigrator-0.2.1 on the new Joomla 1.5
3- Migrate the users and groups only using com_mtwmigrator-0.2.1!
4- Install the Comporfiler
5- Migrate the Comprofiler Plugin data com_mtwmigrator-0.2.1
6- Delete Jos_content, Jos_content_frontpage, Jos_content_rating tables on the new installations
7- Backup the UTF8 converted jos_content, Jos_content_frontpage, Jos_content_rating tables individually.
8- Restore the jos_content, Jos_content_frontpage, Jos_content_rating tables into the new site.
9- The Jos_content table on the new 1.5 has 2 additional fields. Insert them by using the following 2 commands from MyPHP Admin


ALTER TABLE jos_content ADD alias VARCHAR(255) AFTER title;

ALTER TABLE jos_content ADD metadata text AFTER hits;

10- Install the Jomcomment component
11- Migrate the jomcomment data using the com_mtwmigrator from withing the new Joomla 1.5

--------

Converstion of the database:


Drop the database and create a new UTF8 database:

mysql --user=xx--password=xxx--execute="DROP DATABASE XXX; CREATE DATABASE XXX CHARACTER SET utf8 COLLATE utf8_general_ci;"



Restore the database:

mysql --user=XXX --password=XXX --default-character-set=utf8 XXX < XXX


Change the character Set:
sudo sed -e 's/latin1/utf8/g' -i XXX

Thanks Joomlan,
I was stuck in this same UTF-8 problem for the last 3 days. So far your solution seems to work for me as well. Mostafa, yamadix, emakki .. thanks you guys too.

Hello everybody!
I have the same problem.
I have website with 20MB database on Mambo 4.5.5 Stable [ Arpie ] 2-Feb-2007
The collation on mysql database is latin1_swedish_ci. The charset in index.php is windows-1251

I create a new website with joomla 1.5.18 with encoding and collation UTF8.
So , I try to convert the database from latin1 to utf8 with notepad++ , but not work - the cyrillic symbols are not correct.

All database from mambo is latin1_swedish_ci - mos_users, mos_content and etc.


This tips posted in this topic not work for cyrillic. :-(

Can you have a idea how can I migrate from Mambo 4.5.5 to Joomla with different collation in database and different charset in the templates?

Have you tried to first migrate from Mambo to Joomla 1.0 and THEN migrate to 1.5?

infograf768 wrote:Have you tried to first migrate from Mambo to Joomla 1.0 and THEN migrate to 1.5?

Thank you!
First I update from Mambo to Joomla 1.0.15 Stable
After Update from Joomla 1.0.15-Stable to Joomla 1.5.18

Thank you for the reply!
Best regards!

infograf768 wrote:Have you tried to first migrate from Mambo to Joomla 1.0 and THEN migrate to 1.5? Law of Attraction

I'm looking to go from 1.0.13 to 1.6 by way of going to 1.5 first.

I went down the long struggling road of getting Joomla, Coppermine and SMF integrated with a single login - handled by SMF (Joomlahacks).

I'm curious...will I lose these bridges while processing my upgrade to 1.5, or to 1.6 for that matter?

After much Research, i found:
No extensions available for anything that I have...I might have to stick with 1.0.13...too much stuff to sacrifice to make the move to 1.5...unless, there is a better migration script that does everything

joomlan wrote:I finally did it. These are the steps:



--------------------------

steps:

1- Install 1.5 without sample data
2- Install com_mtwmigrator-0.2.1 on the new Joomla 1.5
3- Migrate the users and groups only using com_mtwmigrator-0.2.1!
.
.
.
Change the character Set:
sudo sed -e 's/latin1/utf8/g' -i XXX

Working several hours. Trying to resolve this problem.
This method work for me.

S. Bush

***** Manual signatures are NOT allowed *****_____
My personal website
http://www.ecerdc.com

If you are running language that not English. I recommend to check if it's UTF-8 or not. As UTF-8 support almost every language.

Use Phoca script.
Joomla HAS to be full UTF8

http://forum.joomla.org/viewtopic.php?f=617&t=606004

Actually pretty valuable concoction of encoding tricks. I've been searching around google for this solution. But I would like to share how I did it with a littly different way of steps, including a SED script to whack all those weird characters back into line, and the necessary adjustments for your MYSQL server.

ihave this problem too
i use a script that load the data from my database that have unicode latin
and then i instert in database with utf-8 unicode