Joomla 1.0.x to 1.5 migrator

Pintobean · **Joined:** Fri Oct 21, 2005 8:03 pm **Posts:** 7

Will there be an updated migrator to migrate our data from Joomla 1.0.x to Joomla 1.5 RC1? I tried to use the old migrator and got some errors:

Code:

Warning: file_put_contents(/var/www/joomla15rc1/installation/sql/migration/converted.sql) [function.file-put-contents]: failed to open stream: Permission denied in /var/www/joomla15rc1/installation/installer/helper.php on line 918

Error at the line 192: INSERT INTO `jos_core_acl_aro` (`aro_id`, `section_value`, `value`, `order_value`, `name`, `hidden`) VALUES ( '10', 'users', '62', '0', 'Administrator', '0');

Query: INSERT INTO `jos_core_acl_aro` (`aro_id`, `section_value`, `value`, `order_value`, `name`, `hidden`) VALUES ( '10', 'users', '62', '0', 'Administrator', '0');

MySQL: Unknown column 'aro_id' in 'field list'

Stopped on error

I'm looking forward to the stable release of 1.5, and I'm happy to submit feedback on my attempt to migrate my 1.0.x data to 1.5 RC1.

ianmac · **Posted:** Mon Jul 23, 2007 2:32 am

The migrator is currently a work in progress. It is nearing completion and will go to RC shortly. I'll try and remember and post here when it is ready.

Ian

ianmac · **Posted:** Mon Jul 23, 2007 2:38 am

Well, it seems that the rc of the migrator is ready.

You can find it at:
http://joomlacode.org/gf/project/pasamioprojects/frs/

Ian

sural98 · **Joined:** Fri Feb 17, 2006 5:32 pm **Posts:** 152

ianmac wrote:

Well, it seems that the rc of the migrator is ready.

You can find it at:
http://joomlacode.org/gf/project/pasamioprojects/frs/

Ian

A step-by-step instruction sticky for migration process from 1.0.12 to 1.5RC1 would be useful. I made a clean 1.5RC1 install and would like to use a 1.0.12 DB and I could not understand how to use this package.

Robin · **Joined:** Thu Aug 18, 2005 10:41 am **Posts:** 15089

Hi sural,

If you click on the component in the 1.0.x backend (where you need to install it) you will get some links on the bottom. Check the first link which explains which steps to perform.

Robin · **Joined:** Thu Aug 18, 2005 10:41 am **Posts:** 15089

Moderator note: moving from Development 1.5 to New J1.5 Forum Section

w · **Joined:** Wed Mar 08, 2006 7:49 pm **Posts:** 110

sural98 wrote:

ianmac wrote:

Well, it seems that the rc of the migrator is ready.

You can find it at:
http://joomlacode.org/gf/project/pasamioprojects/frs/

Ian

A step-by-step instruction sticky for migration process from 1.0.12 to 1.5RC1 would be useful. I made a clean 1.5RC1 install and would like to use a 1.0.12 DB and I could not understand how to use this package.

sural98,

You need to install the migrator component on your 1.0.12 site. From there in the admin section, go to the component. There will be text links at the bottom (it's not very intuitive, yet) and click on the last one (forgot it's name). Then you'll go through a couple screens and a download link will be available. Now you use the RC1 installer to upload that sql dump.

I was unable to use the RC1 installer to migrate the old content. So I had to FTP the file to installation/sql/migration/ directory (make sure you change the sql file to migrate.sql if you manually upload). Also, no matter what, the prefix is "jos_" for the old tables. Mine was "mos_" but the migrator component changes it. From there you should be good.

ianmac · **Posted:** Tue Jul 24, 2007 4:19 pm

Hey w,

Since you've used the migrator with some success, would you be willing/able to write up a short howto that we could use as documentation? If you are able it would be greatly appreciated!

I've not had a chance to test it out yet, as I don't have any sites right now that I'm planning on migrating in the short term.

Ian

adiluca · **Joined:** Tue Jul 17, 2007 4:22 pm **Posts:** 40

ianmac wrote:

Hey w,

Since you've used the migrator with some success, would you be willing/able to write up a short howto that we could use as documentation? If you are able it would be greatly appreciated!

I've not had a chance to test it out yet, as I don't have any sites right now that I'm planning on migrating in the short term.

Ian

It seems that the migrator is not useful as I've tried myself to upload the dump without any success. There were a lot of error messages I couldn't fix. So I had to return to 1.0.x version waiting for a better solution if any.

ianmac · **Posted:** Tue Jul 24, 2007 6:29 pm

hmmm... I didn't see the bug report that you filed, so I'm not sure what problems you were having. w seems to have gotten it working, so that is why I asked him.

Ian

adiluca · **Joined:** Tue Jul 17, 2007 4:22 pm **Posts:** 40

ianmac wrote:

hmmm... I didn't see the bug report that you filed, so I'm not sure what problems you were having. w seems to have gotten it working, so that is why I asked him.

Ian

I just returned to the old 1.0.x so I don't have any new report to post. I've tried several time and the errors were not the same. It is difficult to manage everything in this environment. It seems to me that nobody know anything regarding this migration procedure. :'(

ianmac · **Posted:** Tue Jul 24, 2007 6:56 pm

Fair enough.

It is just too bad that you won't help us to fix the errors you encountered by providing us with data telling us what happened.

Ian

jc221 · **Joined:** Tue Jul 24, 2007 6:57 pm **Posts:** 15

Hi Thanks for the tool,

I keep getting duplicate errors...

MySQL: Duplicate entry '1' for key 1

key 1 is the id field... i looked at the .sql file and there is only one 'id' = '1'

Please advise,

R

adiluca · **Joined:** Tue Jul 17, 2007 4:22 pm **Posts:** 40

ianmac wrote:

Fair enough.

It is just too bad that you won't help us to fix the errors you encountered by providing us with data telling us what happened.

Ian

I'll try again later when I have much time.

ianmac · **Posted:** Tue Jul 24, 2007 7:51 pm

That would be excellent!

Thank you!

jc221 - did you start with an empty database? It is hard to track down what is going on without seeing the data...

I recently tried the migrator, but only with the 1.0 sample data, and everything seemed to work fine, more or less. A few quirks to work out, but nothing major. All the content transferred properly.

Ian

archangel519 · **Joined:** Fri Jan 06, 2006 10:47 pm **Posts:** 49

Quote:

MySQL: Duplicate entry '1' for key 1

I also received a few of these messages during my migration (started with an empty db). I believe the error is due to the fact that when you specify the db name/password/login info on the previous installation step screen before the migrate script is run, some data is auto populated into the new db when you click "next". Specifically, I believe it is the jos_menu entry for the mainmenu and some of the jos_module table. I removed the "Insert Into" lines that were offending in the .sql migration script, and the import went ok after I removed them. However, I cannot load my frontpage now (backend is fine) due to some issue with the mainmenu module. See my post here...
http://forum.joomla.org/index.php/topic,193756.0.html

Not sure what the error means. I think the migrator component is almost there, but needs just a little tweeking. I will see if I can figure out what should be changed if I can find some extra time. Thanks for any help in the meantime... ;)

archangel519 · **Joined:** Fri Jan 06, 2006 10:47 pm **Posts:** 49

OK, I have messed around a bit more and here is what I have found.
The errors are occurring during the migration sql import because the tables #_menu and #_modules are pre-populated when you leave the database initialization step during the install. Basically when you click next after you type in the db name, db user, db password, etc, the installer creates the base tables and populates them with some initial data. Namely in the #_menu table, it creates a menu with id=1 (mainmenu).

Code:

Line 397 Joomla.sql and Line 398 joomla_backward.sql
#INSERT INTO `#__menu` VALUES (1, 'mainmenu', 'Home', 'home', 'index.php?option=com_content&view=frontpage', 'component', 1, 0, 20, 0, 1, 0, '0000-00-00 00:00:00', 0, 0, 0, 3, 'show_page_title=1\npage_title=Welcome to the Frontpage\nshow_description=0\nshow_description_image=0\nnum_leading_articles=1\nnum_intro_articles=4\nnum_columns=2\nnum_links=4\nshow_title=1\npageclass_sfx=\nmenu_image=-1\nsecure=0\norderby_pri=\norderby_sec=front\nshow_pagination=2\nshow_pagination_results=1\nshow_noauth=0\nlink_titles=0\nshow_intro=1\nshow_section=0\nlink_section=0\nshow_category=0\nlink_category=0\nshow_author=1\nshow_create_date=1\nshow_modify_date=1\nshow_item_navigation=0\nshow_readmore=1\nshow_vote=0\nshow_icons=1\nshow_pdf_icon=1\nshow_print_icon=1\nshow_email_icon=1\nshow_hits=1\n\n', 0, 0, 1);

Also in the #_modules table it creates some initial modules:

Code:

Line 477 Joomla.sql and Line 478 joomla_backward.sql
#INSERT INTO `#__modules` VALUES (1, 'Main Menu', '', 1, 'left', 0, '0000-00-00 00:00:00', 1, 'mod_mainmenu', 0, 0, 1, 'menutype=mainmenu\nmoduleclass_sfx=_menu\n', 1, 0, '');

Also in the #_modules table are items for id's 2-15 of various modules.

When the migration script is created, it brings over the id's from your existing tables, so if one of the menus or modules has an id of 1 in #_menu or 1-15 in the #_modules table, the duplicate key error occurs.

I was able to successfully get the import to finish by editing Joomla.sql and joomla_backwards.sql. I removed the line populating mainmenu into the #_menu table, removed the mainmenu with id = 1 in #_modules table, and changed the id's in the #_modules table to be different from the id's of the modules in my migration scipt. In the end, my backend works, but my front end will not load. (See my previous post for details of errors).

My next step will be to start from scratch, and attempt to order the id's sequentially in both the installation and the migration script, and try not to remove the lines in any of the .sql files at all.

Let me know if any of this is making sense!

archangel519 · **Joined:** Fri Jan 06, 2006 10:47 pm **Posts:** 49

Ok, so I polished things up a little, but still no front page...

I removed the insert statement that referenced the home page (id=1, link=com_frontpage) in the #_menu table from the migration sql file instead of the install sql file since my migration insert statement referenced com_frontpage which is no longer supported.

I left all the installation file insert statements concerning the #_modules in, and changed my migration file #_modules insert statements to have id's that were sequential starting with 16 ( since the migration file id's ended with 15).

I ran the installation again on a fresh db and the migration file went successfully, backend loads and works fine, but no frontend.
I also noticed that I have only 7 or so categories in the categories manager. I should have 197! When looking at my migrate.sql file, the file ends about 7 or so lines into the jos_categories section, so I am thinking (since i have about 47936 lines in my migrate.sql file) that the script must have timed out or something. I am going to rerun and check the apache logs for any timeout errors or warnings.

Here I go again...

archangel519 · **Joined:** Fri Jan 06, 2006 10:47 pm **Posts:** 49

Quote:

I also noticed that I have only 7 or so categories in the categories manager. I should have 197! When looking at my migrate.sql file, the file ends about 7 or so lines into the jos_categories section, so I am thinking (since i have about 47936 lines in my migrate.sql file) that the script must have timed out or something. I am going to rerun and check the apache logs for any timeout errors or warnings.

Just an update, I was running into timeout issues with my php scripts. I fixed the issue, got a complete dump and imported it successfully. I am still having the issues with the front end.

Can anyone provide any insight for me on the following error?

Code:

PHP Warning:  array_push() [<a href='function.array-push'>function.array-push</a>]: First argument should be an array in /var/www/html/joomla15/libraries/joomla/application/menu.php on line 292

jaysunp · **Joined:** Sat Sep 16, 2006 1:59 am **Posts:** 48

I made several attempts to migrate a 1.x site to 1.5RC1 without success. Kept getting db errors that stopped the migration. It may be due to the fact that my "old" site is on my WAMP server, but the sql dump is complete except fot Virtuemart.

I started with an empty db encoded originally with uft-8. Here are two sets of error codes I received:

First atttempt
-------------

Code:

Error at the line 1: INSERT INTO jos_banner (`bid`,`cid`,`type`,`name`,`imptotal`,`impmade`,`clicks`,`imageurl`,`clickurl`,`date`,`showBanner`,`checked_out`,`checked_out_time`,`editor`,`custombannercode`) VALUES ( '1','1','banner','OSM 1','0','1870','0','osmbanner1.png','http://www.opensourcematters.org','2004-07-07 15:31:29','0','0','0000-00-00 00:00:00','','');

Query: INSERT INTO jos_banner (`bid`,`cid`,`type`,`name`,`imptotal`,`impmade`,`clicks`,`imageurl`,`clickurl`,`date`,`showBanner`,`checked_out`,`checked_out_time`,`editor`,`custombannercode`) VALUES ( '1','1','banner','OSM 1','0','1870','0','osmbanner1.png','http://www.opensourcematters.org','2004-07-07 15:31:29','0','0','0000-00-00 00:00:00','','');

MySQL: Table '4yourluv.jos_banner' doesn't exist

Stopped on error

---------------------------------------------------

Next attempt
-------------

Code:

Error at the line 1: ﻿INSERT INTO jos_banner (`bid`,`cid`,`type`,`name`,`imptotal`,`impmade`,`clicks`,`imageurl`,`clickurl`,`date`,`showBanner`,`checked_out`,`checked_out_time`,`editor`,`custombannercode`) VALUES ( '1','1','banner','OSM 1','0','1870','0','osmbanner1.png','http://www.opensourcematters.org','2004-07-07 15:31:29','0','0','0000-00-00 00:00:00','','');

Query: ï»¿INSERT INTO jos_banner (`bid`,`cid`,`type`,`name`,`imptotal`,`impmade`,`clicks`,`imageurl`,`clickurl`,`date`,`showBanner`,`checked_out`,`checked_out_time`,`editor`,`custombannercode`) VALUES ( '1','1','banner','OSM 1','0','1870','0','osmbanner1.png','http://www.opensourcematters.org','2004-07-07 15:31:29','0','0','0000-00-00 00:00:00','','');

MySQL: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near '﻿INSERT INTO jos_banner (`bid`,`cid`,`type`,`name`,`imptotal`,`impmade`,`click' at line 1

Stopped on error

Am looking forward to the process smoothing out.
Any ideas on the problem?

jason[rtl]

Code:

[/rtl]

archangel519 · **Joined:** Fri Jan 06, 2006 10:47 pm **Posts:** 49

Are you sure that you are choosing the correct old prefix and encoding? I had issues on my first attempt because I chose the incorrect encoding. Not sure if that could be your problem, but there is a character in the statement you copied that looks wierd...

Code:

Query: ï»¿INSERT

Maybe it was just in your post, but maybe not...

archangel519 · **Joined:** Fri Jan 06, 2006 10:47 pm **Posts:** 49

Update: Posted bug about duplicate entry error in migrate component bugtracker:
http://joomlacode.org/gf/project/pasami ... cker_id=97

pasamio · **Posted:** Sat Jul 28, 2007 9:53 am

Strange, the system should have checks to prevent it from timing out on the 1.0 side, 1.5 data import should also be fault tolerant as well, the only part is the last step where it transforms a whole heap of things (namely menu) - it looks like the 1.0 side is not working, so I'll build a large data set and see if I can replicate it.

Can't seem to duplicate the duplicate entry bug except for attempting to run migration or data load twice, can you supply some form replication scenarios?

ZenSpirit · **Joined:** Wed Oct 05, 2005 2:08 pm **Posts:** 11

pasamio wrote:

can you supply some form replication scenarios?

I'm having the duplicate entry error also.
I have a migrate.sql file that produces the error.
You can have it to test with.
Let me know how to deliver this to you if you are interested.

Forgot to mention: i have a dedicated server running several joomla installs. If you would like i could give you access to the joomla install i'm trying to migrate.

Greetings.

mikblik · **Joined:** Tue Jul 04, 2006 6:42 am **Posts:** 3

While migrating my DB from 1.0.12 to 1.5 RC1, I am getting an error message that I haven't encountered in this forum:

Migration failed:

Incorrect table name ''.jos_ .'modules' SQL=INSERT INTO `'.jos_ .'modules` VALUES (35, 'Breadcrumbs', '', 1, 'breadcrumb', 0, '0000-00-00 00:00:00', 1, 'mod_breadcrumbs', 0, 0, 1, 'moduleclass_sfx= cache=0 showHome=1 homeText=Home showComponent=1 separator= ', 1, 0, '');

Any idea what I can do to fix this? I have already replaced my 1.0.12 with the 1.5 RC1 install (though I have it backed up, of course), so I would rather not go back to fix anything at the 1.0.12-version DB.

BlackTiger · **Joined:** Fri Jul 27, 2007 9:21 pm **Posts:** 2

Hi,

I started with an empty database and tried to migrate the migrate.sql (I even tried without typing SiteName/AdminMail+Password on that site).

Yet, I always get that duplicate key entry.

The backup contains over 3000 users and over 180 articles.

If you need my migrate.sql pm me.

Regards
BlackTiger

pasamio · **Posted:** Sun Jul 29, 2007 3:15 pm

mikblik wrote:

Any idea what I can do to fix this? I have already replaced my 1.0.12 with the 1.5 RC1 install (though I have it backed up, of course), so I would rather not go back to fix anything at the 1.0.12-version DB.

Known RC1 issue, update to latest nightly build to fix this. This is run after the main migration so if its all you are getting then the migration has run successfully.

For those interested, gzip up the file and mail it to my email (sam DOT moffatt AT joomla DOT org) and I'll try to replicate and work out whats breaking

Thanks,
Sam

sykong · **Joined:** Thu Dec 22, 2005 12:25 pm **Posts:** 26

I've just tried the nightly build, downloaded from http://dev.joomla.org/nightly/joomla_tr ... svn.tar.gz

I'm still getting the same error that has been reported by others

Quote:

Migration failed:

Duplicate entry '35' for key 1 SQL=INSERT INTO `jos_modules` VALUES (35, 'Breadcrumbs', '', 1, 'breadcrumb', 0, '0000-00-00 00:00:00', 1, 'mod_breadcrumbs', 0, 0, 1, 'moduleclass_sfx= cache=0 showHome=1 homeText=Home showComponent=1 separator= ', 1, 0, '');

ianmac · **Posted:** Mon Jul 30, 2007 1:50 pm

gzip the file and send it to the address above if you would like to help us track down this bug.

Ian

archangel519 · **Joined:** Fri Jan 06, 2006 10:47 pm **Posts:** 49

Hey guys, just a thought on this issue... I have the default joomla mainmenu module unpublished and am using infinity menus to show the main menu module. I haven't looked real close at the migrator code, but just thought that this may or may not be relevant info...

Also, I was getting a time out issue due to my php.ini max_execution_time being set too low. I believe this was during the menu transformation as you specified, because I have over 300 menu items! I changed the max_execution_time to be much higher temporarily and I was able to get it to complete. My final .sql file is over 93,000 lines long...

Joomla! Discussion Forums

Forum rules

Joomla 1.0.x to 1.5 migrator

Quick reply

Who is online