Migration Issues: Ms Sql > Mysql: Insert Buffer Memory

I am having an issue using the built in migration tool on MySQL workbench. I am migrating a very large database from MS SQL 2014 to MySQL. The MS SQL server is deployed locally on

Solution 1:

Since this one is over a year ago you might have solved this issue already, but maybe others (like me) have the same problem and so I want to add my solution:

In some MySQL forum I found a guy posted a formula and after calculating it for my server and my system I found out, that I tried to use 2 GB too much RAM which the system did not have. Here it is and I hope it helps someone.

RAM = innodb_pool_buffer_size + key_buffer_size + 
   ( (read_buffer_size + sort_buffer_size + read_rnd_buffer_size + join_buffer_size)
         * max_connection )

Solution 2:

From the looks of it, the error is within MySQL. Try to tune your MySQL server's bulk_insert_buffer_size parameter.

Solution 3:

This looks like an issue with the memory of whatever server is hosting the MYSQL database. It looks like you don't have 1GB of memory to spare to insert the new data in one go (on a previous response, you indicated that you have already changed the bulk_insert_buffer_size parameter). You can either:

• Close some applications and see if it frees up enough space.
• Break your exported data into smaller chunks and insert them in smaller increments (ie, creating views or something on the MS SQL server)
• Take it one step further and insert one row at a time (which can be very time-consuming)

Solution 4:

You might want to take a look at this. This developer migrated the data using a program called Access to MYSQL whick looks pretty promising.

Solution 5:

I would suggest you to use Talend data integration tool. It is quite easy you create a job map your tables and then start the job. It will take care of batch size and stuff.

I had a huge MSSQL database which I migrated to MySQL it did a good job. I even had some structure changes in MySQL compared to MSSQL. It has a nice GUI you can just map the columns by WYSIWYG. It is built on Eclipse so if you have used eclipse before It seems familiar.