mssql与mysql 数据迁移

概要：

mssql向mysql迁移的实例，所要用到的工具bcp和load data local infile。

由于订单记录的数据是存放在mssql服务器上的，而项目需求把数据迁移到mysql server，存在的问题mssql和mysql订单表结构不同，所以不能直接导入到mysql中的订单表里面。

解决思路，首先，在mysql数据库新建一张与mssql中订单表结构一样的表，在mssql上利用bcp工具导出数据为csv，然后把导出csv数据上传到mysql服务器上用load data命令行导入表；最后通过存储过程查询循环insert到目标表中。

导出表结构并且修改后，在mysql服务器上创建同样结构的表：（以下图为：mssql导出表结构图）

以下是导出csv相关sql语句

 use data_trade;
 Go 

 SP_CONFIGURE'show advanced options',1
 RECONFIGURE
 Go
 SP_CONFIGURE 'xp_cmdshell',1
 RECONFIGURE
 Go 

 EXEC master..xp_cmdshell 'BCP  data_trade.do.t_trade OUT  D:\trade.csv -c -t "jxfield" -T -r "jxrowend"'

由于订单表中的字段比较复杂，字段中包含了逗号，换行和回车等符号，所以从定义的了字段分隔符和行的终止符，分别用 -t -r两个参数定义。

去掉字段中的空号逗号换行符和回车；

$ cat a.csv |  tr -d ' ,^' | sed 's/jxrowend/$^/g' | tr '^' '\n' >b.csv

将导出的csv文件上传到mysql服务器上的/tmp目录下并c，然后执行

load data local infile '/tmp/trade.csv'
into table `t_trade`
character set gbk
fields terminated by 'jxfield'
optionally enclosed by '"'
escaped by '"'
lines terminated by 'jxrowend';

查询循环插入到目标表中代码如下：

 DELIMITER ;;

 DROP PROCEDURE IF EXISTS `update_trade`;;
 CREATE PROCEDURE  `update_trade` ()
 BEGIN
 -- 需要定义接收游标数据的变量
 DECLARE astorage_id varchar(40);
 DECLARE atid varchar(40);
 DECLARE apro_detail_code varchar(40);
 DECLARE apro_name varchar(255);
 DECLARE aspecification varchar(255);
 DECLARE abarcode varchar(40);
 DECLARE acombine_barcode varchar(40);
 DECLARE aiscancel varchar(40);
 DECLARE aisscheduled varchar(40);
 DECLARE astock_situation varchar(40);
 DECLARE aisbook_pro varchar(40);
 DECLARE aiscombination varchar(40);
 DECLARE aisgifts varchar(40);
 DECLARE agift_num int(20);
 DECLARE abook_storage varchar(40);
 DECLARE apro_num varchar(40);
 DECLARE asend_num varchar(40);
 DECLARE arefund_num varchar(40);
 DECLARE arefund_renum varchar(40);
 DECLARE ainspection_num varchar(40);
 DECLARE atimeinventory varchar(40);
 DECLARE acost_price decimal(20,2);
 DECLARE asell_price decimal(20,2);
 DECLARE aaverage_price decimal(20,2);
 DECLARE aoriginal_price decimal(20,2);
 DECLARE asys_price decimal(20,2);
 DECLARE aferght decimal(20,2);
 DECLARE aitem_discountfee decimal(20,2);
 DECLARE ainspection_time varchar(40);
 DECLARE aweight varchar(40);
 DECLARE ashopid varchar(40);
 DECLARE aout_tid varchar(40);
 DECLARE aout_proid varchar(40);
 DECLARE aout_prosku varchar(40);
 DECLARE aproexplain varchar(40);
 DECLARE abuyer_memo varchar(40);
 DECLARE aseller_remark varchar(255);
 DECLARE adistributer varchar(40);
 DECLARE adistribut_time varchar(40);
 DECLARE asecond_barcode varchar(40);
 DECLARE aproduct_no varchar(40);
 DECLARE abrand_number varchar(40);
 DECLARE abrand_name varchar(40);
 DECLARE abook_inventory int(40);
 DECLARE aproduct_specification varchar(255);
 DECLARE adiscount_amount decimal(20,2);
 DECLARE acredit_amount decimal(20,2);
 DECLARE aMD5_encryption varchar(40);

 -- 遍历数据结束标志
   DECLARE done INT DEFAULT FALSE;
   -- 游标
   DECLARE cur CURSOR FOR SELECT `AC0018`,`TC0013`,`EC0155`,`EC0123`,`ac2037`,`TC0087`,`AI0033`,`EI0734`,`AI0021`,`AM0024`,`TM0030`,`AM0100`,`EQ0147`,`AD0001`,`TC0108`,`EC0155`,`AI0032` FROM `edb_item` order by `AQ2520` asc where `AQ2520`<'2014-04-09 11:31:24' order by `AQ2520` asc;

   -- 将结束标志绑定到游标
   DECLARE CONTINUE HANDLER FOR NOT FOUND SET done = TRUE;
   -- 打开游标
   OPEN cur;

   -- 开始循环
   read_loop: LOOP
     -- 提取游标里的数据，这里只有一个，多个的话也一样；
     FETCH cur INTO  atid,apro_detail_code,apro_name,aspecification,abarcode,astock_situation,agift_num,apro_num,arefund_renum,asell_price,aoriginal_price,aitem_discountfee,ainspection_time,aweight,aout_tid,aproexplain,ainspection_num;
     -- 声明结束的时候
     IF done THEN
       LEAVE read_loop;
     END IF;
     -- 这里做你想做的循环的事件
     -- IF ainspection_num is null THEN SET ainspection_num=0;END IF;
     SET astorage_id=null;
   SET acombine_barcode=null;
   SET aiscancel=null;
   SET aisscheduled=null;
   SET aisbook_pro=null;
   SET aiscombination=null;
   SET aisgifts=null;
   SET abook_storage=null;
   SET asend_num=null;
   SET arefund_num=null;
   SET atimeinventory=null;
   SET acost_price=null;
   SET aaverage_price=null;
   SET asys_price=null;
   SET aferght=null;
   SET ashopid=null;
   SET aout_proid=null;
   SET aout_prosku=null;
   SET abuyer_memo=null;
   SET aseller_remark=null;
   SET adistributer=null;
   SET adistribut_time=null;
   SET asecond_barcode=null;
   SET aproduct_no=apro_detail_code;
   SET abrand_number=null;
   SET abrand_name=null;
   SET abook_inventory=null;
   SET aproduct_specification=null;
   SET adiscount_amount=null;
   SET acredit_amount=null;
   SET aMD5_encryption=null;

     insert into `t_trade_array`(storage_id,tid,pro_detail_code,pro_name,specification,barcode,combine_barcode,iscancel,isscheduled,stock_situation,isbook_pro,iscombination,isgifts,gift_num,book_storage,pro_num,send_num,refund_num,refund_renum,inspection_num,timeinventory,cost_price,sell_price,average_price,original_price,sys_price,ferght,item_discountfee,inspection_time,weight,shopid,out_tid,out_proid,out_prosku,proexplain,buyer_memo,seller_remark,distributer,distribut_time,second_barcode,product_no,brand_number,brand_name,book_inventory,product_specification,discount_amount,credit_amount,MD5_encryption) values (astorage_id,atid,apro_detail_code,apro_name,aspecification,abarcode,acombine_barcode,aiscancel,aisscheduled,astock_situation,aisbook_pro,aiscombination,aisgifts,agift_num,abook_storage,apro_num,asend_num,arefund_num,arefund_renum,ainspection_num,atimeinventory,acost_price,asell_price,aaverage_price,aoriginal_price,asys_price,aferght,aitem_discountfee,ainspection_time,aweight,ashopid,aout_tid,aout_proid,aout_prosku,aproexplain,abuyer_memo,aseller_remark,adistributer,adistribut_time,asecond_barcode,aproduct_no,abrand_number,abrand_name,abook_inventory,aproduct_specification,adiscount_amount,acredit_amount,aMD5_encryption);

   END LOOP;
   -- 关闭游标
   CLOSE cur;

 END;;
 DELIMITER ;

若在存储过程出现错误，相关处理可以参考continue handler;

相关参考博文：

dcp使用心得：http://www.cnblogs.com/puke/archive/2013/06/05/3119378.html

mysql错误处理 ：http://blog.chinaunix.net/uid-20304312-id-1707822.html