1.原表没有设置主键,出现错误提示:

ERROR tool.ImportTool: Error during import: No primary key could be found for table xxx. Please specify one with --split-by or perform a sequential import with '-m 1'

提示说明的很清楚:在表xxx没有发现主键,使用--split-by指定一个column作为拆分字段或者在命令行上添加 ‘-m 1',为什么会出现这样的错误提示,我们需要了解一下Sqoop的并行导入机制:

一般来说,Sqoop会创建4个进程,同时进行数据导入操作

如果要导入表的主键为id,并行的数量为4,那么Sqoop首先会执行如下一个查询:

select max(id) as max, select min(id) as min from table [where 如果指定了where子句];

通过这个查询,获取到需要拆分字段(id)的最大值和最小值,假设分别是1和1000。

然后,Sqoop会根据需要并行导入的数量,进行拆分查询,比如上面的这个例子,并行导入将拆分为如下4条SQL同时执行:

select * from table where 0 <= id < 250;

select * from table where 250 <= id < 500;

select * from table where 500 <= id < 750;

select * from table where 750 <= id < 1000;

注意,这个拆分的字段需要是整数。

如果要导入的表中没有主键,则我们应该手动选取一个合适的拆分字段。

首先查看表中有那些字段,如查看表student:desc student;

表中有id,name两个字段,那我们就可以选取id作为拆分字段,将表导入hive时在命令中添加 --split-by id,就不会报错了。

参考:http://www.cnblogs.com/gpcuster/archive/2011/03/01/1968027.html

2.Sqoop Hive exited with status 1

当从mysql向Hive导入数据时,执行:

 sqoop import --connect jdbc:mysql://localhost/hive --username hive --password hive --table dept_InnoDB --hive-table dept_InnoDB --hive-import --split-by deptno 

出现以下错误:

// :: INFO hive.HiveImport: Exception in thread "main" java.lang.NoSuchMethodError: org.apache.thrift.EncodingUtils.setBit(BIZ)B
// :: ERROR tool.ImportTool: Encountered IOException running import job: java.io.IOException: Hive exited with status 

google之,原来是机器上装的hive和hbase的版本不兼容造成的,在这里具体的说是hive和habse所使用的thrift版本不一样。当hive和hbase的jar包都添加到CLASSPATH时,运行Sqoop时只会激活一个版本的thrift,这样往往导致hive运行出错。

执行:

locate *thrift*.jar

看到:

aaarticlea/png;base64,iVBORw0KGgoAAAANSUhEUgAAAiYAAAA2CAIAAAB85cWjAAAAA3NCSVQICAjb4U/gAAAgAElEQVR4Xu1dB1gURxveOw6OchQpIkXsCiEWYo0af7FLoobEQuyoBBsEFQ127IixG1FBBRsqUbF3QKULIkUQEFSkSW/nUY67f69wXNmZKxzHobsPTwzTvvd755uZndllXwKVSn1wJ3iH41aEqNP3T9eplJsH/kmmIbJe5K4/r59vHn7c90kJQ9Y28Ho4A/JkQC6BLU9AeFvtnAE8olrQgcTmukTdfosWTB9nQmpBcwi5569r5437TpOv3ZY0J2ldounMi9TMBM7PgwnaktYTW45kNHHV4fjYWLTlqoQHkcfmfUcWWwcv0OYMqFq53KQmHZisS0ChyCWwZXKJH0Y7ClGt8adiKvxH6Ujkc6v5BbRO0Ops8/O4voYqwBLyy8C2JXtEEXRGb7tVkRy4xRprHgHONtgwWuqmZt9dd2PKH64dTmENE0VdCl4aWu4WQdPK3uNBWDS6BpQ+8/X+2Vyd1Saj6OHfg6fMHLHk7LuWm2hugWg8aXvg8oFFl7dNm7146qoDPk9SiunyNMBtS8V02e0E6oXRkg3yVgDQwiYJ5O4TlgfeelLBWvWjMq7tce1PEYgsgmbfRSc/ZyYkufbgDDWtQdtzm24RePcKH3f212QjIeoO+Ovw1dyMBGpGWOyRBcP1pAxTta7Tf7WoeX49sorZQs9aVF0ARrsIUYJWrykHzl+5ZKumOuJwQfLj8F1jjMXM7K3kF4R4NStH76vb7bqqQspImUUwcLiaQA2e3lnYWXnbImpY9DZTVe/ynZGaCETIbAOFAQQvYkEwgaDe0bqrmppFT3MNRS45LdrSiHGpFbJVLOz3hu61fPaPh+2zz5oDZv+77wQzb+bfr7/QK3NTKxFS9Q9f5GlV1WxAd3Lpg20+d6NlP2uUJyClbEut15wjkVsHF9z3+XNvXIGqcf9hNgxaPd+5qlqfufsfuvfhB09LOzV11nUyN9SJRv9bfW5Zp8dhuXVoIRXThf+e3N33zeH1bhHID25b3O4crbZZeP1jo6Tek7tPcrCgPtqWWNmmK44QjHYQolo2XgHbHauDVzltiCtF9Mx699V4XymO9tbxS9K+bmk5VRPb4bpJEZ/y86pqNAoqCbrfj+hVERuX29DShrHrN36+6GT/pmvD2zfVIgWkn21aBp5ZFjp34pw+xI8JxYp8CCJy+zhy1+1S1u1nZErAqqmmvBsJoomdV+KrOPYNaUxmkKeTtVZTVQKl17Qjlx+Wo1lpjx+7WfFTqWYyavOJa3loVkbYS59lk0ya70xAWUSDEd4Xgz8ks0/J0p5EHF48xqhpYaQM3Lx+ZKmf26KTYbFv08Ku7N8S33GBY1+KSO8JJZAMBrr+c/5dKtpm3Mfb3muGduDdzYCy2Lfh0S8WdEQMfn+axDmyu766GxcJBPzegKD0+Bg2UeHJ/qt/NRO9nREHVzAfhBAlCmILGyGhg/2ZWGr05mEaTTbUem0JSSg7PdaAPftj14LiVek47sD6IbSbbmPcfK9GJLwIe3DMa8/xjPqmSkT9kWuvu+seX7L1TmVzQwxq7qtXr6PiWT+xOQYOc62LLnqseVqKzm/qfWatG8p8tGHtpmvP7l47PHdjJHPYEqfezTSqGNmeDI2rCts5zUgkfNlOWE6b3LU6/GyCwKgGBDbIZXK/FSdSE1nRnn5594kzt4oy4z9d//uXjtzAAXUKH1XYMEBcQhoEZck9RMmdR4wxQqKPHvYLS0pITgp98N+RG+9rQYglS4dFlFqn8c47n4S8qGENlvjPYSfWWXJ6GTjbcFx+Ns8QMXJ4xpkiMiMvDtfiYAERBUGqYTX3lF9gTvjxFcYNdQYzg8PDYvx3uliytuJwW2gBQEQROwycfdAnIDEqnL3pT6DGn3Xrgc573BPIqoSbz2/cuzZe4PAf0pUQGBDwEJcRhGA4xZ89QcV/Dr34/Onz22N4MyiQeRQ/wC+oKYxMkV1O7tMTGx7k0PR/WLlp8aWjhf1mBWazjpIY5Sl3dqy7kVf8hahvPX/D34d865LG7omhISqGY04Eek4ru7vJ7WGWatdxs5d932SGoDtk39XDSxofbV51MJXQZ577ymtX9X/+ZXdYJROSRdTsOnpIl8ozG5Y8KyebD1m6ZuXtIMNJU71fVDEp/X6bovfe+2o6Tbefq6fHX+OsOqHHamndDFRiasD3YgSt/jsC/ZbWB290PRhfbWi7xGP72X8qJ/zpl9sIyfqScnj0pECblT7+I6MXLjyVjN5+M+o+57K4gIO3Hd6z/pznjLBiovGgFRsdL/qUDvg9IFPWmyYIQpQokC0wwsqI6wn0n0bY9yRHs1xC1Cxsf+/cELE/oZwJ8wsjcrhJRMPh023VcnafjMJ8X4RkPNHnwNjEjX94JZj5YLZCoAx3/Xsa4+GMw6/YmxJiR5shnZG3nq8ozheCPdXPjHF7mIxsG91fXyWtkNPJZPMRE81VVJDh4zur3SwWmRLJPf74xaQy1POl4H0kZmCDiSIZ97fpUuD728Z3vxzau6jm7Kz5Ob8f3Hp05f2QLUk0cEQ1uwiAgc0BuEFIAMg9ROmV+UUIMvjPRXZJx+/l1LZ8iwiml4moGM86eOXMBMaLC75Lo7MLaKpGppSsAs6xNXC2wXAZaazMYx1BQIjC5JyTSEvaP2Bk8A9D7Hbs6WeA6F/Y6LwqLvVNHmtoQGxx6mJGFLpJN/5x1p/jkIDduzZkllQ1qurpk97ms8Z/0X13m1caqsZ2F/0XC0HCsNU022BkNbkMAQ9xGUGY5SEeNpNZz9tJJlMunZnPVxjIPMQvqC3RTJEl50PI3eth6GCNSdMe9WaT3Uj9K9lFrG1XbU74fzmc+skphJEzTw4a0YkU855pYedkr5u5Ybrn4Q9ouLx4XjPKyUePXY5obueypNOHnXabD2Si97zhoRmq1nect04+/eJykSkwq5BjoyA+/EkkCiM65A3zZbCj50T/CUFl5j9YaVe+jinW+/3giT3fha1c5IWs9D1mpEaCHUUSTe1WrTCLdbbdEch2JDaDOTLS22lsJ/+AAmNgVh69tvRdVo1eeQPSUP4+K/tt88wG8YsLPi8m5N4LFofJGsNTt0z8yfB8ZgFn60rUoGiRVVhwmY11NTV14IWSQwMEfB6nBJYtBMx8YUlMcDh99zS77luT02oRtV6/TOlJi9wUWc5AiJ3BncLGiQme1KmPCaE2LYY9qIQvlU5/7Fk/6NnGofc+08lmwrns30lmdjtmGiTt83mMQmAn6JvrIdSkwnqtAZ0pFLK5Tl1aPg0ZYK6jinCXnC9JPgt2Vo8nRB1NFFlvEESjz9TpnSrvBQmfXGAFNoQo1nrFLM+IjY9qTKlz7JAeFR1OjVs3w7IzhZDSARI2TU6CYDTl8/8L6WWFhmhj4T2XXbZ3N867+nR2TtQNnzPnTz/Locq+8sBGirqNs/cESvT2aVPP5/J2xDxSALMNnQkeleBhngd9/Mr4QiWPmP/H90nHttAXb5j/w82QOE55sC0uTKyIajqhor377+r9EKpAb9OrCzKqERKtWPSQHmILkoXeBYPAY4VZc1ojtTCD/dCbVFciNIRAzHMrY/kFtyWSi3kywSrVWJKN3jzomOtyThJUOv648PSV25+S42vePH+9Z5gaoqalilZW7zrEAilOiCwU7VaNHj92R4pfPm2KqLqciNBixGqohQYCyRJGSMsOe1JMsB6O1lI16q6PlOWWUQYtGaURd+jQuZfvstElQcyl3nNETxW1IX4R8ZzH1DWx3rYkxKibvioCyYI0Kjn4xtLsvC8IxYTSdIynMeBI2PO8uGfoT37o+qG80y2gNckR8tuCIWSURJ18Udf558lW6AaR3GOOvXnF48Bn6B5HbKcAwDMZDIR/ViJb7XwYkby5rya6Xxnrvqf/q3XeEZgbILbTalYO8wfXh3vf+CTckbTUTVMmW030ihJ9OtdY+izg8Cb/2M8YK7Z639/GmVQ8C0gSHO7NDPMHNowoXg0GA90AEgkIk0FH12UigSBJp4iFwd/lkAYhWcCgEd+VfGwIhCiTluLv0uenhU7HHn7uM32P782EA3adRe5KIYYFsyD0kkx/GGCIpPo/yBddb9AbasBsA7EsG1FogwQda7uZvfP/3X3x+O6A7J4TZ1hL+/6W0FQJASn3rJaDF4IkA/PSOgWJp8aGRoSoQmDdkqt2cfjP/6/uEb5rnJ+nVRA6jVx9Za0hxxSTPSDREYl9savzLsFfwFn8dZgIeudAYLVD0KCoIQ21DIqxIfFLah4VY8LBAEFgTRdld+cvOvOGtV3mXMyGivxahATOwmhIIAnilwD4RgZrumrytC5jn7PzJfZDc3TfnNKMB2QOAh4RfrmGKWgLhJBZGeb/tCLAboGVTyZp5hzToksBiVU8+6BaaAFs8PTPmUVMjW4DO6k+zWKvGgSiOkVTh0xEz+lGO47toIOci4w/x2vf5b+iUTu/n3XtE6fz1HstsDerDtn9tJT3AJNelluBaBl30iTSSwrRfTXRqKOpBlKeWyW8JmFypmE5b5JhyeObCaILFa88X2CzAYuJQyajkY4uq80XrFO4pSSBIVGDCg9RhFlbmHjpcOIln2O/bjtzcfr6HUHPFkaC1m/MPhBMBNDLmjfQrT5WA5DZBqs4J02CTsGuzKyM2TfsRzLjSy2dcNp2xFlqTb3U+zqhiMI2xE1tahw0Y0IrC2fKAzxfmzIxL4xJ3O+QJYevqnq3H/sScw/u9buSzropydYuqEU4Sw4tKzILmTzMrjs5hm9GZ1elZUVlI5MHj+2sFst+mEy2GDHaCEmLyaHBshChrlA1GTTKCMmMy61FmHXUBkRdW42WU4mo61NQ6MKzEKOhDk3S1FEnItXNW9yILOZkm0GkwutvvggGU8M7YBaEN4hfwuCFW2HUZMTHZginQn6nyR0hOs6r4i/459ktXjwhWX2SwdvjJ1M5e2uYXyyI2OAZpS/vxjI2LnX84dSWmAr+mZlZed/dfqBG0z5aw3rHhe39g1f9diq+oGmmUe8+/peOtWE3kpvXPPR999exn5BZMwfrXb1fhm4rDAdP7IsU+CSWNU9PKgaj5syZQIw+el54o0OxnjbVoOzWtbQaCKnNWeJcZpWkhrqMZJ8Uc97fRv9HfKdAYCh7iPLIqS+4H3Dvw/RF3UzRQ38qf8diUovpF3gGoBe+Ti5F7OaPNQm6nCc0jMGzDccys+5LPaLRgXd2wE4V3ymYsNmJzPov7CHApNcIxw2mLXBLEuQw66moMW0DTRWkCnPFxWoDAgMCHt0uAkcKlhVEHPOYlaRNlGzJqfsYn4GMmO8yO+l8fA6NYNDPmP3XMOjFyL13zG/5SXf/I6T9V9B3XPUHd0QQzl4ZzTp6evnJTad20vffTVXpPXe1c6/C/36+jx6HMMFZCAfRwCUurppR7+gW0/9ytap6MvsBenKnkp9ejIzrbUq7fS0F2eFoZ/niFkHwYJBR/T6xFFm4cNG8iuhqvU6kVzeuZtfn3Tt03Pm063m/Dv8G3k0rbdAw6mVaGXw+7BOdAc6C8AjxiwseUhmWRTGztuzFe+ZNr8rLyP8id4QsAHUZvn7JLls9jyC0B6732K+HoBfMLwhsev7dNcdnvFh57DH5+D93UvJVvrPkvv/CqM778JZXU0OvogGpLf2UmVfddAirYjxoWGckc1eqwE10bfrVfTEOR/Z4e2qci0IG/LVlOCFmp2/zK3CIZr+l5zZPN0J+1UuyW/mK/yxay2aGrWHxo/OpoqflmB5AXOYtMKIVxYYNDIYyh6iq+c+7F5smvXiV9pnK0DQb7TitK5J5NkHgRkKUDk4Kpl+QYV7z2nfri/HHdly4bXn2XETW5zqSrrEJKf46OmDBsw3HVENe4juas+0212l7w0tIxl20X1+7+K5OppEC8oaXjm1LbDVIAUZVVnQB4uq0zKkspEjHlPzqWmAW1uGiQBMywgCPFGyA4pjHriVlqmRLTv37iw4rdQ+4zT9z4S/0/UFmXXV+6ot37JMtZlXs2hkrCja7LvXc74ae9dAr38fdz2DfFTErY91nupVud1tz4JA2UpMR5jdj6yn0dTV4FscBhpaNm9cMYxV6QcL15Sv332I9DWDkRkUXrpn8W++yVWv3/nR2fXzSOrTwl+jq5p0wLWX3xkvf7XA47uPQWJ52xv3hf9n1jOpX66cvzlm3Ytmy7fPQ1ykbq96F+4deQpcchAnOgvAI8QtSS3yWtfuT282l6sNWWjhFVLcKwsaPt3yC3I471FzdGdp8pCWjX0xawlGn/3122blk8ZlfWfxWfEq89apU9OGeCANki36mSNnjTN6OlFOCnue/cqn29g3r9h5eg1SnPjg8ZfMN/j/KqcuNfJRr70CIfPxJcKxSrBeO1S24dTtFwhUHGqIiaJsTxIQNHIYShyhJQ9uw//SDc5ezHzIyStOfezl5HeGcl0Lo4GRh+gWeARC0l5fP+rx4xdoZzr5zWAs8tTD5wmbWgIXMNmxTzLIw72UXd+2Z6xm0CKGXpZ52vxv4rg4yzMViBxfAtgUuL0FOXfp+D7/+Xgv2H5vKqHh72v3+lSz+P2LDbAEbhtitJ3CkCBrhnf2IYx4Tm7SJhLi4uI9Z6axvrCnJReo8JzLEvWzFqEmPBN9yRfGp9fC4+Z9H1d6Bcy9nNaoZGBtp1pfll9Ik3p8qiYs4jFZhQGeEV7q/zfnfp65LEv+UrFUQsBtVEhgtcBD94E1IkNpai4XP+Q48W9AeXlVZGSD3Xh53d27SgvFzWvK4TjrvSAMHDkSXHOkqtVnp+uxjHr6/Xf37/kGSk9eNiIJSggGZRKA1Sv28r808wA23GgPaQ2eN1Cm4HpjelusNekqvHDBajWa84fbOAMlk+uo/un5ISSvXHDrvj+71iTsyJT4WkIPvkh2sycGQfJpg1iSemDCr6qi3y73QNawmy4PH/W9blCIZk48jeCtyZoCg29/xf1qfLt1La9MVR0lgtIxc6uM/h3L+tq5l7eC1lZIBVb0u3X5cMW9eR3WkJi/2kMvW6wr94A2ByWRev3pJiQ7WJOslIsXIpJNmY1lhUVmd2CNNyZrES+EM4AzgDOAMtC4D7WyXwyODUVOcx/77WfzCGcAZwBnAGWgvDAC/PtBeHMBx4gzgDOAM4Ay0FwaI8fHx7QWrsuBENQGXbtro3lf892ogiFH5VM8tzuMMFb3mQ8ATta2dPDxWfd/0N1cQ9MqXpUjwstmCMK98dOKIcAZaiQGilZWA2gDPjICuYisZb2pWIeKJGD5ILmgof5VJBcqnSgqeqDfAafGsic2KFRiUtU6SNAEA0FWUGLwCbGFrOH4lUpKtEwFSt9o2ipZSw8QriDAAuslWpK6iIsQTRRxnJUgsaKhINjCRtiRR+cFLFQAwXUUJaFKELaiGowQYhYvAXJZVSlLYBvd3mfRYCZrdJnoF3EJVX6mZ0elXtiz+jiemBTDDTpbJFrfBNlK0hLmD50nGAOD1AUXqKipEPBGbDQkFDRXJBjbQFqQqP3jpAgCmqyieJkXaEo9GwhIwl6WXkoQYlUmPlUAZ6H3RyyHv3Io5DzJVev2xbtORc+SPYzc9gWuyymSLh72NFC0h3OFZEjKAvcsRFjQkW658kxnuP4z74Smdcb7UzCBXC856RdT5ftbJoPvFbAm86qQn0TuGd+B+m1MSITlhW3Dg8hUZhNtqysVGCNIEVAr51GbHpALPqmbjcio9Be3K2Mwrmxf00Wz6yipMLhAcAIgEQo3YCLG6BqaryCkPAM9rrNVtQTQcOSBAYQOQXIS5LJuUJBax3DSxeqyYddW7j5lkVBa4x+dKbNqrqFtbt98q1rWxNWvW/8WuJU77FbNWWytaAkDhyVIwgLnLkUbQENHou8vP4/cP/q6OYRnVRF2TLt0aPzbJOgEF8poRSmNL7iKDEhEFQAjQBATK6ilSPlUsvQDwrHoEWvK/G09k0LvM+Mvt+CXt8okenA/cgWRhIQEgkVAjgF6srmFAdBU55QHgmxprfVsQDUcOCADzwJECcRnDlgRSkljEctLE67Fi1q0vyfrE1B8z2VrvdXwFg9xtWD+D6jfhmJJ9zfVltIV+YK1NFS0xCcATpWIAa8mRRtAQ1dLRM9dByjPjn0YlsiSzEhOE7UOF5KSxJX+RQWGoWL+DEII0AQGyeoqUT22WLpMWPErAK7+jR9hft3uaqtL/keu6SYfuXchHv9EJ8IsODgCI2GWzUCMIIVZXIBBdRU55EHhOriJsAWUruQ6BwoaVjTVSIC5D9CIhWWwc2AKvYvVYuT4I/tOYf8d5y7C7O/xSh4bd+Wg67X8NB5x2PqyAf4RKvPYrpi00sU0VLUGg8HTJGcA4WJNK0BBBqqI9tj9lOBzNjrx0acNsu56CMhZikEhlS5EigzzcYhEqoXyqzOAFequhIO55MdJrkDn7pWmwXCAwACQRahRLr5gAAmULgueUUqQtEC5eehtKSaKqoVB1WogeK6ZbKhpmXcwonyN8r70uYTQ2anw3c9ZICzHnak0NSWsLEwA3ERyisFp4noIZEN3lYAoastSGiWoqmEp2demX3fs+trKb9ouD/dIgR9d437/s98eUSvJ5Z0xbcAYUJDLYBEIShEonnyojeGHiCSzFOfSDSGg6VC4QFAASCDVKQq8wLJ7sNWY0NpXmA89NUqQtEcwYCW0mJQkUeJVNj5UyePW5JRqH7FbvzaxHAs7vu+IRG7Bp750XDiFV4J1Oy7RfMdiEhyhWBTytbRgQ2eVgChrSKwvLEY0ePTuIrlAc2PWlacFn9jlMnTB4b/ZAJw9H7psFYnzCtMWpwycyyGuEreFoyJIZ5STxyYxyRAYtUZFB0bsrjtTdKVTSNDIlKTU5MhGVNBW4sGxxC0AQYvoGtsWWTzVkyaeKVIT4BckSboZPPlVG8EItqncZOcaImRr1Cf1oKtgvbiWsAGALNeqz9FjT32W/5f68zyqp481EEHohncKnqyhMAu93fvCcRAXagmg4AgHDMyRxWaQFMAy2wGtoZAz68yz+QxX3I4UcPVZLVI+VPStw9VhDhfRY57vuXDjEuFkFXUW/Z2/9hryUIq4wY/mbqLRGdQszvtMOVJtSuJZstkRc5EsQG6Kwynie4hgQXkOwBQ0bS2IvJzH3rdq6tfp8SCHdaJBRswg0xWbzBtuKqJiEnIo69U4jbDoijTmfaZJ8ahPbFsd3BYoMIpi22DBgCDH7CCyrp0j5VA40qcFzqpkOHjW+pkzDYqiT24Ke+UEuD1hPhsB+IQgwAOSvnsmNDbCuIiZ4sV0JDgAEouEItiWjhiNmRIl1GVxLahgy6bE2FsVHZqk6/uM5m3429hPTeLSj+1iVj94vS3gafZjalDLZAvsKD1FYPTxPwQwILTkgQUN6rt/KVSa73f/ce3g1irC+Mjv+YeYX1rqiQlYnGg5b4zXPiLX3qC9Kj97v4nW1UIIlB2SLw4DiRAbRx7ZYWqIoDDhCrJ6CyOopUD6VjUx68IwvH5/H5TrM3Rm8EH1KW5r46N9pu/yfs09HIH5BAkD+6pkczjF1FcHgxbMBCgC0pgy2ALKVHOwy/hcThpi2pJeSlEmPtTbtxK+uKgdXLb9+bS3659Xl2dGHXfZ4vW0WbMXWppTJlqjHilW0FLWPp0jLAIFKpT64E8wVL1CkoKEibUnLCqe8kiOEyae2B21KRdKrSFuyBRteS1oG2kLRUlqMeHlRBgR2OYoUNFSkLVG3JUlRfoQQL5QfvCIRKtIWpFPwrBYz0MaKli3GjzeA8C05ihQ0VKQt2XpZ+RFC/FJ+8IpEqEhbkE7Bs+TAQBsrWsrBg2++CcGDtW+eDpwAnAGcAZwBnIHWY0DkJenWM4W3jDOAM4AzgDPwbTOALznfdv/j3uMM4AzgDCiQAXzJkZ5sucg7KqEqqPRMKLqGbHKcsqGUzZZcYkM2wHgtnIH2wABwycFVQfm7T1JhTcm7XAlVQVngAZqbkvsFLqkAOU6ecQXYwqU/wV0trxxc+lNeTCpRO6AlR5FSklIJNcqTO1wVVIRNmAClSGGpEqTq5RbCUIStb076k2Jpf+zKwzJUFuttSPRRx5/0QXOHQFjg0p9SjZJvoDCpawftE+fPC3uqSClJ6YQahZG26HdcFVSYPpgApXBZqX6XrpdbBkORtqQiAVYY5nLbS38SDWxPXNoyOfvcsrlPcnWHrNrueteXPtDhfGYDzCcEl/6E0vNNZhKf5leJOi4snoirgnatDj+bwFKR4V0gecd2qwoKFqAkdLA/E0uN3jxMo8l7tV5bQhLKTo81YH/NGZf+pGZGXhyuJTY22q30J8Hgx9nTtD/sWXv0SkxyxKMzSzye0vrNdbIU/UYt/xBBZJMZxaU/BUj82n4h9dAgZAo7JYV4Iqq9gauCLr50tLDfrMBs1ocM268qKFhzk1kZcT2B/tMI+57k6OQ61Ek1C9vfOzdE7E8oZyK49CebksbKPPSL29zrq5P+JKjraBGRmsIazrcTmdUZMe+QsYN7UAjJzd8FF55GEFz6U4QSPIH/6wM8NqQSTwSLQja1h6V1KJMtXBU0PDRD1fqO89bJp19cLuRwWBAf/iQS3X5Fh7xhvgx29JzoPyFIRlVQsAAloyQmOJy+e5pd963JabWIWq9fpvSkRW6KLEdVlMzsVq0wi3W23RFYxJqPYjOYIyO9ncZ28g/ApT9j0rRHvdlkN1L/SjabHNaFNRzAzCMQfU9IFtuSHKU/GcWvYz4iC9wWDQs7FJVL1zTvZkJBkGp1Evo8ByyMhUt/cvsc/4ePAYxHgFKKJwJFISXhWSpbuCooUpcTEVqMWA214B1x8VimZYc9KSZYD+fPEkuvpNqUjJKoky/qOv882QqVCCX3mGNvXvE48Bm6x0Fw6U9InEtKL6QJ2bPkKv1Zm+Y7z+sZZfG/6SmvqG/DU/0ceyINRYVU8HrDBxyX/pS9F7++mvTlfPwAAAIlSURBVMJ6OehBmeW8SYYlj28mfOHzFlcF5WdDKAy+LlXQpq/BC2puMivD/J9WBNgtsPLJJM2cY1p0KSCR/RAQl/6ETgpfi/QnwqTGn3azDNA2NdVTpVVr2vvGrW14mNl8lojFAi79icXKt54mssvBFE/EVUFrJAsUsDRhu1EFBQhQMqviL/jnGTgsnjDLeZLB2wsnUznaqrj0p2SRIUEpAPPwmoqR/mzCQK/Oz8kt0pngvbJn9aPTNwr4Njm49Ce8o/BcLgPCuxxsKUlcFVTCgAGrZ7YbVVCgDmZdhq9fsstWzyMI7YHrPfa7EuiFS39O2xteQjLuov362sV3rBcJZL6AzMNaVIz0J7qbVTfr3auHebdBIyc5zfnRLP38r5tDec+nUIC49Cesl/C8ZgZwVVCUC5AopPTCmhD1TOVXBeVGBVCAsvHjLZ8gt+MONVd3hpbyZF9x6c+gRQi9LPW0+93Ali052AqkYmYrBUl/IuSeq/3OLTWozHoTd2vbn0eCXuY1y36yIOLSn2I6Cs/mMoCrgoJDQcmlJNuFKqgiOVSkLXDU4DnyZACX/pQnm0rRFq4KCuyGdi0lqSTgFQlDkbaAQYNnyIEBXPpTDiQqbRO4Kiiga9q1lKSSgFckDEXaAoQMniwnBnDpTzkRqZTN4KqgStktOCicAZwBnIGvkQGRl6S/Ridxn3AGcAZwBnAGlIEBfMlRhl7AMeAM4AzgDHwTDPwfYGfQPHFUVscAAAAASUVORK5CYII=" alt="" />

果然,hive和hbase引用了不同版本的thrift.

这个问题解决起来也非常简单,将HBASE_HOME设置为空,让Sqoop不能加载hbase版本的thrift就OK了。

参考:http://stackoverflow.com/questions/16133156/sqoop-hive-exited-with-status-1

使用Sqoop从mysql向hdfs或者hive导入数据时出现的一些错误的更多相关文章

  1. sqoop从hive导入数据到mysql时出现主键冲突

    今天在将一个hive数仓表导出到mysql数据库时出现进度条一直维持在95%一段时间后提示失败的情况,搞了好久才解决.使用的环境是HUE中的Oozie的workflow任何调用sqoop命令,该死的o ...

  2. 【转】hive导入数据出现NULL

    在把hdfs上数据迁移到hive中的表时,若出现数据位NULL,是因为没有指定列分隔符. 由于hive默认的分隔符是/u0001(Ctrl+A),为了平滑迁移,需要在创建表格时指定数据的分割符号,语法 ...

  3. [MySQL]load data local infile向MySQL数据库中导入数据时,无法导入和字段不分离问题。

    利用load data将文件中的数据导入数据库表中的时候,遇到了两个问题. 首先是load data命令无法执行的问题: 命令行下输入load data local infile "path ...

  4. sqoop:mysql和Hbase/Hive/Hdfs之间相互导入数据

    1.安装sqoop 请参考http://www.cnblogs.com/Richardzhu/p/3322635.html 增加了SQOOP_HOME相关环境变量:source ~/.bashrc  ...

  5. Hive导入数据的四种方法

    Hive的几种常见的数据导入方式这里介绍四种:(1).从本地文件系统中导入数据到Hive表:(2).从HDFS上导入数据到Hive表:(3).从别的表中查询出相应的数据并导入到Hive表中:(4).在 ...

  6. hive 导入数据

    1.load data load data local inpath "/home/hadoop/userinfo.txt" into table userinfo; " ...

  7. MYSQL数据库导入数据时出现乱码的解决办法

    我的一个网站在负载搞不定的情况下最终选择了数据库和程序分离的方式解决的高负载,但是再导入数据的时候出现了大量乱码,最终通过方法二解决掉导入数据的问题,后面再设计网站布局的时候数据库跟网站程序分离是个很 ...

  8. mysql 批处理文件--- 创建 用户 以及 导入数据

    在window下,通过批处理文件(.bat),进行开启MYSQL服务,导入数据文件(.sql) 1)新建一个txt文件,写入以下内容 rem 启动mysql56服务  mysql56是我的mysql服 ...

  9. mysql/mariadb数据库在插入表数据时,ID竟然成奇数增加了?看完下面内容就知道怎么处理了。

    今天突然被问到一个问题,mysql数据库插入表数据时,设置了ID自增,但是插入数据后,ID却呈奇数增加,不是123456类型,而是13579形式,突然有点懵,研究了一会,发现是auto_increme ...

随机推荐

  1. 解决64位win7系统IIS7[ODBC 驱动程序管理器]未发现数据源名称并且未指定默认驱动程序

    从网上下载了一个asp系统,数据库是Access类型的,运行环境为 64位Windows 7系统,IIS7,运行系统后,报如下错误: Microsoft OLE DB Provider for ODB ...

  2. $.get

    $('#choice').change(function() { if($(this).val() != '') { $.get( 'data.php', { what: $(this).val() ...

  3. 九度OJ 1500 出操队形 -- 动态规划(最长上升子序列)

    题目地址:http://ac.jobdu.com/problem.php?pid=1500 题目描述: 在读高中的时候,每天早上学校都要组织全校的师生进行跑步来锻炼身体,每当出操令吹响时,大家就开始往 ...

  4. 程序员面试题精选100题(33)-在O(1)时间删除链表结点[数据结构]

    作者:何海涛 出处:http://zhedahht.blog.163.com/ 题目:给定链表的头指针和一个结点指针,在O(1)时间删除该结点.链表结点的定义如下: struct ListNode { ...

  5. jQuery 选择器(转)

    jQuery 选择器 选择器 实例 选取 * $("*") 所有元素 #id $("#lastname") id="lastname" 的元 ...

  6. ASP.Net MVC 生成安全验证码

    ---------html <td>验证码:</td>            <td>                <img src="/Logi ...

  7. memcached全面剖析--5

    memcached的应用和兼容程序 mixi案例研究 mixi在提供服务的初期阶段就使用了memcached. 随着网站访问量的急剧增加,单纯为数据库添加slave已无法满足需要,因此引入了memca ...

  8. 微信公众号-5秒内不回复测试并处理方案,顺便复习php 时间执行

    在index.php中 file_put_contents('has_request.txt','请求时间:'.date('YmdHis')."\n",FILE_APPEND); ...

  9. redis 安装注意事项

    redis安装 1.redis 安装 官网地址:http://redis.io/download $ wget http://download.redis.io/releases/redis-3.0. ...

  10. Linux启用MySQL的InnoDB引擎

    前几天公司的一个项目组的同事反应说公司内部的一台Linux服务器上的MySQL没有InnoDB这个引擎,我当时想应该不可能啊,MySQL默认应该 就已经安装了这个引擎的吧,于是上服务器去看了看,发现还 ...