报错如下:
2022-02-21 18:07:56,595 FATAL [IPC Server handler 22 on 42371] org.apache.hadoop.mapred.TaskAttemptListenerImpl:
Task: attempt_1639734219463_44543_m_000001_0 - exited :
java.io.IOException: java.sql.SQLException: ORA-12592: TNS:bad packet
at org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:233)
at org.apache.sqoop.mapreduce.AsyncSqlRecordWriter.write(AsyncSqlRecordWriter.java:46)
at org.apache.hadoop.mapred.MapTask$NewDirectOutputCollector.write(MapTask.java:658)
at org.apache.hadoop.mapreduce.task.TaskInputOutputContextImpl.write(TaskInputOutputContextImpl.java:89)
at org.apache.hadoop.mapreduce.lib.map.WrappedMapper$Context.write(WrappedMapper.java:112)
at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportMapper.map(SqoopHCatExportMapper.java:56)
at org.apache.sqoop.mapreduce.hcat.SqoopHCatExportMapper.map(SqoopHCatExportMapper.java:35)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
at org.apache.sqoop.mapreduce.AutoProgressMapper.run(AutoProgressMapper.java:64)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:170)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1869)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:164)
查找资料,很多建议: 数据容量、超时时间、防火墙 。
挨个排查,使用CSV数据往Oracle同步,发现没问题。
最终确定是数据格式的原因:
某些字段有特殊字符,比如按了 TAB键,空格键等。
表中查找是否含有特殊字符的字段,尤其是备注字段,姓名字段,诸如此类需要手输的字段,因为业务前端录入可能会有这样的问题。



