Hive整合Hbase 解决map=100% reduce=0%的问题

搭建过程致谢：https://www.cnblogs.com/yfb918/p/10882323.htmlhttps://blog.csdn.net/dajiangtai007/article/details/79696853我当时在从hive插入到hbase表的时候，一直卡在map=100% reduce=0%查询日志找到原因：2021-04-17 06:18:12,884 ERROR [mai

宋老板的笔记

3612人浏览 · 2021-04-17 21:35:25

宋老板的笔记 · 2021-04-17 21:35:25 发布

搭建过程致谢：

https://www.cnblogs.com/yfb918/p/10882323.html

https://blog.csdn.net/dajiangtai007/article/details/79696853

我当时在从hive插入到hbase表的时候，一直卡在map=100% reduce=0%

查询日志找到原因：

2021-04-17 06:18:12,884 ERROR [main] org.apache.hadoop.hbase.client.AsyncProcess: Failed to get region location
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest$Builder.setTrackScanMetrics(Z)Lorg/apache/hadoop/hbase/protobuf/generated/ClientProtos$ScanRequest$Builder;
   at org.apache.hadoop.hbase.client.RpcRetryingCaller.translateException(RpcRetryingCaller.java:241)
   at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:214)
   at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:364)
   at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:338)
   at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:137)
   at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ScanRequest$Builder.setTrackScanMetrics(Z)Lorg/apache/hadoop/hbase/protobuf/generated/ClientProtos$ScanRequest$Builder;
   at org.apache.hadoop.hbase.protobuf.RequestConverter.buildScanRequest(RequestConverter.java:500)
   at org.apache.hadoop.hbase.client.ClientSmallReversedScanner$SmallReversedScannerCallable.call(ClientSmallReversedScanner.java:291)
   at org.apache.hadoop.hbase.client.ClientSmallReversedScanner$SmallReversedScannerCallable.call(ClientSmallReversedScanner.java:276)
   at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:212)
   ... 7 more

与hbase相关，那就是jar包有问题

回到hive的lib目录下面发现拷贝过来的jar包有hive自带的，版本不一致，删除自带的即可！