Hive activity failing with error "{"error":"File /opt/cloudera/parcels/CDH-5.x/lib/hive-hcatalog/sbin/../share/webhcat/svr/lib/zookeeper-3.4.3.jar does not exist."}"

Hive activity failing with error "{"error":"File /opt/cloudera/parcels/CDH-5.x/lib/hive-hcatalog/sbin/../share/webhcat/svr/lib/zookeeper-3.4.3.jar does not exist."}"

book

Article ID: KB0076236

calendar_today

Updated On:

Products Versions
TIBCO ActiveMatrix BusinessWorks Plug-in for Big Data 6.x

Description

Description:
=========

The Hive activity of TIBCO ActiveMatrix BusinessWorks(TM) Plug-in for Big Data failing with below error:
==============
<Data>
<ns0:HadoopException xmlns:ns0="http://schemas.tibco.com/bw/plugins/hadoop/HadoopExceptions">
    <msg>Error Occurred: com.tibco.plugin.hadoop.hdfs.exception.HDFSCommonException: {"error":"File /opt/cloudera/parcels/CDH-5.13.2-1.cdh5.13.2.p0.3/lib/hive-hcatalog/sbin/../share/webhcat/svr/lib/zookeeper-3.4.3.jar does not exist."}&#xD;
at com.tibco.plugin.hadoop.Utils.throwHDFSException(Utils.java:126)&#xD;
at com.tibco.bw.palette.hadoop.runtime.HadoopActivity.throwHadoopException(HadoopActivity.java:335)&#xD;
at com.tibco.bw.palette.hadoop.runtime.HiveActivity.eval(HiveActivity.java:115)&#xD;
at com.tibco.bw.palette.hadoop.runtime.HadoopActivity.doExecute(HadoopActivity.java:283)&#xD;
at com.tibco.bw.palette.hadoop.runtime.HadoopActivity$1.run(HadoopActivity.java:300)&#xD;
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)&#xD;
at java.util.concurrent.FutureTask.run(FutureTask.java:266)&#xD;
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)&#xD;
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)&#xD;
at java.lang.Thread.run(Thread.java:748)&#xD;
-{ActivityName=Hive, ProcessName=governmentservice.Resource, ModuleName=GovernmentService}</msg>
    <msgCode>TIBCO-BW-PALETTE-HADOOP-5000001</msgCode>
</ns0:HadoopException>
</Data>
==============


Cause:
=====
The issue caused by WebHcat is not configured properly in the CDH environment. By default, WebHcat uses zookeeper-3.4.3 so that it is finding zookeeper 3.4.3 while CDH 5.13.2 uses zookeeper-3.4.5 jar.

For a compatible version of CDH with zookeeper refer the link:
https://www.cloudera.com/documentation/enterprise/release-notes/topics/cdh_vd_cdh_package_tarball_513.html#packaging_5132

Issue/Introduction

Hive activity failing with error "{"error":"File /opt/cloudera/parcels/CDH-5.x/lib/hive-hcatalog/sbin/../share/webhcat/svr/lib/zookeeper-3.4.3.jar does not exist."}"

Environment

Product: TIBCO ActiveMatrix BusinessWorks(TM) Plug-in for Big Data Version: 6.x OS: All Supported Operating Systems

Resolution

Resolution:
==========
To resolve this issue follow the below steps,
1. Open the Cloudera Manager Admin Console, click the Hive service and click Configuration.
2. Under WebHCat Server, click Advanced.
3. Click the Value cell for the "WebHCat Server Configuration Safety Valve for webhcat-site.xml", add the following:
****************
  <property>
    <name>templeton.libjars</name>
    <value>/usr/lib/zookeeper/zookeeper-3.x.x-cdh x.x.jar</value>
    <description>Jars to add to the classpath.</description>
  </property>
  <property>
    <name>templeton.hive.path</name>
    <value>hive.tar.gz/bin/hive</value>
    <description>The path to the Hive executable.</description>
  </property>
****************
 4.  Make sure in the above that you enter the correct version for the zookeeper and hive based on your CDH version.
 5. Click Save Changes.
 

Additional Information

https://community.cloudera.com/t5/Batch-SQL-Apache-Hive/problem-running-hive-query-through-webhcat/td-p/847