TIBCO Data Science Team Studio may fail to submit spark jobs on the Cloudera data source
Article ID: KB0075346
Updated On:
| Products | Versions |
|---|---|
| Spotfire Data Science | 6.5.0 |
Description
TIBCO Data Science Team Studio fails to submit spark jobs on the Cloudera data source. For example a Column Filter operators fails to submit the spark job with the error below:
Execution of 'Column Filter' failed. Error details: An error occurred when running the operator. Please see Alpine.log for more details.
Execution of 'Column Filter' failed. Error details: An error occurred when running the operator. Please see Alpine.log for more details.
Issue/Introduction
TIBCO Data Science Team Studio may fail to submit spark jobs on the Cloudera data source
Environment
Operating System: Linux
Resolution
Try to run a MapReduce job with the same operator that fails to submit spark jobs. If the MapReduce job succeeds, it indicates that the spark jars are corrupted.
Delete the spark jars from the location, /user/chorus/lib of your Cloudera data source. Refresh the browser and re-submit the spark job to resolve the issue.
Delete the spark jars from the location, /user/chorus/lib of your Cloudera data source. Refresh the browser and re-submit the spark job to resolve the issue.
Feedback
Yes
No
Powered by
