Skip to main content

TIBCO Data Science Team Studio may fail to submit spark jobs on the Cloudera data source

Rich Talbot
  • Created
Date Posted:
Product: TIBCO Spotfire®

Problem:

TIBCO Data Science Team Studio may fail to submit spark jobs on the Cloudera data source


Solution:

TIBCO Data Science Team Studio fails to submit spark jobs on the Cloudera data source. For example a Column Filter operators fails to submit the spark job with the error below: 


Execution of 'Column Filter' failed. Error details: An error occurred when running the operator. Please see Alpine.log for more details. Try to run a MapReduce job with the same operator that fails to submit spark jobs. If the MapReduce job succeeds, it indicates that the spark jars are corrupted. 

Delete the spark jars from the location, /user/chorus/lib of your Cloudera data source. Refresh the browser and re-submit the spark job to resolve the issue. 

Comments

0 comments

Article is closed for comments.