Shop

Your Notifications (0)

There are currently no notifications. You're all set!

Demos Trials
Knowledge Base
ChemDraw and ChemOffice+ Products Signals Notebook E-Notebook and ChemBioOffice Enterprise Spotfire and Signals Spotfire Products Columbus Signals Image Artist
Downloads
Downloads
Community
Support Forums Ideas Portal Product Basics
About Support
Legal Resources Support and Maintenance Plans Product Life Cycle Support News
Contact Support

Initializing the pyspark on Jupyter Python Notebooks in Team Studio fails with an error

Rich Talbot
  • Updated
Date Posted:
Product: TIBCO Spotfire®

Problem:

Initializing the pyspark on Jupyter Python Notebooks in Team Studio fails with an error


Solution:

Initializing the pyspark on Jupyter Python Notebooks in Team Studio fails with the following error:

===============================================
An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext: java.lang.IllegalStateException: Spark context stopped while waiting for backend at org.apache.spark.scheduler.TaskSchedulerImpl.waitBackendReady(TaskSchedulerImpl.scala:818)
================================================ Make sure that the java version on the Cloudera datasource is greater than 1.7. By default, the Cloudera datasource is shipped with Java 1.7 so we have to manually update the java version to 1.8 or higher.


NOTE: TIBCO Data Science Team Studio supports Oracle jdk and doesn't support Open jdk yet.