Apache Spark Data Source Template

Keywords: Apache Spark Template

Here is a template for the Apache Spark JDBC data source.

This template uses single quotes around the various names, to prevent the following SQL error.

• Failed to execute query: [Databricks][DatabricksJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: org.apache.hive.service.cli.HiveSQLException: Error running query: [PARSE_SYNTAX_ERROR] org.apache.spark.sql.catalyst.parser.ParseException:
  [PARSE_SYNTAX_ERROR] Syntax error

<jdbc-type-settings>
  <type-name>Databricks (Apache Spark)</type-name>
  <driver>com.databricks.client.jdbc.Driver</driver>
  <connection-url-pattern>jdbc:databricks://host:port/database;transportMode=value;ssl=value;AuthMech=value;httpPath=value</connection-url-pattern>
  <ping-command>select version()</ping-command>
  <column-name-pattern>`$$name$$`</column-name-pattern>
  <table-name-pattern>`$$name$$`</table-name-pattern>
  <schema-name-pattern>`$$name$$`</schema-name-pattern>
  <catalog-name-pattern>`$$name$$`</catalog-name-pattern>
  <procedure-name-pattern>`$$name$$`</procedure-name-pattern>
  <column-alias-pattern>`$$name$$`</column-alias-pattern>
</jdbc-type-settings>

This box will be hidden from the public.
From Case: #235742