Skip to content

Databricks#

Spark Plugin#

  1. Create privacera_spark_custom.properties file.

    vi ~/privacera/privacera-manager/config/custom-properties/privacera_spark_custom.properties
    
  2. Add the following properties as per your preferences.

    Property Description Example
    privacera.jwt.dbx.login.user.fallback.enable

    Set this property to fallback to the logged-in user when JWT is enabled.

    privacera.jwt.dbx.login.user.fallback.enable=true

    privacera.dbx.system.mounts

    Set this property to pass comma-separated system mount points for Databricks which you want to ignore in the OLAC cluster.

    privacera.dbx.system.mounts=/,/databricks-results,/databricks/mlflow-tracking,/databricks-datasets,/databricks/mlflow-registry

  3. Run the following command.

    cd ~/privacera/privacera-manager/
    ./privacera-manager.sh update
    

Access Private DNS from Databricks Cluster#

Create another DNS entry and map it to the private DNS, so that you can access the secondary DNS directly from Databricks. Follow below steps and then upload the modified init script back to DBFS.

  1. Edit ranger_enable_scala.sh file.

    vi ranger_enable_scala.sh
    
  2. Add the following property.

    export DS_HOST=<alias_host>
    
  1. Edit ranger_enable.sh file.

    vi ranger_enable.sh
    
  2. Add the following properties.

    export BASE_RANGER_URL=https://<alias_host>:6182
    export BASE_SOLR_URL=https://<alias_host>:6084
    

Last update: October 4, 2021