Upgrading Tecton SDK on Databricks Notebook Clusters

This guide includes instructions for updating existing Notebook clusters to a different Tecton SDK version. Supported SDK versions can be found here.

In the Databricks UI, go to Clusters -> your current Tecton Notebook Cluster.

Replace Libraries and Jars in the new cluster

On the Cluster configuration page, go to the Libraries tab and uninstall the tecton and tecton-udfs jar.

Install tecton package from PyPi

1. Click Install New
2. Select PyPI under Library Source
3. Set Package to tecton and specify the new version. For example, if upgrading to version 0.4.3 specify tecton==0.4.3.

Install Tecton UDFs jar

1. Click Install New
2. Select DBFS/S3 under Library Source
3. Set File Path to s3://tecton.ai.public/pip-repository/itorgation/tecton/{tecton_version}/tecton-udfs-spark-3.jar and replace tecton_version with the new SDK version. For example, s3://tecton.ai.public/pip-repository/itorgation/tecton/0.4.3/tecton-udfs-spark-3.jar

Restart your Cluster

1. Click Restart
2. Connect a notebook to the cluster and run the following to confirm the new version.

   import tecton
   print(tecton.__version__)