From the course: MLOps with Databricks
Join today to access over 25,500 courses taught by industry experts.
Define and deploy the Databricks Asset Bundle - Databricks Tutorial
From the course: MLOps with Databricks
Define and deploy the Databricks Asset Bundle
- [Instructor] In the previous video, we defined the components of our Databricks workflow. Let's now work on the Databricks YAML file. The bundle name was already defined in the beginning when we started working with DB Connect. Let's move directly to the most important part, bundle resources. Our bundle has one resource. It's a job called hotel-cancellation. It has a schedule. The job is supposed to run at 6:00 AM, Amsterdam time every Monday. It has a pause status. It is defined by a variable scheduled pause status. For non-production workflows, we want to pause the schedule so that the job doesn't run on a chron trigger, and the value pause is defined for a variable in the dev target. The job has a tag, project_name. It can be used to track the cost associated with the project. Let's now define the job cluster. We choose 15.4 standard runtime, single user mode. We also choose the VM types for the worker nodes and the driver nodes and autoscaling policy. In our case, all the tasks…
Download courses and learn on the go
Watch courses on your mobile device without an internet connection. Download courses using your iOS or Android LinkedIn Learning app.