Databricks Data Engineer Associate Question 432
Single answerYou are configuring a Databricks Job with multiple tasks. Task B should only start after Task A has successfully completed. How can you set up this dependency in the Databricks Jobs UI?
- A
Set Task A as a predecessor for Task B in the 'Task dependencies' section of the Jobs UI.
- B
Configure Task A to trigger Task B using a Databricks REST API call.
- C
Add Task B as a child task in the 'Cluster Configuration' section of the Jobs UI.
- D
Use a Databricks Notebook to manually control the execution order of Task A and Task B.
Show answer and explanation
Correct answer: A
Explanation
In Databricks Jobs, task dependencies are managed in the 'Task dependencies' section of the Jobs UI. By setting Task A as a predecessor of Task B, you ensure that Task B will only execute after Task A completes successfully. This approach is straightforward and aligns with best practices for managing task dependencies within Databricks Jobs.
- A. Correct.
This is the correct method. In the Databricks Jobs UI, you can define task dependencies by setting Task A as a predecessor for Task B, ensuring Task B only runs after Task A completes.
- B. Incorrect.
This is incorrect. While the Databricks REST API can be used to manage jobs, it is not necessary for setting a task dependency in the Jobs UI.
- C. Incorrect.
This is incorrect. The 'Cluster Configuration' section is used to configure cluster settings, not to define task dependencies.
- D. Incorrect.
This is incorrect. Using a Databricks Notebook to manually control execution is not a recommended or scalable approach for managing task dependencies in Jobs.