Databricks Data Engineer Associate Question 429
Select 3You are setting up a Databricks Job that processes data in multiple stages. The job consists of three tasks: Task A (data ingestion), Task B (data transformation), and Task C (data validation). Task B must only start after Task A is successfully completed, and Task C must only start after both Task A and Task B are successfully completed. How should you configure the predecessor relationships between these tasks in the Databricks Jobs UI?
- A
Set Task A as a predecessor of Task B.
- B
Set Task A as a predecessor of Task C.
- C
Set Task B as a predecessor of Task C.
- D
Set Task C as a predecessor of Task A.
- E
Set Task C as a predecessor of Task B.
Show answer and explanation
Correct answers: A, B, C
Explanation
In Databricks Jobs, predecessor tasks are used to define dependencies between tasks to ensure they run in the correct order. In this case, Task B depends on Task A, and Task C depends on both Task A and Task B. Thus, Task A must be set as a predecessor of Task B and Task C, and Task B must be set as a predecessor of Task C. This ensures the tasks are executed in the proper sequence.
- A. Correct.
This is correct because Task B depends on the successful completion of Task A to begin execution.
- B. Correct.
This is correct because Task C depends on the successful completion of Task A to ensure the data ingestion phase is completed before validation.
- C. Correct.
This is correct because Task C also depends on the successful completion of Task B to ensure the data transformation phase is completed before validation.
- D. Incorrect.
This is incorrect because Task C does not precede Task A; instead, Task C depends on the completion of Task A (and Task B).
- E. Incorrect.
This is incorrect because Task C does not precede Task B; instead, Task C depends on Task B's completion.