Databricks Data Engineer Associate Question 442
Select 3You are working on a Databricks workflow that contains multiple tasks. One of the tasks is intermittently failing, and you need to identify the root cause by reviewing its execution history. Which of the following actions would allow you to effectively analyze the task's execution history in Databricks?
- A
Navigate to the Workflows UI, select the specific workflow, and open the Task Runs tab to view details of each task execution.
- B
Use the Databricks REST API to retrieve detailed task run logs and execution metadata.
- C
Access the Databricks CLI to directly modify the task execution history and resolve the issue.
- D
Navigate to the Workflows UI and download the logs associated with the failed task for additional debugging.
- E
Enable task retry settings in the workflow configuration to automatically fix the issue.
Show answer and explanation
Correct answers: A, B, D
Explanation
To effectively analyze a task's execution history in Databricks, you can leverage the Workflows UI to view the Task Runs tab, use the REST API for detailed logs and metadata, or download logs from the Workflows UI for additional debugging. These methods provide actionable insights into the task's behavior and failure causes. The Databricks CLI and enabling retries are not appropriate for reviewing execution history.
- A. Correct.
This is correct because, in the Databricks Workflows UI, the Task Runs tab provides a detailed history of task executions, including logs and status information.
- B. Correct.
This is correct because the Databricks REST API allows you to programmatically retrieve detailed task run logs and metadata for further analysis.
- C. Incorrect.
This is incorrect because the Databricks CLI is not used to modify task execution history. It is generally used for scripting and managing Databricks resources but does not allow you to directly alter execution history.
- D. Correct.
This is correct because downloading the task logs from the Workflows UI enables deeper inspection of the failure, which is often necessary for debugging.
- E. Incorrect.
This is incorrect because enabling task retry settings does not allow you to review the execution history. While retries may help with transient issues, they do not provide insight into past task runs.