Databricks Data Engineer Associate Question 441
Select 3A data engineer is troubleshooting a failed task in a Databricks job. They want to review the task's execution history to identify the root cause of the failure. Which of the following steps should they take to access the task's execution history?
- A
Navigate to the 'Tasks' tab in the Databricks Jobs UI and click on the task name to view its execution history.
- B
Open the Databricks Cluster UI and inspect the logs of the associated cluster for the task.
- C
In the Databricks Jobs UI, click on the job run associated with the failed task and review the task execution details.
- D
Use a REST API call to fetch the task's execution history programmatically.
- E
Check the Databricks SQL history tab for the task's execution details.
Show answer and explanation
Correct answers: A, C, D
Explanation
To review a task's execution history in Databricks, users can utilize the 'Tasks' tab in the Jobs UI or click on a specific job run to view the task details. Additionally, the Databricks REST API provides a method to programmatically access execution history. Cluster logs and the SQL history tab are not the appropriate tools for this specific purpose.
- A. Correct.
This is correct. The 'Tasks' tab in the Databricks Jobs UI provides details about individual tasks, including their execution history.
- B. Incorrect.
This is incorrect. While cluster logs may provide general troubleshooting information, they are not the primary source for reviewing a task's execution history.
- C. Correct.
This is correct. The Databricks Jobs UI allows users to click on job runs to view detailed execution history for each task within the run.
- D. Correct.
This is correct. The Databricks REST API can be used to programmatically fetch task execution history and other job-related data.
- E. Incorrect.
This is incorrect. The SQL history tab in Databricks is used to view SQL query history, not task execution details for Databricks jobs.