Databricks Data Engineer Associate Question 439
Select 3A data engineering team is troubleshooting a failed task in a Databricks Job. They need to review the task’s execution history to understand the failure. Which of the following steps can they take to access this information in the Databricks workspace?
- A
Navigate to the Job's run history, select the specific run, and click on the failed task to view its execution details.
- B
Open the Databricks SQL editor and query system tables to retrieve task execution logs.
- C
Go to the Runs tab of the Job and expand the task details for the desired run to access logs and error messages.
- D
Use the Databricks REST API to list job runs and access the execution details of the failed task.
- E
Access the workspace's global event logs to search for task-level execution details.
Show answer and explanation
Correct answers: A, C, D
Explanation
To review a task's execution history in Databricks, users can rely on the Job's run history UI in the workspace or access the task execution details programmatically using the REST API. The Runs tab provides logs and error messages for individual tasks, while the REST API allows for automated retrieval of these details. Other tools, like the SQL editor or global event logs, are not suitable for directly accessing task-specific execution histories.
- A. Correct.
Correct. The most straightforward way to review a task’s execution history is through the Job's run history in the Databricks workspace.
- B. Incorrect.
Incorrect. The Databricks SQL editor is not designed for querying task execution details directly.
- C. Correct.
Correct. The Runs tab provides detailed information about the task execution, including logs and error messages for failed tasks.
- D. Correct.
Correct. The Databricks REST API allows programmatic access to job and task execution details, which can include failure information.
- E. Incorrect.
Incorrect. While global event logs are useful for auditing and troubleshooting, they do not provide task-specific execution histories in a structured manner.