Databricks Data Engineer Associate Question 459
Select 2You are working on a Databricks job that processes daily sales data. The job contains multiple tasks, and you want to create an alert that notifies your team if any task in the job fails. Which of the following steps should you perform to configure such an alert?
- A
Navigate to the Databricks Jobs UI and enable the 'Notify on Failure' option for the job.
- B
Configure the job to send email notifications to the team in the 'Notifications' section of the job settings.
- C
Use the Databricks REST API to create an alert for failed tasks and set a notification destination.
- D
Set up a monitoring tool to track Databricks cluster logs for failure events.
- E
Enable 'Retry on Failure' for each task to automatically retry failed tasks.
Show answer and explanation
Correct answers: B, C
Explanation
To create an alert for a failed task in Databricks, you can use the 'Notifications' section in the job settings to configure email notifications or programmatically configure alerts using the Databricks REST API. These methods ensure reliable and timely notifications about task failures directly within the Databricks ecosystem.
- A. Incorrect.
This is incorrect. While the Databricks Jobs UI provides options for configuring notifications, there is no specific 'Notify on Failure' toggle. Notifications must be configured explicitly in the job settings.
- B. Correct.
This is correct. In the 'Notifications' section of the Databricks job settings, you can configure email notifications for failures, which is a recommended approach for alerting the team.
- C. Correct.
This is correct. The Databricks REST API allows you to programmatically configure alerts for task failures and set up notification destinations, which is another valid approach.
- D. Incorrect.
This is incorrect. While external monitoring tools can track logs for failures, this approach is not specific to the Databricks platform and is not the recommended method for configuring alerts within Databricks.
- E. Incorrect.
This is incorrect. Enabling 'Retry on Failure' helps with task reliability but does not notify the team when a task fails after retries. Alerts are configured separately.