Databricks Data Engineer Associate Question 461
Select 3A data engineering team wants to be notified whenever a task in a Databricks job fails. They also want the alert to include details of the failed task. Which of the following steps should the team take to create an alert for failed tasks?
- A
Navigate to the 'Jobs' tab in the Databricks workspace and select the job to configure alerts for.
- B
Set up an email notification under the 'Notifications' tab of the job configuration.
- C
Create a query in a SQL Analytics Dashboard that checks for failed tasks and set an alert.
- D
Enable the 'Retry on Failure' setting for the job tasks.
- E
Configure a webhook notification in the job's 'Notifications' tab to integrate with a third-party alerting system.
Show answer and explanation
Correct answers: A, B, E
Explanation
To create an alert for failed tasks in a Databricks job, you need to configure notifications in the job's settings. Email notifications can be directly set up for job failures, and webhook notifications allow integration with external alerting tools. SQL Analytics Dashboards are not used for job failure alerts, and 'Retry on Failure' helps with task recovery but doesn’t generate alerts.
- A. Correct.
Correct: This is the first step to access the job's configuration where notifications can be set up.
- B. Correct.
Correct: Email notifications can be configured in the 'Notifications' tab to alert users about job failures, including failed tasks.
- C. Incorrect.
Incorrect: While SQL Analytics Dashboards can be used to monitor data, they are not directly linked to job task failure alerts.
- D. Incorrect.
Incorrect: Enabling 'Retry on Failure' helps in automatically retrying failed tasks but does not notify users about the failures.
- E. Correct.
Correct: Webhook notifications can be configured to send detailed alerts about failed tasks to third-party alerting systems, providing flexibility in how alerts are handled.