Databricks Machine Learning Professional Question 108
Select 3You are tasked with setting up a Databricks job that triggers an external system via a webhook upon successful job completion. Which steps should you take to configure the webhook correctly?
- A
Create a webhook endpoint URL in the external system and store it securely.
- B
Set up a Databricks job and configure the webhook URL in the job's notification settings.
- C
Write a Python script within the Databricks job to manually send a POST request to the webhook URL.
- D
Ensure that the external system's webhook URL uses HTTPS for secure communication.
- E
Enable the Databricks job's webhook integration by turning on the 'Webhook Notifications' toggle in the job settings.
Show answer and explanation
Correct answers: A, B, D
Explanation
To connect a webhook with a Databricks job, you need to first create a webhook endpoint URL in the external system and ensure it is secure. Then, configure the webhook URL in the job's notification settings to trigger automatically upon job status changes. Using HTTPS ensures secure communication, while enabling a non-existent toggle or scripting a manual POST request does not align with standard configuration practices.
- A. Correct.
Correct. A webhook endpoint URL is required to establish communication between Databricks and the external system. This URL must be stored securely to prevent unauthorized access.
- B. Correct.
Correct. In Databricks, webhook URLs can be configured in the job notification settings to automatically trigger when the job completes successfully or encounters an error.
- C. Incorrect.
Incorrect. While using a Python script to send a POST request is an alternative, this bypasses the webhook integration native to Databricks and is not necessary for standard webhook setup.
- D. Correct.
Correct. HTTPS ensures secure communication between Databricks and the external system, which is essential for protecting sensitive data during transmission.
- E. Incorrect.
Incorrect. Databricks does not have a specific 'Webhook Notifications' toggle in job settings. Webhook integration is configured directly in the job's notification settings.