Databricks Machine Learning Professional Question 109
Select 3You are working on automating a Databricks ML pipeline, and you need to trigger a Databricks Job when an external system sends an event. To achieve this, you plan to set up a Webhook integration. Which of the following steps are required to successfully connect a Webhook with a Databricks Job?
- A
Create a Databricks Job and retrieve its Job ID.
- B
Configure the Webhook to send an HTTP POST request to the Databricks Jobs API endpoint.
- C
Generate a Databricks personal access token and use it as the authentication header in the Webhook configuration.
- D
Enable cluster logging in Databricks before configuring the Webhook.
- E
Set up a retry policy in the Webhook configuration to handle potential failures.
Show answer and explanation
Correct answers: A, B, C
Explanation
To connect a Webhook with a Databricks Job, you must first create the Job and retrieve its Job ID. The Webhook should be configured to send an HTTP POST request to the Databricks Jobs API endpoint, and authentication must be handled using a Databricks personal access token. Steps like enabling cluster logging or setting up a retry policy are not strictly necessary for the Webhook-to-Job connection but may be relevant in other contexts.
- A. Correct.
Correct. You need to create a Databricks Job and retrieve its Job ID, as this is required for the Webhook to target the correct Job in Databricks.
- B. Correct.
Correct. The Webhook must be configured to send an HTTP POST request to the Databricks Jobs API endpoint, as this is how the Job is triggered programmatically.
- C. Correct.
Correct. A Databricks personal access token is required for authenticating the Webhook's requests to the Databricks Jobs API.
- D. Incorrect.
Incorrect. Enabling cluster logging is not required for connecting a Webhook with a Databricks Job. It is a separate feature unrelated to Webhook integration.
- E. Incorrect.
Incorrect. While setting up a retry policy is a good practice for handling failures, it is not a mandatory step for connecting a Webhook with a Databricks Job.