Databricks Data Engineer Associate Question 488
Select 3You are tasked with setting up a new data pipeline in Databricks that requires secure access to Azure Data Lake Storage. To achieve this, you decide to use a service principal for authentication. Which of the following steps are required to define and configure a service principal for this purpose?
- A
Create an application registration in Azure Active Directory and generate a client secret.
- B
Assign the service principal to a Databricks cluster as a user account.
- C
Grant the service principal the necessary permissions to access Azure Data Lake Storage.
- D
Use the service principal's client ID and client secret to configure Databricks secret scopes.
- E
Assign the service principal the 'Databricks Admin' role within the Databricks workspace.
Show answer and explanation
Correct answers: A, C, D
Explanation
To define and configure a service principal in the context of Databricks, you need to create an application registration in Azure Active Directory, grant the necessary permissions to access external resources, and use its credentials (client ID and client secret) to configure Databricks secret scopes. This approach ensures secure authentication and authorization for accessing Azure resources like Data Lake Storage.
- A. Correct.
Correct: Creating an application registration in Azure Active Directory is the first step to defining a service principal. This registration generates the necessary credentials (client ID and client secret).
- B. Incorrect.
Incorrect: Service principals are not assigned as user accounts to Databricks clusters. They are used for authentication and authorization purposes, not as a substitute for user accounts.
- C. Correct.
Correct: Granting the appropriate permissions to the service principal ensures it can access the required Azure resources, such as Data Lake Storage.
- D. Correct.
Correct: The client ID and client secret of the service principal are used to configure secret scopes in Databricks, enabling secure authentication to external resources.
- E. Incorrect.
Incorrect: While a service principal can perform administrative tasks if granted such privileges, assigning it the 'Databricks Admin' role is not required to configure secure access to Azure Data Lake Storage.