Databricks Generative AI Engineer Associate Question 241
Select 3You are working on a Databricks project that involves training a large language model (LLM) using sensitive customer data. To ensure proper governance, which actions should you take to comply with data governance policies and secure the training process?
- A
Use Unity Catalog to manage access controls and audit data usage for the training datasets.
- B
Store sensitive customer data in plain text files within the Databricks workspace to simplify data access.
- C
Apply data masking or anonymization techniques to sensitive fields before using the data for training.
- D
Enable cluster-level encryption to secure data in transit and at rest during the model training.
- E
Disable audit logs for the workspace to improve training performance by reducing logging overhead.
Show answer and explanation
Correct answers: A, C, D
Explanation
Proper governance in Databricks involves using tools like Unity Catalog for access controls and auditing, applying data security measures such as encryption and anonymization, and ensuring visibility into data usage through audit logs. These steps help protect sensitive data and comply with regulatory requirements during processes like training LLMs.
- A. Correct.
Unity Catalog provides a unified governance solution for managing access controls, enforcing data policies, and auditing data usage, making it a critical component for ensuring data governance in Databricks.
- B. Incorrect.
Storing sensitive data in plain text files is a violation of data governance best practices and exposes the data to potential security breaches.
- C. Correct.
Data masking or anonymization helps protect sensitive fields and ensures compliance with privacy regulations when using customer data for model training.
- D. Correct.
Cluster-level encryption ensures that data remains secure both at rest and in transit, aligning with governance and security best practices for sensitive data.
- E. Incorrect.
Disabling audit logs is not recommended as it removes visibility into data access and usage, which is essential for governance and compliance.