Databricks Data Engineer Associate Question 517
Single answerA data engineering team is designing a Databricks workspace architecture for their organization. They plan to use Unity Catalog for centralized governance and want to ensure optimal performance and simplified management. Which of the following best practices should they follow when setting up the metastores?
- A
Colocate Unity Catalog metastores with the same region as the Databricks workspace
- B
Create a separate metastore in a different region for each Databricks workspace
- C
Use a single metastore across multiple workspaces located in different cloud regions
- D
Avoid using Unity Catalog and rely on individual workspace-level Hive metastores
Show answer and explanation
Correct answer: A
Explanation
Colocating Unity Catalog metastores with the same region as the Databricks workspace ensures low-latency access and simplifies operations. This is considered a best practice because cross-region communication can lead to performance degradation, and using Unity Catalog provides centralized governance, making it the recommended approach for modern data engineering workflows.
- A. Correct.
Colocating Unity Catalog metastores with the same region as the Databricks workspace is a best practice to minimize latency and ensure optimal performance.
- B. Incorrect.
Creating separate metastores in different regions for each workspace increases complexity and does not leverage the centralized governance benefits of Unity Catalog.
- C. Incorrect.
Using a single metastore across multiple workspaces in different regions can cause latency issues due to cross-region communication and should be avoided.
- D. Incorrect.
Avoiding Unity Catalog and relying on workspace-level Hive metastores compromises the centralized governance and scalability benefits provided by Unity Catalog.