Databricks Data Engineer Professional Question 129
Select 3A data engineering team is tasked with promoting data from the Bronze layer to the Silver layer in a Delta Lake architecture. Which of the following objectives should they focus on during this transformation process?
- A
Performing data validation and filtering out corrupted records
- B
Enforcing schema consistency to ensure uniformity of data
- C
Adding business-specific aggregations and KPIs for reporting
- D
Enriching the data by joining it with reference datasets
- E
Archiving raw data for long-term storage and compliance
Show answer and explanation
Correct answers: A, B, D
Explanation
The objective of promoting data from the Bronze to Silver layer is to clean, validate, and structure the data, ensuring it is ready for analytical use or further transformations. This involves removing corrupted records, enforcing schema consistency, and enriching the data with additional context, such as joining with reference datasets. Aggregations and archiving are not primary objectives of this specific transformation stage.
- A. Correct.
Correct: Validating and filtering corrupted records are key objectives of transforming data from Bronze (raw) to Silver (cleaned and structured) to ensure data quality.
- B. Correct.
Correct: Enforcing schema consistency ensures that data in the Silver layer adheres to a defined structure, making it ready for downstream processing.
- C. Incorrect.
Incorrect: Business-specific aggregations and KPIs are typically created in the Gold layer (analytics-ready data), not during Bronze-to-Silver transformations.
- D. Correct.
Correct: Enriching data by joining with reference datasets adds value and context, which is an important part of preparing data at the Silver layer.
- E. Incorrect.
Incorrect: Archiving raw data is typically a function of the Bronze layer, not a step during the transformation to Silver.