DEA-C01 Question 268
Select 2Your organization uses AWS Glue to manage ETL jobs and a data lake in Amazon S3. You need to ensure the accuracy and trustworthiness of the data by tracking its lineage throughout the ETL process. Which actions should you take to achieve this?
- A
Enable AWS Glue Data Catalog to store metadata and lineage information.
- B
Use AWS Glue's built-in feature to generate data lineage diagrams.
- C
Integrate AWS Glue with AWS Lake Formation to enforce fine-grained data permissions.
- D
Use AWS Glue job bookmarks to track changes in data over time.
- E
Enable AWS Glue's integration with Amazon Athena to query and trace data lineage.
Show answer and explanation
Correct answers: A, B
Explanation
To ensure data accuracy and trustworthiness, tracking data lineage is crucial. AWS Glue offers features like the Data Catalog for metadata and lineage storage and built-in lineage diagrams for visualizing data transformations and flow. These tools help identify the origin and transformations of data, ensuring its integrity and reliability. Other options, like job bookmarks or integration with Athena, serve different purposes and do not directly contribute to lineage tracking.
- A. Correct.
Correct: AWS Glue Data Catalog stores metadata about datasets and can track lineage information, which is essential for maintaining data accuracy and trustworthiness.
- B. Correct.
Correct: AWS Glue provides built-in features for generating lineage diagrams, which visually represent how data flows and is transformed throughout the ETL process.
- C. Incorrect.
Incorrect: While AWS Lake Formation enforces fine-grained data permissions, it does not directly provide data lineage tracking capabilities.
- D. Incorrect.
Incorrect: AWS Glue job bookmarks track processed data for incremental ETL jobs but do not provide lineage information.
- E. Incorrect.
Incorrect: Amazon Athena is used for querying data but does not provide lineage tracking capabilities when integrated with AWS Glue.