DEA-C01 Question 267
Select 3You are working as a data engineer for a financial services company that requires strict regulatory compliance for its data workflows. The company uses AWS Glue for its ETL processes. How can you ensure the accuracy and trustworthiness of the data by implementing data lineage?
- A
Enable AWS Glue Data Catalog and use its built-in data lineage tracking capabilities.
- B
Implement AWS Glue job bookmarks to track changes in data between job runs.
- C
Use AWS Glue's integration with Amazon Athena to query data lineage metadata.
- D
Leverage AWS Glue's integration with AWS Lake Formation to track permissions alongside data lineage.
- E
Enable AWS Glue Studio to visualize data transformations and inspect data lineage.
Show answer and explanation
Correct answers: A, D, E
Explanation
Data lineage in AWS Glue can be achieved by leveraging the AWS Glue Data Catalog for metadata tracking, AWS Lake Formation for governance and permissions tracking, and AWS Glue Studio for visualizing data transformations. These tools collectively enhance the accuracy and trustworthiness of data by providing transparency into its flow and transformations.
- A. Correct.
The AWS Glue Data Catalog provides built-in capabilities for tracking metadata and data lineage, which is critical for ensuring data accuracy and trustworthiness.
- B. Incorrect.
AWS Glue job bookmarks track state between job runs but do not provide data lineage information. This is not a correct option for data lineage.
- C. Incorrect.
Amazon Athena allows you to query data stored in S3 but does not directly provide lineage metadata. This is not relevant for tracking lineage.
- D. Correct.
AWS Lake Formation enhances data governance by integrating with AWS Glue to track data permissions and lineage, ensuring trustworthiness and compliance.
- E. Correct.
AWS Glue Studio provides visualization tools that help inspect the flow of data transformations, contributing to data lineage tracking and ensuring accuracy.