DEA-C01 Question 409
Single answerYou are a Data Engineer working for an e-commerce company. Your team is tasked with building a data lake on Amazon S3 to store raw customer and transaction data. Before designing transformations and analytics workflows, you need to understand the quality, completeness, and structure of the ingested data. Which AWS service or feature would you use to achieve this efficiently?
- A
AWS Glue DataBrew
- B
Amazon QuickSight
- C
AWS Lake Formation
- D
Amazon Redshift Spectrum
Show answer and explanation
Correct answer: A
Explanation
Data profiling is a critical step in understanding the quality and structure of a dataset before processing and analysis. AWS Glue DataBrew is a service designed to simplify and automate data preparation tasks, including data profiling. It provides detailed insights into data quality, completeness, and distribution, which are essential for building robust data pipelines.
- A. Correct.
AWS Glue DataBrew allows data engineers to perform data profiling, which provides insights into the quality, structure, and completeness of the data. It is specifically designed for this purpose.
- B. Incorrect.
Amazon QuickSight is a business intelligence tool for creating visualizations and dashboards, but it does not provide data profiling capabilities.
- C. Incorrect.
AWS Lake Formation helps set up and manage a secure data lake but does not include specific data profiling features.
- D. Incorrect.
Amazon Redshift Spectrum enables querying data stored in Amazon S3 using Redshift, but it is not a tool for profiling data.