DEA-C01 Question 193
Single answerA data engineering team is tasked with building a data lake on Amazon S3. They want to ensure that all datasets in the data lake are discoverable and that metadata, including schema information, is readily available for querying. Which AWS service should they use to achieve this?
- A
AWS Glue Data Catalog
- B
Amazon Redshift
- C
AWS Lake Formation
- D
Amazon Elasticsearch Service
Show answer and explanation
Correct answer: A
Explanation
The AWS Glue Data Catalog is designed specifically for metadata management and discovery in an S3-based data lake. It enables users to store metadata, define schemas, and query the data using tools like Amazon Athena. While AWS Lake Formation is useful for managing permissions and setting up a data lake, it relies on the Glue Data Catalog for metadata functionality.
- A. Correct.
AWS Glue Data Catalog is a fully managed metadata repository that allows you to catalog datasets, define schemas, and enable dataset discovery, making it the correct choice for this scenario.
- B. Incorrect.
Amazon Redshift is a data warehousing solution and does not provide cataloging capabilities for datasets in an S3 data lake.
- C. Incorrect.
AWS Lake Formation is a service for setting up and managing data lakes, but it leverages the AWS Glue Data Catalog for metadata management and discoverability.
- D. Incorrect.
Amazon Elasticsearch Service is primarily used for search and analytics use cases and does not provide features for metadata cataloging or dataset discovery.