DEA-C01 Question 203
Select 2You are a data engineer working for a retail company that processes large amounts of transactional data daily. You need to create a central metadata repository to enable your team to search, query, and manage the data stored in Amazon S3, Redshift, and RDS. Which steps should you take to create a data catalog using AWS Glue?
- A
Set up an AWS Glue Crawler to scan your data stores and populate the Data Catalog.
- B
Manually define the metadata schema for each table in the AWS Glue Data Catalog.
- C
Configure IAM roles to grant AWS Glue access to the data sources.
- D
Use AWS Glue Studio to automatically visualize and extract the metadata from the data sources.
- E
Enable encryption at rest for the AWS Glue Data Catalog to secure the metadata.
Show answer and explanation
Correct answers: A, C
Explanation
To create a Data Catalog in AWS Glue, you need to use AWS Glue Crawlers to scan the data stores and extract metadata automatically. Additionally, you must configure IAM roles to grant Glue the necessary permissions to access the data sources. These steps ensure that the metadata is populated and accessible for querying and managing data. While other options like manual schema definition or encryption are valid considerations, they are not core steps in the process of creating an AWS Glue Data Catalog.
- A. Correct.
Correct: AWS Glue Crawlers automatically scan your data stores, extract metadata, and populate the Data Catalog with the necessary information.
- B. Incorrect.
Incorrect: While manually defining metadata is possible, it is not required when using AWS Glue Crawlers, which automate metadata extraction.
- C. Correct.
Correct: IAM roles are required to grant AWS Glue the necessary permissions to access and interact with the data sources.
- D. Incorrect.
Incorrect: AWS Glue Studio is primarily used for creating and managing ETL jobs, not for extracting metadata to populate the Data Catalog.
- E. Incorrect.
Incorrect: While encryption is important for securing metadata, it is not a required step for creating a Data Catalog in AWS Glue.