DEA-C01 Question 356
Select 3You are working as a Data Engineer for a company that processes e-commerce order data. The raw data is stored in Amazon S3, and your team needs to transform this data using AWS Glue to generate daily sales reports. The reports must be stored in Amazon Redshift for efficient querying. Which of the following steps will correctly achieve this goal?
- A
Create an AWS Glue Data Catalog table for the raw data stored in Amazon S3.
- B
Use an AWS Glue job to transform the data and write it directly to Amazon Redshift.
- C
Manually load the transformed data from Amazon S3 into Amazon Redshift using the COPY command.
- D
Configure an Amazon Redshift Spectrum query to directly query the transformed data in Amazon S3.
- E
Define an AWS Glue workflow to orchestrate the entire process from data transformation to loading into Amazon Redshift.
Show answer and explanation
Correct answers: A, B, E
Explanation
To achieve the goal of transforming raw data in Amazon S3 and loading daily sales reports into Amazon Redshift, you need to use AWS Glue for data transformation and orchestration. Creating an AWS Glue Data Catalog table is the first step to define metadata for the raw data. AWS Glue jobs can then transform the data and directly write it to Amazon Redshift. An AWS Glue workflow ensures the entire process is automated and integrated seamlessly. Options involving manual processes or Redshift Spectrum do not align with the requirement of generating and storing reports in Redshift.
- A. Correct.
Correct: Creating an AWS Glue Data Catalog table is necessary to define metadata about the raw data in Amazon S3, making it discoverable and usable in AWS Glue jobs.
- B. Correct.
Correct: AWS Glue jobs can be used to perform data transformations and write the processed data directly to Amazon Redshift.
- C. Incorrect.
Incorrect: While the COPY command can load data into Amazon Redshift, it is not required when AWS Glue writes the data directly into Amazon Redshift.
- D. Incorrect.
Incorrect: Redshift Spectrum allows querying data in Amazon S3 without loading it into Redshift, which does not meet the requirement of storing the reports in Redshift.
- E. Correct.
Correct: AWS Glue workflows help orchestrate and automate the end-to-end ETL process, ensuring smooth integration between services.