DEA-C01 Question 311
Select 3A data engineering team needs to process large-scale data transformations, run SQL queries on a data warehouse, and automate ETL processes using scripts. Which AWS services support scripting to accomplish these tasks?
- A
Amazon EMR
- B
Amazon Redshift
- C
AWS Glue
- D
Amazon S3
- E
Amazon DynamoDB
Show answer and explanation
Correct answers: A, B, C
Explanation
Amazon EMR, Amazon Redshift, and AWS Glue all support scripting capabilities to handle various data engineering tasks. Amazon EMR allows scripting using frameworks like Apache Spark for large-scale distributed processing. Amazon Redshift enables the use of SQL and stored procedures for advanced data operations. AWS Glue supports Python and Scala scripting for building ETL workflows. On the other hand, Amazon S3 and DynamoDB are not designed for scripting but serve other purposes such as storage and NoSQL database management, respectively.
- A. Correct.
Amazon EMR supports scripting through various frameworks such as Apache Spark, Apache Hive, and Presto, allowing you to write custom scripts for data processing.
- B. Correct.
Amazon Redshift supports scripting through SQL queries and procedural code using Redshift's SQL-based stored procedures, making it suitable for data transformations and analysis.
- C. Correct.
AWS Glue supports scripting with Python or Scala to define ETL jobs using the Glue ETL library, enabling automated data preparation workflows.
- D. Incorrect.
Amazon S3 is a storage service and does not inherently support scripting for data transformations, though it integrates with other services that do.
- E. Incorrect.
Amazon DynamoDB is a NoSQL database service and does not support direct scripting for data transformations. It is primarily used for high-performance data storage rather than complex scripting tasks.