DEA-C01 Question 315
Select 3A data engineering team needs to process large-scale data transformations and run custom scripts as part of their workflow. They also require seamless integration with other AWS services. Which of the following AWS services allow scripting capabilities to process and transform data?
- A
Amazon EMR
- B
Amazon Redshift
- C
AWS Glue
- D
Amazon S3
- E
Amazon DynamoDB
Show answer and explanation
Correct answers: A, B, C
Explanation
Amazon EMR, Amazon Redshift, and AWS Glue are services that allow users to incorporate custom scripts into their workflows for data processing and transformation. Amazon EMR supports scripting through Apache Spark, Hive, and Pig. AWS Glue provides scripting capabilities in Python or Scala for ETL processes. Amazon Redshift supports scripting via SQL and UDFs. Services like Amazon S3 and DynamoDB, on the other hand, are designed for storage and database purposes, respectively, and do not support scripting directly.
- A. Correct.
Amazon EMR supports scripting through tools like Apache Spark, Hive, and Pig, allowing users to write custom scripts for data processing and transformation.
- B. Correct.
Amazon Redshift supports scripting via its SQL interface, including user-defined functions (UDFs) that can be written in Python to perform custom logic.
- C. Correct.
AWS Glue allows scripting via its Spark-based ETL jobs, enabling users to write custom scripts in Python or Scala for data transformations.
- D. Incorrect.
Amazon S3 is a storage service and does not provide scripting capabilities. It stores data but does not process or transform it directly.
- E. Incorrect.
Amazon DynamoDB is a NoSQL database service designed for high availability and scalability but does not support scripting for data transformation or processing.