DEA-C01 Question 312
Select 3You are designing a data processing pipeline for a large e-commerce company. The pipeline needs to process terabytes of data daily and requires the ability to execute custom scripts for data transformation and analytics. Which of the following AWS services supports scripting capabilities to meet this requirement?
- A
Amazon EMR
- B
Amazon Redshift
- C
AWS Glue
- D
Amazon S3
- E
Amazon DynamoDB
Show answer and explanation
Correct answers: A, B, C
Explanation
Amazon EMR, Amazon Redshift, and AWS Glue are services that enable scripting capabilities for custom data processing and analytics tasks. Amazon EMR is ideal for large-scale distributed data processing using scripting languages like Python or tools like Apache Spark. Amazon Redshift supports SQL and stored procedures for transforming and querying large datasets. AWS Glue provides a serverless option for creating custom ETL scripts in Python or Scala. Amazon S3 and DynamoDB, while integral to data workflows, do not natively support scripting functionalities.
- A. Correct.
Amazon EMR supports scripting via frameworks like Apache Spark, Apache Hive, and Apache Pig, allowing you to run custom data processing tasks.
- B. Correct.
Amazon Redshift allows scripting through SQL and stored procedures, enabling advanced data transformations and analytics.
- C. Correct.
AWS Glue supports scripting using Python or Scala for custom ETL (Extract, Transform, Load) jobs.
- D. Incorrect.
Amazon S3 is a storage service and does not provide scripting capabilities. However, it can integrate with services that do.
- E. Incorrect.
Amazon DynamoDB is a NoSQL database service and does not support scripting for data transformations or analytics.