DEA-C01 Question 313
Select 3You are a data engineer tasked with processing and transforming large datasets in the AWS cloud. You want to write custom scripts to manage data processing workflows and transformations. Which of the following AWS services allow you to write and execute custom scripts as part of their functionality?
- A
Amazon EMR
- B
Amazon Redshift
- C
AWS Glue
- D
Amazon S3
- E
Amazon Athena
Show answer and explanation
Correct answers: A, B, C
Explanation
Amazon EMR, Amazon Redshift, and AWS Glue are services that allow users to write and execute custom scripts for various data processing tasks. Amazon EMR supports scripting through frameworks like Apache Spark, Amazon Redshift supports SQL-based scripting, and AWS Glue allows Python or Scala scripts in ETL workflows. In contrast, Amazon S3 is purely a storage service, and Amazon Athena is limited to SQL queries without custom scripting capabilities.
- A. Correct.
Amazon EMR supports scripting through tools like Apache Spark and Hive, where users can write custom code in various programming languages such as Python (PySpark) or SQL.
- B. Correct.
Amazon Redshift allows the use of SQL-based scripts for data querying, transformations, and stored procedures, making it suitable for scripting-based tasks.
- C. Correct.
AWS Glue supports scripting through AWS Glue Jobs, where users can write custom scripts in Python or Scala to perform ETL (Extract, Transform, Load) operations.
- D. Incorrect.
Amazon S3 is an object storage service and does not support scripting directly. It is used for storing and retrieving data rather than executing scripts.
- E. Incorrect.
Amazon Athena is a serverless query service that uses SQL for querying data in S3, but it does not support custom scripting beyond SQL queries.