MLA-C01 Question 74
Select 3A company processes real-time sensor data from IoT devices and needs to transform the data into a structured form before sending it to Amazon Redshift for analytics. The transformation logic requires applying custom business rules and enriching the data with metadata from a DynamoDB table. Which combination of AWS services can be used to perform this transformation effectively?
- A
AWS Lambda for real-time transformation and enrichment, integrated with DynamoDB for metadata lookup
- B
Amazon Kinesis Data Analytics to process and enrich the streaming data
- C
AWS Glue to perform ETL operations on the real-time streaming data
- D
Apache Spark on Amazon EMR to process the streaming data and implement custom business rules
- E
Amazon Redshift Spectrum for transforming data in real time
Show answer and explanation
Correct answers: A, B, D
Explanation
The correct combination of services depends on the nature of the transformation and scale of the data. AWS Lambda is suitable for lightweight, serverless transformations, while Amazon Kinesis Data Analytics provides a managed service for real-time streaming data processing. For more complex and large-scale transformations, Apache Spark on Amazon EMR is a robust option. AWS Glue and Amazon Redshift Spectrum are not suitable for real-time streaming data transformation tasks.
- A. Correct.
Correct. AWS Lambda can be used for lightweight, serverless real-time data transformation and is capable of integrating with DynamoDB for metadata lookups.
- B. Correct.
Correct. Amazon Kinesis Data Analytics is designed for processing streaming data in real time and can handle transformation and enrichment tasks efficiently.
- C. Incorrect.
Incorrect. AWS Glue is primarily used for batch ETL jobs, not real-time streaming data transformation.
- D. Correct.
Correct. Apache Spark on Amazon EMR is suitable for real-time or near-real-time processing of large-scale streaming data and can implement custom business rules and transformations.
- E. Incorrect.
Incorrect. Amazon Redshift Spectrum is used for querying data stored in S3, not for transforming real-time streaming data.