MLS-C01 Question 57
Single answerA data engineering team needs to process large volumes of semi-structured log data in transit to generate real-time insights. The data must be transformed and enriched before being stored in Amazon S3 for downstream machine learning workflows. Which AWS service is the most appropriate for this use case?
- A
AWS Glue
- B
Amazon EMR
- C
AWS Batch
- D
Amazon Kinesis Data Analytics
Show answer and explanation
Correct answer: D
Explanation
For real-time data transformations in transit, Amazon Kinesis Data Analytics is the most appropriate service. It is designed to process and analyze streaming data in real time, allowing for data enrichment and transformation before storage. The other services listed are more suited for batch processing or non-real-time ETL workflows.
- A. Incorrect.
AWS Glue is primarily used for batch ETL operations. While it is capable of transforming data, it is not suitable for real-time data transformations in transit.
- B. Incorrect.
Amazon EMR is designed for big data processing and can handle ETL operations, but it is not optimized for real-time data processing in transit. It is more suited for batch processing jobs.
- C. Incorrect.
AWS Batch is designed for batch computing and is not intended for real-time data transformation or streaming use cases.
- D. Correct.
Amazon Kinesis Data Analytics is specifically designed for real-time data processing and transformation. It can process streaming data in transit, making it the best fit for this use case.