DEA-C01 Question 43
Single answerYou are designing a data pipeline to process clickstream data captured from a website. The data arrives in an Amazon Kinesis Data Stream, and you need to transform it to calculate session durations for each user before storing it in Amazon S3 for further analysis. Which AWS service or combination of services would be the most suitable for performing this transformation in near real-time?
- A
Amazon Kinesis Data Analytics
- B
AWS Glue
- C
Amazon EMR
- D
AWS Batch
Show answer and explanation
Correct answer: A
Explanation
Amazon Kinesis Data Analytics is purpose-built for processing and transforming streaming data in near real-time. It integrates seamlessly with Amazon Kinesis Data Streams and allows you to perform SQL-based transformations, such as calculating session durations, before storing the processed data in downstream services like Amazon S3. Other services like AWS Glue, Amazon EMR, and AWS Batch are either designed for batch processing or are not optimized for streaming use cases, making them less suitable for this scenario.
- A. Correct.
Amazon Kinesis Data Analytics is the correct choice because it is designed for performing real-time analytics and transformations on streaming data, such as calculating session durations from clickstream data.
- B. Incorrect.
AWS Glue is primarily used for ETL (Extract, Transform, Load) jobs that operate on batch data, not for near real-time streaming transformations.
- C. Incorrect.
Amazon EMR is a big data processing service suitable for batch or large-scale distributed processing, but it is not optimal for near real-time streaming transformations.
- D. Incorrect.
AWS Batch is used for scheduled batch processing jobs and is not suitable for real-time data transformation use cases.