DEA-C01 Question 113
Single answerYou are working as a Data Engineer at an e-commerce company. The company collects real-time clickstream data from its website and stores it in Amazon Kinesis Data Streams. The data must then be processed to generate real-time metrics, such as user activity trends, and stored in Amazon S3 for further analysis. Which service should you use to process the data in real-time while ensuring scalability and low latency?
- A
Amazon Kinesis Data Analytics
- B
AWS Glue
- C
Amazon EMR
- D
Amazon Redshift
Show answer and explanation
Correct answer: A
Explanation
The scenario involves real-time processing of clickstream data from Kinesis Data Streams. Amazon Kinesis Data Analytics is purpose-built for processing streaming data in real-time, allowing you to write SQL queries or custom applications to extract insights from the data as it flows through the stream. This makes it the most suitable choice for the given use case.
- A. Correct.
Amazon Kinesis Data Analytics is designed for real-time processing of streaming data from Kinesis Data Streams. It allows you to analyze and process data in real-time with SQL queries or Java/Scala applications, making it the best choice for this scenario.
- B. Incorrect.
AWS Glue is primarily used for ETL (Extract, Transform, Load) operations and batch processing. It is not optimized for real-time data processing.
- C. Incorrect.
Amazon EMR is a managed big data service primarily used for batch processing and running big data frameworks like Apache Spark or Hadoop. It is not ideal for real-time streaming data processing.
- D. Incorrect.
Amazon Redshift is a data warehousing service used for complex analytical queries on structured data. It is not suitable for real-time data processing.