MLS-C01 Question 36
Single answerYou are building a data pipeline to collect real-time clickstream data from a web application and deliver it to both an Amazon S3 bucket for long-term storage and an Amazon Redshift cluster for analytics. You need a managed service to ingest, transform, and deliver the streaming data to these destinations with minimal operational overhead. Which AWS service configuration should you use?
- A
Use Amazon Kinesis Data Firehose to ingest, transform, and deliver data to Amazon S3 and Amazon Redshift.
- B
Use Amazon Kinesis Data Streams to ingest data, then write a custom application to transform and deliver the data to Amazon S3 and Amazon Redshift.
- C
Use AWS Glue to process the streaming data and deliver it to Amazon S3 and Amazon Redshift.
- D
Use Amazon EMR to process the data and send it to Amazon S3 and Amazon Redshift.
Show answer and explanation
Correct answer: A
Explanation
Amazon Kinesis Data Firehose is the most suitable service for this scenario because it is designed to handle real-time data ingestion, transformation, and delivery to multiple destinations like Amazon S3 and Amazon Redshift. It requires minimal operational overhead compared to alternatives like building custom applications or managing complex big data frameworks.
- A. Correct.
Correct: Amazon Kinesis Data Firehose is a fully managed service designed to ingest, transform, and deliver streaming data to destinations like Amazon S3 and Amazon Redshift with minimal operational overhead.
- B. Incorrect.
Incorrect: While Amazon Kinesis Data Streams can ingest data, you would need to build and manage a custom application to handle transformation and delivery, which increases operational complexity.
- C. Incorrect.
Incorrect: AWS Glue is primarily used for ETL (Extract, Transform, Load) jobs on batch data, not real-time streaming data.
- D. Incorrect.
Incorrect: Amazon EMR is generally used for big data processing frameworks like Apache Spark or Hadoop and is not designed for real-time data ingestion and delivery in a managed way.