DEA-C01 Question 9
Select 2A company wants to build a data pipeline that ingests real-time streaming data from IoT devices, processes it for anomaly detection, and stores the processed data for analytics. The data should be processed with minimal latency, and the solution should be scalable and cost-effective. Which combination of AWS services should you use to implement this solution?
- A
Amazon Kinesis Data Streams for ingestion, AWS Lambda for processing, and Amazon S3 for storage
- B
Amazon SQS for ingestion, Amazon EC2 for processing, and Amazon RDS for storage
- C
Amazon Kinesis Data Firehose for ingestion, AWS Glue for processing, and Amazon Redshift for storage
- D
Amazon Kinesis Data Streams for ingestion, AWS Lambda for processing, and Amazon DynamoDB for storage
Show answer and explanation
Correct answers: A, D
Explanation
The correct combination of services depends on the requirements for real-time ingestion, minimal latency, scalability, and cost-effectiveness. Amazon Kinesis Data Streams is ideal for real-time ingestion, AWS Lambda allows serverless and low-latency processing, and both Amazon S3 and DynamoDB can be used for storage depending on the use case. S3 is more suited for cost-effective analytics storage, while DynamoDB is better for real-time queries and NoSQL use cases.
- A. Correct.
Correct: Amazon Kinesis Data Streams is a scalable service designed for real-time data ingestion. AWS Lambda provides serverless processing with minimal latency, and Amazon S3 is cost-effective for storing large amounts of processed data.
- B. Incorrect.
Incorrect: Amazon SQS is not ideal for real-time streaming data ingestion as it is designed for message queuing. Amazon EC2 requires managing instances, which increases operational overhead, and Amazon RDS is not optimized for handling large-scale real-time analytics.
- C. Incorrect.
Incorrect: Amazon Kinesis Data Firehose is designed for near real-time, not real-time, streaming, and it is commonly used for delivering data to storage solutions rather than processing. AWS Glue is better suited for batch processing rather than real-time processing.
- D. Correct.
Correct: Amazon Kinesis Data Streams supports real-time ingestion, AWS Lambda enables serverless, low-latency processing, and Amazon DynamoDB is a scalable NoSQL database suitable for storing processed real-time data.