MLA-C01 Question 337
Select 2A company wants to automate the ingestion of streaming data from IoT sensors into an Amazon S3 data lake for downstream machine learning workflows. The solution must ensure fault tolerance, scalability, and integration with an orchestration service to trigger preprocessing workflows after data ingestion. Which combination of services should you use to meet these requirements?
- A
Amazon Kinesis Data Firehose for streaming data ingestion and AWS Step Functions to orchestrate preprocessing workflows
- B
Amazon S3 Event Notifications to trigger AWS Lambda for preprocessing and Amazon SQS for fault-tolerant message queuing
- C
Amazon Managed Workflows for Apache Airflow (MWAA) to orchestrate data ingestion and Amazon S3 for storage
- D
AWS Glue for streaming ingestion and Amazon EventBridge to orchestrate preprocessing workflows
- E
Amazon Kinesis Data Streams for ingestion, AWS Lambda for preprocessing, and AWS Step Functions for orchestration
Show answer and explanation
Correct answers: A, E
Explanation
Both Amazon Kinesis Data Firehose and Amazon Kinesis Data Streams are suitable for streaming data ingestion into Amazon S3. AWS Step Functions provides robust orchestration for triggering preprocessing workflows after data is ingested. Combining these services ensures scalability, fault tolerance, and automation of the entire pipeline. AWS Lambda can be used for real-time preprocessing of the ingested data.
- A. Correct.
Correct. Amazon Kinesis Data Firehose is a fully managed service for streaming data ingestion into Amazon S3, and AWS Step Functions can orchestrate preprocessing workflows triggered after data is delivered.
- B. Incorrect.
Incorrect. While Amazon S3 Event Notifications can trigger AWS Lambda for preprocessing, this option does not include a robust streaming ingestion solution like Kinesis Data Firehose. Amazon SQS is also unnecessary for this specific use case.
- C. Incorrect.
Incorrect. Although Amazon MWAA can orchestrate workflows, it is not designed for real-time data ingestion. This option lacks a proper streaming data ingestion solution.
- D. Incorrect.
Incorrect. AWS Glue is primarily used for ETL tasks but is not optimized for streaming ingestion. This option also does not include a proper orchestration service.
- E. Correct.
Correct. Amazon Kinesis Data Streams provides scalable streaming data ingestion, AWS Lambda can preprocess the data in real-time, and AWS Step Functions can orchestrate the overall workflow.