MLA-C01 Question 9
Select 2You are designing a machine learning pipeline for a healthcare company that collects patient data from multiple sources, such as mobile apps, IoT devices, and hospital records. The data is semi-structured and needs to be ingested in real time to support model training and analytics. Which combination of AWS services should you use to ingest, process, and store this data for further analysis and model training?
- A
Amazon Kinesis Data Streams for real-time ingestion and Amazon S3 for storage
- B
AWS Glue for real-time ingestion and Amazon Redshift for storage
- C
Amazon Kinesis Firehose for real-time ingestion and Amazon S3 for storage
- D
Amazon DynamoDB Streams for real-time ingestion and Amazon RDS for storage
- E
Amazon S3 for real-time ingestion and AWS Lambda for pre-processing
Show answer and explanation
Correct answers: A, C
Explanation
For real-time ingestion of large-scale semi-structured data, Amazon Kinesis Data Streams and Amazon Kinesis Firehose are the most suitable AWS services. Both are designed to handle streaming data and can integrate seamlessly with Amazon S3 for scalable and cost-effective storage. This combination allows you to process and store data efficiently for further analysis and machine learning workflows.
- A. Correct.
Correct. Amazon Kinesis Data Streams is designed for real-time ingestion of large-scale data, and Amazon S3 is a cost-effective, scalable storage solution for semi-structured data.
- B. Incorrect.
Incorrect. AWS Glue is primarily used for ETL operations and data cataloging, not for real-time ingestion. Amazon Redshift is suitable for analytics but not ideal for semi-structured data storage.
- C. Correct.
Correct. Amazon Kinesis Firehose is optimized for real-time data ingestion and can directly deliver data to Amazon S3 for storage.
- D. Incorrect.
Incorrect. While DynamoDB Streams supports real-time data processing, it is not suitable for large-scale semi-structured data ingestion. Amazon RDS is a relational database service and not ideal for storing semi-structured data.
- E. Incorrect.
Incorrect. Amazon S3 is a storage service and does not support real-time ingestion. AWS Lambda can perform pre-processing but is not a dedicated real-time ingestion service.