MLA-C01 Question 7
Select 3You are a Machine Learning Engineer tasked with building a recommendation system for an e-commerce platform. The platform generates large amounts of clickstream data, transaction logs, and user profile data daily. You need to design a data ingestion and storage solution that is cost-effective, scalable, and allows for querying the data in its raw format as well as performing transformations for machine learning model training. Which combination of services should you use?
- A
Use Amazon Kinesis Data Streams for real-time ingestion of clickstream data and store it in Amazon S3.
- B
Use Amazon Redshift to ingest and store all data, including clickstream, transaction logs, and user profile data.
- C
Use AWS Glue to catalog and transform data stored in Amazon S3.
- D
Use Amazon S3 as the primary storage for ingested data and configure lifecycle policies for cost optimization.
- E
Use Amazon RDS for storing clickstream data and performing complex queries directly on the database.
Show answer and explanation
Correct answers: A, C, D
Explanation
The correct combination of services leverages Amazon S3 as the primary storage solution due to its scalability and cost-effectiveness. Using Amazon Kinesis Data Streams ensures efficient ingestion of real-time data such as clickstream logs, and AWS Glue enables data cataloging and transformation for machine learning purposes. Amazon Redshift and Amazon RDS are not suitable choices for this scenario as they are not optimized for raw data storage or unstructured data handling at scale.
- A. Correct.
Amazon Kinesis Data Streams is a suitable choice for real-time ingestion of clickstream data, and Amazon S3 is a cost-effective and scalable storage solution.
- B. Incorrect.
Amazon Redshift is a data warehouse solution that is not cost-effective or designed for storing raw data at scale, such as clickstream logs or unstructured data.
- C. Correct.
AWS Glue is a serverless data integration service that can catalog and perform ETL on data stored in Amazon S3, making it a good choice for preparing data for machine learning.
- D. Correct.
Amazon S3 is a highly scalable and cost-effective storage service. Configuring lifecycle policies allows you to optimize costs by transitioning data to cheaper storage tiers.
- E. Incorrect.
Amazon RDS is a relational database service and is not designed for storing large-scale clickstream data or handling unstructured data efficiently.