DEA-C01 Question 64
Select 2A company processes a large volume of data daily and needs to design a fault-tolerant, distributed system for their data pipeline. They want to ensure scalability and minimize infrastructure management overhead. Which AWS services should they use to build this solution?
- A
Amazon S3 for storage and AWS Lambda for serverless compute
- B
Amazon EC2 instances with auto-scaling for compute and EBS for storage
- C
Amazon EMR for distributed data processing and Amazon S3 for storage
- D
Amazon RDS for data processing and AWS Glue for data transformation
- E
Amazon Redshift for data warehousing and Amazon S3 for long-term storage
Show answer and explanation
Correct answers: A, C
Explanation
The scenario requires a fault-tolerant, distributed, and scalable system with minimal infrastructure management. Amazon S3 and AWS Lambda provide serverless, scalable solutions for storage and compute. Alternatively, Amazon EMR and Amazon S3 enable distributed data processing with scalable storage, making these the best choices for the described requirements.
- A. Correct.
Amazon S3 provides scalable storage, and AWS Lambda offers serverless compute, reducing infrastructure management overhead. This combination is suitable for fault-tolerant and scalable workloads.
- B. Incorrect.
Amazon EC2 and EBS require managing instances and volumes, which increases infrastructure management. While auto-scaling helps scalability, it doesn't fully minimize management overhead.
- C. Correct.
Amazon EMR is a managed distributed computing service ideal for large-scale data processing. Combined with Amazon S3 for storage, it provides scalability, fault tolerance, and minimal management.
- D. Incorrect.
Amazon RDS is designed for relational databases, not distributed data processing. While AWS Glue is suitable for ETL tasks, this combination is not ideal for the described scenario.
- E. Incorrect.
Amazon Redshift is optimized for data warehousing, not distributed data processing. Although Amazon S3 is suitable for long-term storage, this option doesn't align with the given requirements.