MLS-C01 Question 15
Single answerYou are working on a machine learning project that involves training a deep learning model on a large dataset consisting of millions of high-resolution images. The model training process requires high throughput for reading and writing data, and the dataset needs to be shared across multiple EC2 instances during distributed training. Which storage medium is the most suitable for this use case?
- A
Amazon S3
- B
Amazon Elastic Block Store (Amazon EBS)
- C
Amazon Elastic File System (Amazon EFS)
- D
Amazon RDS
Show answer and explanation
Correct answer: C
Explanation
Amazon EFS is the most suitable storage option for this use case because it provides a shared file system that can be accessed concurrently by multiple EC2 instances, which is essential for distributed training. Additionally, it offers high throughput and is designed to handle the high-performance requirements of tasks like training deep learning models on large datasets. Other options, such as Amazon S3 and Amazon EBS, either do not provide the required file system interface or are not shareable across instances.
- A. Incorrect.
Amazon S3 is a highly scalable object storage service, but it is not optimized for high-throughput, low-latency operations that are common in distributed training scenarios. Additionally, S3 does not provide the file system interface required for distributed training.
- B. Incorrect.
Amazon EBS provides block storage for a single EC2 instance. While it offers high performance, it is not shareable across multiple EC2 instances, which is a key requirement for distributed training.
- C. Correct.
Amazon EFS is a file storage service that provides high throughput and can be accessed concurrently by multiple EC2 instances. It is well-suited for distributed machine learning training where data needs to be shared across instances.
- D. Incorrect.
Amazon RDS is a managed relational database service. While it is excellent for structured data storage and transactional workloads, it is not suitable for storing large unstructured datasets like images for machine learning training.