DEA-C01 Question 167
Single answerA data engineering team is building a real-time analytics pipeline that processes high-frequency financial transactions. The team requires a storage solution that provides consistent low-latency performance and supports high IOPS (Input/Output Operations Per Second) for storing and retrieving transaction data. Which storage service and configuration would best meet these requirements?
- A
Amazon S3 with S3 Intelligent-Tiering
- B
Amazon EBS with Provisioned IOPS SSD (io2)
- C
Amazon RDS with General Purpose SSD (gp3)
- D
Amazon EFS with Standard Storage Class
Show answer and explanation
Correct answer: B
Explanation
The scenario requires a storage solution that offers consistent low-latency and high IOPS for processing high-frequency financial transactions. Amazon EBS with Provisioned IOPS SSD (io2) is purpose-built for such workloads, delivering predictable, high-performance storage. Other options, such as Amazon S3, RDS with gp3, or EFS, do not meet the stringent performance demands of the described real-time analytics pipeline.
- A. Incorrect.
Amazon S3 with S3 Intelligent-Tiering is designed for cost optimization and automatically moves data between access tiers based on usage patterns. However, it is not optimized for low-latency performance or high IOPS, making it unsuitable for real-time transaction storage.
- B. Correct.
Amazon EBS with Provisioned IOPS SSD (io2) is specifically designed for applications requiring low-latency and high-performance storage. It provides predictable, consistent IOPS and is ideal for workloads like real-time analytics pipelines.
- C. Incorrect.
Amazon RDS with General Purpose SSD (gp3) is a good choice for general-purpose database workloads, but it does not provide the high IOPS and low-latency performance required for handling high-frequency transactional data.
- D. Incorrect.
Amazon EFS with Standard Storage Class is a scalable file storage solution for use cases like content management and shared file systems. However, it is not optimized for low-latency or high IOPS requirements, making it unsuitable for the scenario.