DEA-C01 Question 174
Single answerA data engineering team is processing a large volume of IoT sensor data and needs to store it in Amazon S3 for downstream analytics. The team wants to minimize storage costs and optimize query performance with Amazon Athena. Which data storage format should the team choose?
- A
CSV
- B
JSON
- C
Parquet
- D
TXT
Show answer and explanation
Correct answer: C
Explanation
Parquet is the best choice for this scenario because it is a columnar storage format that provides significant benefits in both storage efficiency (due to compression) and query performance (due to columnar access patterns). These features make it an ideal format for processing large-scale analytics workloads with Amazon Athena, which can take advantage of Parquet's structure to reduce scan times and costs.
- A. Incorrect.
CSV is a plain text format that is simple and widely supported, but it is not optimized for query performance or storage efficiency, especially for large datasets.
- B. Incorrect.
JSON is a semi-structured format that is flexible and supports hierarchical data, but it is not storage-efficient or optimized for query performance at scale.
- C. Correct.
Parquet is a columnar storage format that is highly efficient for both storage and query performance, especially for analytical workloads with tools like Amazon Athena.
- D. Incorrect.
TXT is a plain text format that offers no compression or optimization, making it unsuitable for minimizing storage costs or improving query performance.