DEA-C01 Question 73
Single answerYou are designing a data pipeline that ingests raw data from multiple on-premises databases into AWS, processes it with AWS Glue, and loads the transformed data into Amazon Redshift for analysis. To ensure reliability and manageability, you want to use an intermediate data staging location before processing the data with AWS Glue. Which of the following options is the most appropriate intermediate data staging location for this scenario?
- A
Amazon S3
- B
Amazon DynamoDB
- C
Amazon RDS
- D
Amazon Kinesis Data Streams
Show answer and explanation
Correct answer: A
Explanation
Intermediate data staging locations are essential in data pipelines to ensure reliability, scalability, and integration with downstream services. In this scenario, Amazon S3 is the most appropriate choice as it is a durable, cost-effective, and highly compatible storage service that integrates well with AWS Glue for data processing. Other options like DynamoDB, RDS, and Kinesis Data Streams are not well-suited for this use case, as they are designed for specific purposes unrelated to intermediate data staging.
- A. Correct.
Amazon S3 is the best intermediate staging location in this scenario. It is highly scalable, cost-effective, and integrates seamlessly with AWS Glue. It also supports various data formats, making it an ideal choice for staging raw data.
- B. Incorrect.
Amazon DynamoDB is a NoSQL database and is not suited for intermediate data staging. It is designed for low-latency data retrieval and storage rather than large-scale data processing.
- C. Incorrect.
Amazon RDS is a relational database service and is not typically used for intermediate data staging. It is better suited for transactional workloads rather than staging raw data for processing.
- D. Incorrect.
Amazon Kinesis Data Streams is designed for real-time streaming data, not for staging batch data. It is not an appropriate choice for this use case where raw data is staged and processed in batches.