DEA-C01 Question 19
Select 2You are tasked with designing a data ingestion pipeline for a real-time stock trading platform. The platform requires near real-time visibility into stock trades, while also maintaining a full historical record of all trades for future analysis and compliance. Which ingestion patterns should you consider to meet these requirements?
- A
Use a streaming ingestion service like Amazon Kinesis Data Streams for real-time trade data, and store the data in Amazon S3 for historical analysis.
- B
Use AWS Glue for batch processing the trade data every 24 hours, and store the processed data in Amazon Redshift.
- C
Leverage Amazon Kinesis Data Firehose to deliver both real-time and batch data into Amazon S3 with different delivery streams.
- D
Use AWS Database Migration Service (DMS) to replicate stock trade data into Amazon Aurora for real-time processing and reporting.
Show answer and explanation
Correct answers: A, C
Explanation
To satisfy the requirement of near real-time visibility and maintaining a full historical record, a streaming ingestion pattern is necessary. Amazon Kinesis Data Streams or Kinesis Data Firehose are well-suited for real-time ingestion, while Amazon S3 can serve as a durable and cost-effective storage solution for historical data. Batch processing tools like AWS Glue or database migration tools like AWS DMS are not appropriate for this use case due to their latency or design focus.
- A. Correct.
This option is correct because Amazon Kinesis Data Streams is a suitable solution for real-time ingestion of stock trades, while Amazon S3 is an ideal storage solution for maintaining a full historical record.
- B. Incorrect.
This option is incorrect because AWS Glue is designed for batch processing, which introduces latency and does not support the near real-time visibility required for stock trading platforms.
- C. Correct.
This option is correct because Amazon Kinesis Data Firehose can deliver data to S3 with minimal latency and supports both real-time and batch processing needs, making it a good solution for handling both requirements simultaneously.
- D. Incorrect.
This option is incorrect because AWS DMS is primarily used for database migrations and not for real-time ingestion of streaming data like stock trades.