DOP-C02 Question 225
Select 2Your organization runs a large-scale e-commerce platform, and you are tasked with designing a solution to ingest and process real-time application logs for troubleshooting and monitoring. The solution must handle high-throughput, low-latency log ingestion across multiple AWS Regions and allow real-time querying of data. Which combination of services should you use to achieve this efficiently?
- A
Amazon Kinesis Data Streams and Amazon OpenSearch Service
- B
Amazon S3 and AWS Glue
- C
Amazon CloudWatch Logs and Amazon Athena
- D
Amazon Kinesis Firehose and Amazon S3
- E
Amazon Managed Streaming for Apache Kafka (MSK) and Amazon OpenSearch Service
Show answer and explanation
Correct answers: A, E
Explanation
For real-time log ingestion and querying, a combination of high-throughput, low-latency streaming services like Amazon Kinesis Data Streams or Amazon MSK with a querying and analytics service like Amazon OpenSearch Service is ideal. These solutions are designed to handle real-time data ingestion at scale and support low-latency queries for monitoring and troubleshooting, making them the best fit for the scenario presented.
- A. Correct.
Amazon Kinesis Data Streams is a fully managed service for real-time data streaming, and Amazon OpenSearch Service enables low-latency querying and analysis of log data. Together, they provide a robust solution for real-time log ingestion and querying.
- B. Incorrect.
Amazon S3 and AWS Glue are useful for batch processing and ETL workflows but are not optimized for real-time log ingestion and querying.
- C. Incorrect.
Amazon CloudWatch Logs allows log storage and monitoring, but it does not provide the high-throughput, low-latency capabilities required for real-time log ingestion and querying.
- D. Incorrect.
Amazon Kinesis Firehose can deliver logs to Amazon S3, but it is primarily designed for near real-time scenarios and lacks the querying capabilities provided by OpenSearch Service.
- E. Correct.
Amazon MSK is a managed service for Apache Kafka and can handle high-throughput real-time log ingestion. When paired with OpenSearch Service, it provides a scalable and low-latency solution for querying log data.