DOP-C02 Question 223
Select 3Your organization is deploying a real-time log ingestion pipeline to process and analyze application logs from multiple sources. The logs need to be ingested with minimal latency, stored securely, and processed in near real-time for insights. Which combination of AWS services would best achieve this goal?
- A
Amazon Kinesis Data Streams for log ingestion and processing.
- B
Amazon S3 for near real-time log storage and querying.
- C
AWS Lambda for processing and transforming the ingested logs.
- D
Amazon CloudWatch Logs Insights for querying and analyzing the logs.
- E
Amazon Athena for real-time log ingestion and analysis.
Show answer and explanation
Correct answers: A, C, D
Explanation
To build a real-time log ingestion pipeline, Amazon Kinesis Data Streams can handle the ingestion and buffering of streaming log data with minimal latency. AWS Lambda can process and transform these logs in real-time, while Amazon CloudWatch Logs Insights enables querying and analyzing the logs efficiently. This combination of services ensures minimal latency, secure storage, and near real-time processing and insights.
- A. Correct.
Amazon Kinesis Data Streams is ideal for real-time log ingestion and processing with minimal latency, making it suitable for this use case.
- B. Incorrect.
Amazon S3 is primarily used for long-term storage and batch processing rather than real-time processing, so it is not suitable for this specific requirement.
- C. Correct.
AWS Lambda can process and transform incoming logs in real-time, making it a key component in a real-time log ingestion pipeline.
- D. Correct.
Amazon CloudWatch Logs Insights is designed for querying and analyzing logs efficiently, which is necessary for deriving insights from the pipeline.
- E. Incorrect.
Amazon Athena is not suitable for real-time log ingestion and analysis as it is a query service for analyzing data stored in Amazon S3, which does not support real-time ingestion.