DEA-C01 Question 361
Select 3You are working as a Data Engineer for a company that runs a real-time application hosted on Amazon ECS. The application generates critical logs that need to be stored, analyzed, and monitored for operational issues. The logs should be centrally stored, durable, and searchable. Which of the following combination of services would you use to meet these requirements?
- A
Amazon CloudWatch Logs for storing and monitoring logs
- B
Amazon S3 for durable storage of processed logs
- C
Amazon Kinesis Data Firehose to stream logs to a destination
- D
Amazon RDS for storing the logs in a relational database
- E
AWS Glue for real-time log ingestion and analysis
Show answer and explanation
Correct answers: A, B, C
Explanation
To log application data effectively, you need a combination of services that fulfill the requirements of real-time ingestion, monitoring, and durable storage. Amazon CloudWatch Logs enables real-time monitoring and insights, while Amazon S3 provides durable storage for long-term use. Amazon Kinesis Data Firehose facilitates seamless streaming of logs from the application to storage or analytics services. RDS and Glue are not optimized for these specific use cases.
- A. Correct.
Amazon CloudWatch Logs is designed for storing, monitoring, and analyzing application logs. It provides log insights and helps with real-time monitoring, making it a key choice for operational log data.
- B. Correct.
Amazon S3 is a durable and cost-effective service for storing processed logs, especially for long-term storage and analytics use cases.
- C. Correct.
Amazon Kinesis Data Firehose is ideal for streaming log data from the application to other destinations like Amazon S3 or Amazon Redshift for further analysis.
- D. Incorrect.
Amazon RDS is not designed for real-time log storage or analysis; it is better suited for structured transactional data, not operational logs.
- E. Incorrect.
AWS Glue is primarily used for ETL (Extract, Transform, Load) operations on batch data, not for real-time log ingestion or analysis.