DEA-C01 Question 351
Select 2You are responsible for maintaining a data pipeline in AWS that processes real-time streaming data using Amazon Kinesis Data Streams and stores the results in Amazon S3. Upon monitoring, you notice that the data processing speed has significantly dropped compared to the incoming data rate. Which of the following actions can help you identify and resolve the issue?
- A
Enable enhanced monitoring for Amazon Kinesis Data Streams to analyze shard-level metrics.
- B
Increase the number of shards in the Kinesis Data Stream to handle more throughput.
- C
Check the Amazon CloudWatch metrics for the processing application to identify bottlenecks.
- D
Set up an AWS Lambda function to automatically scale the shards based on the incoming data rate.
- E
Review the Amazon S3 bucket policies to ensure data is being written correctly.
Show answer and explanation
Correct answers: A, C
Explanation
To maintain and monitor a data pipeline effectively, it's critical to gather detailed metrics to diagnose the root cause of performance issues. Enabling enhanced monitoring for Kinesis Data Streams provides shard-level insights, while CloudWatch metrics for the processing application can pinpoint resource bottlenecks. These steps ensure that you have the necessary data to address the performance degradation systematically.
- A. Correct.
Enabling enhanced monitoring for Kinesis Data Streams provides detailed shard-level metrics such as incoming and outgoing data throughput, which can help identify bottlenecks in the stream.
- B. Incorrect.
Increasing the number of shards is a possible resolution but not a diagnostic step. Without understanding the root cause, blindly increasing shards may not resolve the issue.
- C. Correct.
Checking CloudWatch metrics for the processing application helps identify specific bottlenecks, such as memory, CPU, or other resource constraints impacting performance.
- D. Incorrect.
Setting up a Lambda function for automatic shard scaling is a proactive measure but not directly related to diagnosing the current performance issue.
- E. Incorrect.
Reviewing the Amazon S3 bucket policies is irrelevant in this case, as the issue is related to processing speed rather than data storage permissions.