DEA-C01 Question 431
Select 3A data engineering team is tasked with deploying a data pipeline for processing streaming data. They are debating whether to use Amazon Kinesis Data Streams (managed service) or set up their own Apache Kafka cluster on Amazon EC2 (unmanaged service). Which of the following are advantages of using a managed service like Kinesis Data Streams over an unmanaged service like self-managed Apache Kafka?
- A
Reduced operational overhead and maintenance responsibility
- B
Greater control over fine-tuning the underlying infrastructure
- C
Automatic scaling to handle variable workloads
- D
Built-in integration with other AWS services
- E
Lower cost for large-scale deployments
Show answer and explanation
Correct answers: A, C, D
Explanation
Managed services, like Amazon Kinesis Data Streams, simplify the deployment and management of infrastructure by reducing operational overhead and providing features like automatic scaling and built-in integrations with other services. However, they trade off some control over fine-tuning the infrastructure and may not always be the most cost-effective solution for large-scale deployments compared to unmanaged services like self-hosted Apache Kafka.
- A. Correct.
Managed services like Kinesis Data Streams reduce operational overhead because AWS handles tasks such as patching, scaling, and infrastructure management.
- B. Incorrect.
Unmanaged services like self-managed Apache Kafka provide more control over the infrastructure, but managed services like Kinesis sacrifice some control to prioritize convenience and ease of use.
- C. Correct.
Managed services like Kinesis Data Streams offer automatic scaling, which simplifies handling fluctuating workloads without requiring manual intervention.
- D. Correct.
Kinesis Data Streams is tightly integrated with other AWS services, such as AWS Lambda, Amazon S3, and Amazon Redshift, streamlining workflows.
- E. Incorrect.
While managed services might reduce operational costs in certain scenarios, unmanaged services like self-hosted Apache Kafka can often be more cost-effective for large-scale deployments, especially with highly optimized configurations.